Jul 10 09:56:38 devstack cinder-volume[75983]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 10 09:56:38 devstack cinder-volume[75983]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 10 09:56:38 devstack cinder-volume[75983]: we strongly recommend against using it for new projects. Jul 10 09:56:38 devstack cinder-volume[75983]: If you are already using Eventlet, we recommend migrating to a different Jul 10 09:56:38 devstack cinder-volume[75983]: framework. For more detail see Jul 10 09:56:38 devstack cinder-volume[75983]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 10 09:56:38 devstack cinder-volume[75983]: import eventlet # noqa Jul 10 09:56:41 devstack cinder-volume[75983]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75983) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 09:56:41 devstack cinder-volume[75983]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75983) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 09:56:41 devstack cinder-volume[75983]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75983) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 09:56:42 devstack cinder-volume[75983]: INFO dbcounter [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] Registered counter for database cinder Jul 10 09:56:42 devstack cinder-volume[75983]: DEBUG oslo_db.sqlalchemy.engines [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75983) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 09:56:42 devstack cinder-volume[75983]: DEBUG dbcounter [-] [75983] Writer thread running {{(pid=75983) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 10 09:56:42 devstack cinder-volume[75983]: INFO cinder.rpc [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 10 09:56:42 devstack cinder-volume[75983]: INFO cinder.rpc [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 10 09:56:42 devstack cinder-volume[75983]: DEBUG oslo_db.sqlalchemy.engines [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75983) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 09:56:42 devstack cinder-volume[75983]: INFO cinder.volume.manager [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] Determined volume DB was empty at startup. Jul 10 09:56:42 devstack cinder-volume[75983]: DEBUG cinder.volume.manager [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75983) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 10 09:56:42 devstack cinder-volume[75983]: INFO cinder.volume.manager [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 10 09:56:42 devstack cinder-volume[75983]: WARNING stevedore.named [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 10 09:56:42 devstack cinder-volume[75983]: WARNING castellan.key_manager [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 09:56:42 devstack cinder-volume[75983]: WARNING cinder.keymgr.conf_key_mgr [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 09:56:42 devstack cinder-volume[75983]: DEBUG cinder.volume.drivers.lvm [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75983) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_concurrency.processutils [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75983) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_concurrency.processutils [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] CMD "cinder-rtstool verify" returned: 0 in 0.417s {{(pid=75983) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_db.sqlalchemy.engines [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75983) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 09:56:43 devstack cinder-volume[75983]: INFO cinder.rpc [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 10 09:56:43 devstack cinder-volume[75983]: INFO cinder.rpc [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 10 09:56:43 devstack cinder-volume[75983]: WARNING stevedore.named [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 10 09:56:43 devstack cinder-volume[75983]: WARNING castellan.key_manager [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 09:56:43 devstack cinder-volume[75983]: INFO cinder.volume.manager [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_db.sqlalchemy.engines [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75983) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 09:56:43 devstack cinder-volume[75983]: INFO oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] Starting 1 workers Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] Started child 76142 {{(pid=75983) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] Full set of CONF: {{(pid=75983) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] ******************************************************************************** {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] Configuration options gathered from: {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] ================================================================================ {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] allow_availability_zone_fallback = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] allow_compression_on_image_upload = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] allowed_direct_url_schemes = [] {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] api_rate_limit = True {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] auth_strategy = keystone {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] az_cache_duration = 3600 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] backend_availability_zone = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] backend_host = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] backend_name = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] backend_stats_polling_interval = 60 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] backup_api_class = cinder.backup.api.API {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] backup_name_template = backup-%s {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] backup_use_same_host = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] backup_use_temp_snapshot = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] chap_password = **** {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] chap_username = {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] cinder_internal_tenant_project_id = c19f0fa4fe10412198599da866fab23c {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] cinder_internal_tenant_user_id = b76e0cd8374b48a3b4dd3b2836f37042 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] cloned_volume_same_az = True {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] cluster = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] compression_format = gzip {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] compute_api_class = cinder.compute.nova.API {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] config_dir = [] {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] config_source = [] {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] control_exchange = openstack {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[76142]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] debug = True {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] default_availability_zone = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] default_group_type = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] default_volume_type = lvmdriver-1 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] disk_geometry = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] driver_client_cert = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] driver_client_cert_key = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] driver_data_namespace = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] driver_ssl_cert_path = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] driver_ssl_cert_verify = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] driver_use_ssl = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] enable_force_upload = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] enable_new_services = True {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] enable_unsupported_driver = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] enforce_multipath_for_image_xfer = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] filter_function = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] glance_api_insecure = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] glance_api_servers = ['http://192.168.122.152/image'] {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] glance_api_ssl_compression = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] glance_ca_certificates_file = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] glance_catalog_info = image:glance:publicURL {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] glance_certfile = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] glance_keyfile = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] glance_num_retries = 3 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] glance_request_timeout = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] goodness_function = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] graceful_shutdown_timeout = 5 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] group_api_class = cinder.group.api.API {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] host = devstack {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] image_compress_on_upload = True {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] image_conversion_address_space_limit = 1 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] image_conversion_cpu_limit = 60 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] image_conversion_disable = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] image_upload_use_cinder_backend = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] image_upload_use_internal_tenant = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] image_volume_cache_enabled = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] image_volume_cache_max_count = 0 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] image_volume_cache_max_size_gb = 0 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] init_host_max_objects_retrieval = 0 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] instance_format = [instance: %(uuid)s] {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] iscsi_target_flags = {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] iscsi_write_cache = on {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] iser_helper = tgtadm {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] iser_ip_address = 192.168.122.152 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] iser_port = 3260 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] log_color = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] log_config_append = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] log_dir = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] log_file = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] log_options = True {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] log_rotate_interval = 1 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] log_rotate_interval_type = days {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] log_rotation_type = none {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] max_age = 0 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] max_logfile_count = 30 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] max_logfile_size_mb = 200 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] max_over_subscription_ratio = 20.0 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] message_reap_interval = 86400 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] message_ttl = 2592000 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] migration_create_volume_timeout_secs = 300 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] monkey_patch = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] monkey_patch_modules = [] {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] my_ip = 192.168.122.152 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] no_snapshot_gb_quota = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] num_iser_scan_tries = 3 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] num_shell_tries = 3 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] num_volume_device_scan_tries = 3 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] nvmeof_conn_info_version = 1 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] nvmet_ns_id = 10 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] nvmet_port_id = 1 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] osapi_max_limit = 1000 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] osapi_volume_ext_list = [] {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] osapi_volume_listen_port = 8776 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] osapi_volume_use_ssl = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] osapi_volume_workers = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] per_volume_size_limit = -1 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] periodic_fuzzy_delay = 60 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] periodic_interval = 60 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] public_endpoint = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] publish_errors = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] quota_backup_gigabytes = 1000 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] quota_backups = 10 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] quota_gigabytes = 1000 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] quota_groups = 10 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] quota_snapshots = 10 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] quota_volumes = 10 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] rate_limit_burst = 0 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] rate_limit_except_level = CRITICAL {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] rate_limit_interval = 0 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] reinit_driver_count = 3 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] replication_device = **** {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] report_discard_supported = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] report_interval = 120 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] reservation_clean_interval = 86400 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] reservation_expire = 86400 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] reserved_image_namespaces = [] {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[76142]: INFO cinder.volume.manager [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] reserved_percentage = 0 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] rpc_response_timeout = 120 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] run_external_periodic_tasks = True {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] scst_target_driver = iscsi {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] scst_target_iqn_name = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] service_down_time = 720 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] shell_completion = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] snapshot_name_template = snapshot-%s {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] snapshot_same_host = True {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] split_loggers = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] state_path = /opt/stack/data/cinder {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] storage_availability_zone = nova {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] storage_protocol = iSCSI {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] syslog_log_facility = LOG_USER {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] target_helper = lioadm {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] target_ip_address = 192.168.122.152 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] target_port = 3260 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] target_protocol = iscsi {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] target_secondary_ip_addresses = [] {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] trace_flags = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] transport_url = **** {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] until_refresh = 0 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] use_chap_auth = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] use_default_quota_class = True {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] use_journal = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] use_json = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] use_multipath_for_image_xfer = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] use_stderr = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] use_syslog = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] verify_glance_signatures = enabled {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] volume_api_class = cinder.volume.api.API {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] volume_backend_name = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] volume_clear = zero {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] volume_clear_ionice = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] volume_clear_size = 0 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] volume_copy_bps_limit = 0 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] volume_dd_blocksize = 1M {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] volume_name_template = volume-%s {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] volume_service_inithost_offload = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] volume_usage_audit_period = month {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] zoning_mode = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] oslo_concurrency.disable_process_locking = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.040s {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] keystone_authtoken.auth_section = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] keystone_authtoken.auth_type = password {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] keystone_authtoken.auth_version = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] keystone_authtoken.cache = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] keystone_authtoken.certfile = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] keystone_authtoken.include_service_catalog = True {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] keystone_authtoken.insecure = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] keystone_authtoken.interface = public {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] keystone_authtoken.keyfile = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] keystone_authtoken.memcache_password = {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] keystone_authtoken.memcache_username = {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] keystone_authtoken.region_name = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] keystone_authtoken.service_type = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.152/identity {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] cache.backend = dogpile.cache.null {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] cache.backend_argument = **** {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] cache.backend_expiration_time = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] cache.config_prefix = cache.oslo {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] cache.debug_cache_backend = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] cache.enable_retry_client = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] cache.enable_socket_keepalive = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] cache.enabled = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] cache.expiration_time = 600 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] cache.hashclient_retry_attempts = 2 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] cache.memcache_dead_retry = 300 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] cache.memcache_pool_maxsize = 10 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] cache.memcache_sasl_enabled = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] cache.password = **** {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] cache.proxies = [] {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] cache.redis_db = 0 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] cache.redis_server = localhost:6379 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] cache.retry_attempts = 2 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] cache.retry_delay = 0.0 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] cache.socket_keepalive_count = 1 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] cache.socket_keepalive_idle = 1 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] cache.socket_keepalive_interval = 1 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] cache.socket_timeout = 1.0 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] cache.tls_allowed_ciphers = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] cache.tls_cafile = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] cache.tls_certfile = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] cache.tls_enabled = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] cache.tls_keyfile = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] cache.username = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] coordination.backend_url = **** {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.058s {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] database.asyncio_connection = **** {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] database.asyncio_slave_connection = **** {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] database.backend = sqlalchemy {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] database.connection = **** {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] database.connection_debug = 0 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] database.connection_parameters = {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] database.connection_recycle_time = 3600 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] database.connection_trace = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] database.db_inc_retry_interval = True {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] database.db_max_retries = 20 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] database.db_max_retry_interval = 10 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] database.db_retry_interval = 1 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] database.max_overflow = 50 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] database.max_pool_size = 5 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] database.max_retries = 10 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] database.mysql_wsrep_sync_wait = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] database.pool_timeout = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] database.retry_interval = 10 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] database.slave_connection = **** {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] database.sqlite_synchronous = True {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] database.synchronous_reader = True {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] database.use_db_reconnect = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] profiler.connection_string = messaging:// {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] profiler.enabled = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] profiler.es_doc_type = notification {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] profiler.es_scroll_size = 10000 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] profiler.es_scroll_time = 2m {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] profiler.filter_error_trace = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] profiler.hmac_keys = **** {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] profiler.sentinel_service_name = mymaster {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] profiler.socket_timeout = 0.1 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] profiler.trace_requests = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] profiler.trace_sqlalchemy = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] profiler_jaeger.process_tags = {} {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] profiler_jaeger.service_name_prefix = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] profiler_otlp.service_name_prefix = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] oslo_policy.enforce_new_defaults = True {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] oslo_policy.enforce_scope = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] oslo_policy.policy_default_rule = default {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] oslo_policy.policy_file = policy.yaml {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] privsep_osbrick.group = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] privsep_osbrick.helper_command = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] privsep_osbrick.user = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] cinder_sys_admin.group = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] cinder_sys_admin.helper_command = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] cinder_sys_admin.user = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] service_user.auth_section = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] service_user.auth_type = password {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] service_user.cafile = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] service_user.certfile = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] service_user.collect_timing = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] service_user.insecure = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] service_user.keyfile = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] service_user.send_service_user_token = True {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] service_user.split_loggers = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] service_user.timeout = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] glance.auth_section = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] glance.auth_type = password {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] glance.certfile = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] glance.collect_timing = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] glance.insecure = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] glance.keyfile = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] glance.region_name = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] glance.split_loggers = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] glance.timeout = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] backend_defaults.backend_availability_zone = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] backend_defaults.chap_password = **** {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] backend_defaults.chap_username = {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] backend_defaults.disk_geometry = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] backend_defaults.driver_client_cert = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] backend_defaults.driver_client_cert_key = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] backend_defaults.driver_data_namespace = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack sudo[76148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] backend_defaults.driver_use_ssl = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack sudo[76148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] backend_defaults.extra_capabilities = {} {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] backend_defaults.filter_function = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] backend_defaults.goodness_function = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] backend_defaults.iscsi_target_flags = {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] backend_defaults.iscsi_write_cache = on {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] backend_defaults.iser_helper = tgtadm {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] backend_defaults.iser_ip_address = 192.168.122.152 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] backend_defaults.iser_port = 3260 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] backend_defaults.lvm_share_target = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] backend_defaults.lvm_type = auto {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] backend_defaults.num_shell_tries = 3 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] backend_defaults.replication_device = **** {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] backend_defaults.report_discard_supported = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] backend_defaults.reserved_percentage = 0 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] backend_defaults.target_helper = tgtadm {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] backend_defaults.target_ip_address = 192.168.122.152 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] backend_defaults.target_port = 3260 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] backend_defaults.target_protocol = iscsi {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] backend_defaults.trace_flags = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] backend_defaults.unique_fqdn_network = True {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] backend_defaults.use_chap_auth = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] backend_defaults.volume_backend_name = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] backend_defaults.volume_clear = zero {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] backend_defaults.volume_clear_ionice = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] backend_defaults.volume_clear_size = 0 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] oslo_reports.file_event_handler = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] oslo_reports.log_dir = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] lvmdriver-1.backend_host = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] lvmdriver-1.chap_password = **** {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] lvmdriver-1.chap_username = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] lvmdriver-1.disk_geometry = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] lvmdriver-1.driver_client_cert = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] lvmdriver-1.extra_capabilities = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] lvmdriver-1.filter_function = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] lvmdriver-1.goodness_function = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] lvmdriver-1.iser_helper = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] lvmdriver-1.iser_ip_address = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] lvmdriver-1.iser_port = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] lvmdriver-1.lvm_share_target = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] lvmdriver-1.lvm_type = auto {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] lvmdriver-1.num_shell_tries = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] lvmdriver-1.replication_device = **** {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] lvmdriver-1.report_discard_supported = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] lvmdriver-1.reserved_percentage = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] lvmdriver-1.scst_target_driver = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] lvmdriver-1.storage_protocol = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] lvmdriver-1.target_helper = lioadm {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] lvmdriver-1.target_ip_address = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] lvmdriver-1.target_port = 3260 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] lvmdriver-1.trace_flags = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] lvmdriver-1.use_chap_auth = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] lvmdriver-1.volume_clear = zero {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] lvmdriver-1.volume_clear_size = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] lvmdriver-1.volumes_dir = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] oslo_messaging_rabbit.ssl = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] oslo_messaging_notifications.driver = [] {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] oslo_messaging_notifications.retry = -1 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] key_manager.fixed_key = **** {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] barbican.barbican_api_version = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] barbican.barbican_endpoint = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] barbican.barbican_endpoint_type = public {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] barbican.barbican_region_name = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] barbican.cafile = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] barbican.certfile = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] barbican.collect_timing = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] barbican.insecure = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] barbican.keyfile = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] barbican.number_of_retries = 60 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] barbican.retry_delay = 1 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] barbican.send_service_user_token = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] barbican.split_loggers = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] barbican.timeout = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] barbican.verify_ssl = True {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] barbican.verify_ssl_path = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] barbican_service_user.auth_section = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] barbican_service_user.auth_type = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] barbican_service_user.cafile = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] barbican_service_user.certfile = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] barbican_service_user.collect_timing = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] barbican_service_user.insecure = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] barbican_service_user.keyfile = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] barbican_service_user.split_loggers = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] barbican_service_user.timeout = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] vault.approle_role_id = **** {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] vault.approle_secret_id = **** {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] vault.kv_mountpoint = secret {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] vault.kv_path = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] vault.kv_version = 2 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] vault.namespace = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] vault.root_token_id = **** {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] vault.ssl_ca_crt_file = None {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] vault.timeout = 60.0 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] vault.use_ssl = False {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 09:56:43 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] ******************************************************************************** {{(pid=75983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 10 09:56:44 devstack sudo[76148]: pam_unix(sudo:session): session closed for user root Jul 10 09:56:44 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.672s {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 09:56:44 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 09:56:44 devstack sudo[76242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 09:56:44 devstack sudo[76242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 09:56:45 devstack sudo[76242]: pam_unix(sudo:session): session closed for user root Jul 10 09:56:45 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.643s {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 09:56:45 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 09:56:45 devstack cinder-volume[76142]: INFO cinder.brick.local_dev.lvm [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 10 09:56:45 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 09:56:45 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 09:56:45 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 09:56:45 devstack sudo[76458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 09:56:45 devstack sudo[76458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 09:56:45 devstack sudo[76458]: pam_unix(sudo:session): session closed for user root Jul 10 09:56:45 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.673s {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 09:56:45 devstack cinder-volume[76142]: DEBUG cinder.brick.local_dev.lvm [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76142) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jul 10 09:56:45 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 09:56:45 devstack sudo[76692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 09:56:45 devstack sudo[76692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 09:56:47 devstack sudo[76692]: pam_unix(sudo:session): session closed for user root Jul 10 09:56:47 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.275s {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 09:56:47 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 09:56:47 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 09:56:47 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 09:56:47 devstack sudo[76922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 09:56:47 devstack sudo[76922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 09:56:47 devstack sudo[76922]: pam_unix(sudo:session): session closed for user root Jul 10 09:56:47 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.705s {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 09:56:47 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 09:56:47 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 09:56:47 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 09:56:47 devstack sudo[76927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 10 09:56:47 devstack sudo[76927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 09:56:48 devstack sudo[76927]: pam_unix(sudo:session): session closed for user root Jul 10 09:56:48 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.653s {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 09:56:48 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 09:56:48 devstack sudo[76931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 09:56:48 devstack sudo[76931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 09:56:49 devstack sudo[76931]: pam_unix(sudo:session): session closed for user root Jul 10 09:56:49 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.859s {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 09:56:49 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 09:56:49 devstack sudo[76935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 09:56:49 devstack sudo[76935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 09:56:50 devstack sudo[76935]: pam_unix(sudo:session): session closed for user root Jul 10 09:56:50 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.871s {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 09:56:50 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 09:56:50 devstack sudo[76946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 09:56:50 devstack sudo[76946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 09:56:51 devstack sudo[76946]: pam_unix(sudo:session): session closed for user root Jul 10 09:56:51 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.760s {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 09:56:51 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 09:56:51 devstack sudo[76956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 09:56:51 devstack sudo[76956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 09:56:51 devstack sudo[76956]: pam_unix(sudo:session): session closed for user root Jul 10 09:56:51 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.688s {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 09:56:51 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 09:56:51 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 09:56:51 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 09:56:51 devstack sudo[76961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 09:56:51 devstack sudo[76961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 09:56:52 devstack sudo[76961]: pam_unix(sudo:session): session closed for user root Jul 10 09:56:52 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.682s {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 09:56:52 devstack cinder-volume[76142]: INFO cinder.volume.drivers.lvm [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 10 09:56:52 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 09:56:52 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 09:56:52 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 09:56:52 devstack sudo[76971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 09:56:52 devstack sudo[76971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 09:56:53 devstack sudo[76971]: pam_unix(sudo:session): session closed for user root Jul 10 09:56:53 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.747s {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 09:56:53 devstack cinder-volume[76142]: DEBUG cinder.volume.drivers.lvm [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] Updating volume stats {{(pid=76142) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 10 09:56:53 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 09:56:53 devstack sudo[77084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 09:56:53 devstack sudo[77084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 09:56:53 devstack cinder-volume[75983]: DEBUG dbcounter [-] [75983] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75983) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 09:56:53 devstack sudo[77084]: pam_unix(sudo:session): session closed for user root Jul 10 09:56:53 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.743s {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 09:56:53 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 09:56:53 devstack sudo[77229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 09:56:53 devstack sudo[77229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 09:56:54 devstack sudo[77229]: pam_unix(sudo:session): session closed for user root Jul 10 09:56:54 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.620s {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 09:56:54 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 09:56:54 devstack sudo[77233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 09:56:54 devstack sudo[77233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 09:56:55 devstack sudo[77233]: pam_unix(sudo:session): session closed for user root Jul 10 09:56:55 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.642s {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 09:56:55 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 09:56:55 devstack sudo[77236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 09:56:55 devstack sudo[77236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 09:56:55 devstack sudo[77236]: pam_unix(sudo:session): session closed for user root Jul 10 09:56:55 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.645s {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 09:56:55 devstack cinder-volume[76142]: INFO cinder.volume.driver [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] Driver hasn't implemented _init_vendor_properties() Jul 10 09:56:55 devstack cinder-volume[76142]: DEBUG cinder.volume.driver [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76142) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 10 09:56:55 devstack cinder-volume[76142]: DEBUG oslo_db.sqlalchemy.engines [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76142) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 09:56:55 devstack cinder-volume[76142]: DEBUG dbcounter [-] [76142] Writer thread running {{(pid=76142) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 10 09:56:55 devstack cinder-volume[76142]: DEBUG cinder.db.api [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] Building query based on filter {{(pid=76142) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 10 09:56:55 devstack cinder-volume[76142]: DEBUG cinder.image.image_utils [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76142) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 10 09:56:55 devstack cinder-volume[76142]: INFO cinder.keymgr.migration [None req-8ed346e1-430d-4c07-a472-bd99b5054a90 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 10 09:56:55 devstack cinder-volume[76142]: DEBUG cinder.volume.drivers.lvm [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] Updating volume stats {{(pid=76142) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 10 09:56:55 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 09:56:55 devstack sudo[77242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 09:56:55 devstack sudo[77242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 09:56:56 devstack sudo[77242]: pam_unix(sudo:session): session closed for user root Jul 10 09:56:56 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.659s {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 09:56:56 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 09:56:56 devstack sudo[77245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 09:56:56 devstack sudo[77245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 09:56:57 devstack sudo[77245]: pam_unix(sudo:session): session closed for user root Jul 10 09:56:57 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.689s {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 09:56:57 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 09:56:57 devstack sudo[77251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 09:56:57 devstack sudo[77251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 09:56:58 devstack sudo[77251]: pam_unix(sudo:session): session closed for user root Jul 10 09:56:58 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.707s {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 09:56:58 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 09:56:58 devstack sudo[77255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 09:56:58 devstack sudo[77255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 09:56:58 devstack sudo[77255]: pam_unix(sudo:session): session closed for user root Jul 10 09:56:58 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.623s {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 09:56:58 devstack cinder-volume[76142]: DEBUG cinder.manager [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] Notifying Schedulers of capabilities ... {{(pid=76142) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 09:56:58 devstack cinder-volume[76142]: INFO cinder.volume.manager [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] Driver initialization completed successfully. Jul 10 09:56:58 devstack cinder-volume[76142]: INFO cinder.manager [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] Initiating service 2 cleanup Jul 10 09:56:58 devstack cinder-volume[76142]: INFO cinder.manager [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] Service 2 cleanup completed. Jul 10 09:56:58 devstack cinder-volume[76142]: DEBUG cinder.service [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] Creating RPC server for service cinder-volume {{(pid=76142) start /opt/stack/cinder/cinder/service.py:231}} Jul 10 09:56:58 devstack cinder-volume[76142]: DEBUG cinder.service [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76142) start /opt/stack/cinder/cinder/service.py:237}} Jul 10 09:56:58 devstack cinder-volume[76142]: INFO cinder.volume.manager [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 10 09:56:58 devstack cinder-volume[76142]: DEBUG cinder.volume.drivers.lvm [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] Updating volume stats {{(pid=76142) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 10 09:56:58 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 09:56:58 devstack sudo[77259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 09:56:58 devstack sudo[77259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 09:56:59 devstack sudo[77259]: pam_unix(sudo:session): session closed for user root Jul 10 09:56:59 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.685s {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 09:56:59 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 09:56:59 devstack sudo[77262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 09:56:59 devstack sudo[77262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 09:57:00 devstack sudo[77262]: pam_unix(sudo:session): session closed for user root Jul 10 09:57:00 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.679s {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 09:57:00 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 09:57:00 devstack sudo[77317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 09:57:00 devstack sudo[77317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 09:57:00 devstack sudo[77317]: pam_unix(sudo:session): session closed for user root Jul 10 09:57:00 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.644s {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 09:57:00 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 09:57:00 devstack sudo[77325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 09:57:00 devstack sudo[77325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 09:57:01 devstack sudo[77325]: pam_unix(sudo:session): session closed for user root Jul 10 09:57:01 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.639s {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 09:57:01 devstack cinder-volume[76142]: INFO cinder.volume.manager [None req-d2ec8aa3-2b5e-4109-b098-c1d9361a095f None None] Driver post RPC initialization completed successfully. Jul 10 09:57:11 devstack cinder-volume[76142]: DEBUG dbcounter [-] [76142] Writing DB stats cinder:SELECT=4 {{(pid=76142) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 09:57:11 devstack cinder-volume[76142]: DEBUG dbcounter [-] [76142] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76142) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 09:57:49 devstack cinder-volume[76142]: DEBUG oslo_service.periodic_task [None req-25b2d1f8-30cc-4b70-afca-e53d53fbde43 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76142) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 09:57:49 devstack cinder-volume[76142]: DEBUG cinder.volume.drivers.lvm [None req-25b2d1f8-30cc-4b70-afca-e53d53fbde43 None None] Updating volume stats {{(pid=76142) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 10 09:57:49 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-25b2d1f8-30cc-4b70-afca-e53d53fbde43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 09:57:49 devstack sudo[78940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 09:57:49 devstack sudo[78940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 09:57:50 devstack sudo[78940]: pam_unix(sudo:session): session closed for user root Jul 10 09:57:50 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-25b2d1f8-30cc-4b70-afca-e53d53fbde43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.638s {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 09:57:50 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-25b2d1f8-30cc-4b70-afca-e53d53fbde43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 09:57:50 devstack sudo[78943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 09:57:50 devstack sudo[78943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 09:57:50 devstack sudo[78943]: pam_unix(sudo:session): session closed for user root Jul 10 09:57:50 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-25b2d1f8-30cc-4b70-afca-e53d53fbde43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.649s {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 09:57:50 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-25b2d1f8-30cc-4b70-afca-e53d53fbde43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 09:57:50 devstack sudo[78946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 09:57:50 devstack sudo[78946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 09:57:51 devstack sudo[78946]: pam_unix(sudo:session): session closed for user root Jul 10 09:57:51 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-25b2d1f8-30cc-4b70-afca-e53d53fbde43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.656s {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 09:57:51 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-25b2d1f8-30cc-4b70-afca-e53d53fbde43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 09:57:51 devstack sudo[78989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 09:57:51 devstack sudo[78989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 09:57:52 devstack sudo[78989]: pam_unix(sudo:session): session closed for user root Jul 10 09:57:52 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-25b2d1f8-30cc-4b70-afca-e53d53fbde43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.617s {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 09:57:52 devstack cinder-volume[76142]: DEBUG cinder.manager [None req-25b2d1f8-30cc-4b70-afca-e53d53fbde43 None None] Notifying Schedulers of capabilities ... {{(pid=76142) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 09:57:52 devstack cinder-volume[76142]: DEBUG oslo_service.periodic_task [None req-25b2d1f8-30cc-4b70-afca-e53d53fbde43 None None] Running periodic task VolumeManager._thread_info {{(pid=76142) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 09:57:52 devstack cinder-volume[76142]: DEBUG cinder.volume.manager [None req-25b2d1f8-30cc-4b70-afca-e53d53fbde43 None None] thread count: 6 {{(pid=76142) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 09:57:52 devstack cinder-volume[76142]: DEBUG cinder.volume.manager [None req-25b2d1f8-30cc-4b70-afca-e53d53fbde43 None None] thread info: [<_MainThread(MainThread, started 133548961009792)>, , , , , ] {{(pid=76142) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 09:58:49 devstack cinder-volume[76142]: DEBUG oslo_service.periodic_task [None req-25b2d1f8-30cc-4b70-afca-e53d53fbde43 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76142) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 09:58:49 devstack cinder-volume[76142]: DEBUG cinder.volume.drivers.lvm [None req-25b2d1f8-30cc-4b70-afca-e53d53fbde43 None None] Updating volume stats {{(pid=76142) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 10 09:58:49 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-25b2d1f8-30cc-4b70-afca-e53d53fbde43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 09:58:49 devstack sudo[82246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 09:58:49 devstack sudo[82246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 09:58:50 devstack sudo[82246]: pam_unix(sudo:session): session closed for user root Jul 10 09:58:50 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-25b2d1f8-30cc-4b70-afca-e53d53fbde43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.646s {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 09:58:50 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-25b2d1f8-30cc-4b70-afca-e53d53fbde43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 09:58:50 devstack sudo[82249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 09:58:50 devstack sudo[82249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 09:58:50 devstack sudo[82249]: pam_unix(sudo:session): session closed for user root Jul 10 09:58:50 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-25b2d1f8-30cc-4b70-afca-e53d53fbde43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.660s {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 09:58:50 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-25b2d1f8-30cc-4b70-afca-e53d53fbde43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 09:58:50 devstack sudo[82252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 09:58:50 devstack sudo[82252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 09:58:51 devstack sudo[82252]: pam_unix(sudo:session): session closed for user root Jul 10 09:58:51 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-25b2d1f8-30cc-4b70-afca-e53d53fbde43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.652s {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 09:58:51 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-25b2d1f8-30cc-4b70-afca-e53d53fbde43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 09:58:51 devstack sudo[82255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 09:58:51 devstack sudo[82255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 09:58:52 devstack sudo[82255]: pam_unix(sudo:session): session closed for user root Jul 10 09:58:52 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-25b2d1f8-30cc-4b70-afca-e53d53fbde43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.639s {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 09:58:52 devstack cinder-volume[76142]: DEBUG cinder.manager [None req-25b2d1f8-30cc-4b70-afca-e53d53fbde43 None None] Notifying Schedulers of capabilities ... {{(pid=76142) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 09:58:52 devstack cinder-volume[76142]: DEBUG oslo_service.periodic_task [None req-25b2d1f8-30cc-4b70-afca-e53d53fbde43 None None] Running periodic task VolumeManager._thread_info {{(pid=76142) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 09:58:52 devstack cinder-volume[76142]: DEBUG cinder.volume.manager [None req-25b2d1f8-30cc-4b70-afca-e53d53fbde43 None None] thread count: 6 {{(pid=76142) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 09:58:52 devstack cinder-volume[76142]: DEBUG cinder.volume.manager [None req-25b2d1f8-30cc-4b70-afca-e53d53fbde43 None None] thread info: [<_MainThread(MainThread, started 133548961009792)>, , , , , ] {{(pid=76142) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 09:59:11 devstack cinder-volume[76142]: DEBUG dbcounter [-] [76142] Writing DB stats cinder:SELECT=1 {{(pid=76142) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 09:59:11 devstack cinder-volume[76142]: DEBUG dbcounter [-] [76142] Writing DB stats cinder:UPDATE=1 {{(pid=76142) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 09:59:49 devstack cinder-volume[76142]: DEBUG oslo_service.periodic_task [None req-25b2d1f8-30cc-4b70-afca-e53d53fbde43 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76142) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 09:59:49 devstack cinder-volume[76142]: DEBUG cinder.volume.drivers.lvm [None req-25b2d1f8-30cc-4b70-afca-e53d53fbde43 None None] Updating volume stats {{(pid=76142) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 10 09:59:49 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-25b2d1f8-30cc-4b70-afca-e53d53fbde43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 09:59:49 devstack sudo[84098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 09:59:49 devstack sudo[84098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 09:59:50 devstack sudo[84098]: pam_unix(sudo:session): session closed for user root Jul 10 09:59:50 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-25b2d1f8-30cc-4b70-afca-e53d53fbde43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.621s {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 09:59:50 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-25b2d1f8-30cc-4b70-afca-e53d53fbde43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 09:59:50 devstack sudo[84101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 09:59:50 devstack sudo[84101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 09:59:50 devstack sudo[84101]: pam_unix(sudo:session): session closed for user root Jul 10 09:59:50 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-25b2d1f8-30cc-4b70-afca-e53d53fbde43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.704s {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 09:59:50 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-25b2d1f8-30cc-4b70-afca-e53d53fbde43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 09:59:50 devstack sudo[84104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 09:59:50 devstack sudo[84104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 09:59:51 devstack sudo[84104]: pam_unix(sudo:session): session closed for user root Jul 10 09:59:51 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-25b2d1f8-30cc-4b70-afca-e53d53fbde43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.661s {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 09:59:51 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-25b2d1f8-30cc-4b70-afca-e53d53fbde43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 09:59:51 devstack sudo[84116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 09:59:51 devstack sudo[84116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 09:59:52 devstack sudo[84116]: pam_unix(sudo:session): session closed for user root Jul 10 09:59:52 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-25b2d1f8-30cc-4b70-afca-e53d53fbde43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.647s {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 09:59:52 devstack cinder-volume[76142]: DEBUG cinder.manager [None req-25b2d1f8-30cc-4b70-afca-e53d53fbde43 None None] Notifying Schedulers of capabilities ... {{(pid=76142) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:00:49 devstack cinder-volume[76142]: DEBUG oslo_service.periodic_task [None req-25b2d1f8-30cc-4b70-afca-e53d53fbde43 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76142) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 10:00:49 devstack cinder-volume[76142]: DEBUG cinder.volume.drivers.lvm [None req-25b2d1f8-30cc-4b70-afca-e53d53fbde43 None None] Updating volume stats {{(pid=76142) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 10 10:00:49 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-25b2d1f8-30cc-4b70-afca-e53d53fbde43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:00:49 devstack sudo[85395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 10:00:49 devstack sudo[85395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:00:50 devstack sudo[85395]: pam_unix(sudo:session): session closed for user root Jul 10 10:00:50 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-25b2d1f8-30cc-4b70-afca-e53d53fbde43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.670s {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:00:50 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-25b2d1f8-30cc-4b70-afca-e53d53fbde43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:00:50 devstack sudo[85407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 10:00:50 devstack sudo[85407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:00:50 devstack sudo[85407]: pam_unix(sudo:session): session closed for user root Jul 10 10:00:50 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-25b2d1f8-30cc-4b70-afca-e53d53fbde43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.660s {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:00:50 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-25b2d1f8-30cc-4b70-afca-e53d53fbde43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:00:50 devstack sudo[85411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 10:00:50 devstack sudo[85411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:00:51 devstack sudo[85411]: pam_unix(sudo:session): session closed for user root Jul 10 10:00:51 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-25b2d1f8-30cc-4b70-afca-e53d53fbde43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.622s {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:00:51 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-25b2d1f8-30cc-4b70-afca-e53d53fbde43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:00:51 devstack sudo[85425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 10:00:51 devstack sudo[85425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:00:52 devstack sudo[85425]: pam_unix(sudo:session): session closed for user root Jul 10 10:00:52 devstack cinder-volume[76142]: DEBUG oslo_concurrency.processutils [None req-25b2d1f8-30cc-4b70-afca-e53d53fbde43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.651s {{(pid=76142) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:00:52 devstack cinder-volume[76142]: DEBUG cinder.manager [None req-25b2d1f8-30cc-4b70-afca-e53d53fbde43 None None] Notifying Schedulers of capabilities ... {{(pid=76142) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:00:52 devstack cinder-volume[76142]: DEBUG oslo_service.periodic_task [None req-25b2d1f8-30cc-4b70-afca-e53d53fbde43 None None] Running periodic task VolumeManager._thread_info {{(pid=76142) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 10:00:52 devstack cinder-volume[76142]: DEBUG cinder.volume.manager [None req-25b2d1f8-30cc-4b70-afca-e53d53fbde43 None None] thread count: 6 {{(pid=76142) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 10:00:52 devstack cinder-volume[76142]: DEBUG cinder.volume.manager [None req-25b2d1f8-30cc-4b70-afca-e53d53fbde43 None None] thread info: [<_MainThread(MainThread, started 133548961009792)>, , , , , ] {{(pid=76142) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 10:01:11 devstack cinder-volume[76142]: DEBUG dbcounter [-] [76142] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76142) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 10:01:24 devstack cinder-volume[75983]: INFO oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] Caught SIGTERM, stopping children Jul 10 10:01:24 devstack cinder-volume[75983]: DEBUG oslo_concurrency.lockutils [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] Acquiring lock "singleton_lock" {{(pid=75983) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 10:01:24 devstack cinder-volume[75983]: DEBUG oslo_concurrency.lockutils [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] Acquired lock "singleton_lock" {{(pid=75983) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 10:01:24 devstack cinder-volume[75983]: DEBUG oslo_concurrency.lockutils [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] Releasing lock "singleton_lock" {{(pid=75983) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 10:01:24 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] Stop services. {{(pid=75983) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 10 10:01:24 devstack cinder-volume[75983]: DEBUG oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] Killing children. {{(pid=75983) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 10 10:01:24 devstack cinder-volume[75983]: INFO oslo_service.backend._eventlet.service [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] Waiting on 1 children to exit Jul 10 10:01:29 devstack cinder-volume[76142]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Jul 10 10:01:30 devstack cinder-volume[86317]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 10 10:01:30 devstack cinder-volume[86317]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 10 10:01:30 devstack cinder-volume[86317]: we strongly recommend against using it for new projects. Jul 10 10:01:30 devstack cinder-volume[86317]: If you are already using Eventlet, we recommend migrating to a different Jul 10 10:01:30 devstack cinder-volume[86317]: framework. For more detail see Jul 10 10:01:30 devstack cinder-volume[86317]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 10 10:01:30 devstack cinder-volume[86317]: import eventlet # noqa Jul 10 10:01:32 devstack cinder-volume[86317]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86317) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 10:01:32 devstack cinder-volume[86317]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86317) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 10:01:32 devstack cinder-volume[86317]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86317) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 10:01:32 devstack cinder-volume[86317]: INFO dbcounter [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] Registered counter for database cinder Jul 10 10:01:32 devstack cinder-volume[86317]: DEBUG oslo_db.sqlalchemy.engines [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86317) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG dbcounter [-] [86317] Writer thread running {{(pid=86317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 10 10:01:33 devstack cinder-volume[86317]: INFO cinder.rpc [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 10 10:01:33 devstack cinder-volume[86317]: INFO cinder.rpc [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_db.sqlalchemy.engines [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86317) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 10:01:33 devstack cinder-volume[86317]: INFO cinder.volume.manager [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] Determined volume DB was empty at startup. Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG cinder.volume.manager [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86317) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 10 10:01:33 devstack cinder-volume[86317]: INFO cinder.volume.manager [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 10 10:01:33 devstack cinder-volume[86317]: WARNING stevedore.named [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 10 10:01:33 devstack cinder-volume[86317]: WARNING castellan.key_manager [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 10:01:33 devstack cinder-volume[86317]: WARNING cinder.keymgr.conf_key_mgr [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 10:01:33 devstack cinder-volume[86317]: INFO cinder.volume.manager [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_db.sqlalchemy.engines [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86317) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 10:01:33 devstack cinder-volume[86317]: INFO oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] Starting 1 workers Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] Started child 86582 {{(pid=86317) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] Full set of CONF: {{(pid=86317) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] ******************************************************************************** {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] Configuration options gathered from: {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] ================================================================================ {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] allow_availability_zone_fallback = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86582]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] allow_compression_on_image_upload = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] allowed_direct_url_schemes = [] {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] api_rate_limit = True {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] auth_strategy = keystone {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_availability_zone = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_host = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_name = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_stats_polling_interval = 60 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backup_api_class = cinder.backup.api.API {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backup_name_template = backup-%s {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backup_use_same_host = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backup_use_temp_snapshot = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] chap_password = **** {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] chap_username = {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] cinder_internal_tenant_project_id = c19f0fa4fe10412198599da866fab23c {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] cinder_internal_tenant_user_id = b76e0cd8374b48a3b4dd3b2836f37042 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] cluster = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] compression_format = gzip {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] compute_api_class = cinder.compute.nova.API {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] config_dir = [] {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] config_source = [] {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] control_exchange = openstack {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] debug = True {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] default_availability_zone = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] default_group_type = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] default_volume_type = QuobyteHD {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] disk_geometry = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] driver_client_cert = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] driver_client_cert_key = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] driver_data_namespace = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] driver_ssl_cert_path = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] driver_ssl_cert_verify = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] driver_use_ssl = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] enable_new_services = True {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] enable_unsupported_driver = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] enabled_backends = ['QuobyteHD'] {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] enforce_multipath_for_image_xfer = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] filter_function = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] glance_api_insecure = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] glance_api_servers = ['http://192.168.122.152/image'] {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] glance_api_ssl_compression = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] glance_ca_certificates_file = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] glance_catalog_info = image:glance:publicURL {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] glance_certfile = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] glance_keyfile = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] glance_num_retries = 3 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] glance_request_timeout = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] goodness_function = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] graceful_shutdown_timeout = 5 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] group_api_class = cinder.group.api.API {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] host = devstack {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] image_compress_on_upload = True {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] image_conversion_address_space_limit = 1 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] image_conversion_cpu_limit = 60 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] image_conversion_disable = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] image_upload_use_cinder_backend = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] image_upload_use_internal_tenant = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] image_volume_cache_enabled = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] image_volume_cache_max_count = 0 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] image_volume_cache_max_size_gb = 0 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] init_host_max_objects_retrieval = 0 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86582]: INFO cinder.volume.manager [None req-8fd9ff3a-bceb-48df-8c4d-5d06a36d6123 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 10 10:01:33 devstack cinder-volume[86582]: DEBUG cinder.volume.drivers.remotefs [None req-8fd9ff3a-bceb-48df-8c4d-5d06a36d6123 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86582) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] instance_format = [instance: %(uuid)s] {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] iscsi_target_flags = {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] iscsi_write_cache = on {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] iser_helper = tgtadm {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] iser_ip_address = 192.168.122.152 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] iser_port = 3260 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] log_color = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] log_config_append = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] log_dir = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] log_file = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] log_options = True {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] log_rotate_interval = 1 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] log_rotate_interval_type = days {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] log_rotation_type = none {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] max_age = 0 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] max_logfile_count = 30 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] max_logfile_size_mb = 200 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] max_over_subscription_ratio = 20.0 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] message_reap_interval = 86400 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] message_ttl = 2592000 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] migration_create_volume_timeout_secs = 300 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] monkey_patch = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] monkey_patch_modules = [] {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] my_ip = 192.168.122.152 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] no_snapshot_gb_quota = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] num_iser_scan_tries = 3 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] num_shell_tries = 3 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] num_volume_device_scan_tries = 3 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] nvmeof_conn_info_version = 1 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] nvmet_ns_id = 10 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] nvmet_port_id = 1 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] osapi_max_limit = 1000 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] osapi_volume_ext_list = [] {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] osapi_volume_listen = 0.0.0.0 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] osapi_volume_listen_port = 8776 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] osapi_volume_use_ssl = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] osapi_volume_workers = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] per_volume_size_limit = -1 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] periodic_fuzzy_delay = 60 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] periodic_interval = 60 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] project_id_regex = [0-9a-f\-]+ {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] public_endpoint = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] publish_errors = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] quota_backup_gigabytes = 1000 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] quota_backups = 10 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] quota_gigabytes = 1000 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] quota_groups = 10 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] quota_snapshots = 10 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] quota_volumes = 10 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] rate_limit_burst = 0 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] rate_limit_except_level = CRITICAL {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] rate_limit_interval = 0 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] reinit_driver_count = 3 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] replication_device = **** {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] report_discard_supported = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] report_interval = 120 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] reservation_clean_interval = 86400 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] reservation_expire = 86400 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] reserved_image_namespaces = [] {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] reserved_percentage = 0 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] rpc_response_timeout = 120 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] run_external_periodic_tasks = True {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] scst_target_driver = iscsi {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] scst_target_iqn_name = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] service_down_time = 720 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] shell_completion = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] snapshot_name_template = snapshot-%s {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] split_loggers = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] state_path = /opt/stack/data/cinder {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] storage_availability_zone = nova {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] storage_protocol = iSCSI {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] syslog_log_facility = LOG_USER {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] target_helper = lioadm {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] target_ip_address = 192.168.122.152 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] target_port = 3260 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] target_protocol = iscsi {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] target_secondary_ip_addresses = [] {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] trace_flags = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] transfer_api_class = cinder.transfer.api.API {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] transport_url = **** {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] until_refresh = 0 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] use_chap_auth = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] use_default_quota_class = True {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] use_journal = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] use_json = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] use_multipath_for_image_xfer = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] use_stderr = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] use_syslog = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] verify_glance_signatures = enabled {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] volume_api_class = cinder.volume.api.API {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] volume_backend_name = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] volume_clear = zero {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] volume_clear_ionice = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] volume_clear_size = 0 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] volume_copy_bps_limit = 0 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] volume_dd_blocksize = 1M {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] volume_name_template = volume-%s {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] volume_service_inithost_offload = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] volume_usage_audit_period = month {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] zoning_mode = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] oslo_concurrency.disable_process_locking = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] keystone_authtoken.auth_section = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] keystone_authtoken.auth_type = password {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] keystone_authtoken.auth_version = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] keystone_authtoken.cache = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] keystone_authtoken.certfile = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] keystone_authtoken.delay_auth_decision = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] keystone_authtoken.http_connect_timeout = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] keystone_authtoken.include_service_catalog = True {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] keystone_authtoken.insecure = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] keystone_authtoken.interface = public {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] keystone_authtoken.keyfile = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] keystone_authtoken.memcache_password = {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] keystone_authtoken.memcache_username = {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] keystone_authtoken.region_name = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] keystone_authtoken.service_token_roles_required = True {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] keystone_authtoken.service_type = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] keystone_authtoken.token_cache_time = 300 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.152/identity {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] cache.backend = dogpile.cache.null {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] cache.backend_argument = **** {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] cache.backend_expiration_time = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] cache.config_prefix = cache.oslo {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] cache.debug_cache_backend = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] cache.enable_retry_client = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] cache.enable_socket_keepalive = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] cache.enabled = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] cache.expiration_time = 600 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] cache.hashclient_retry_attempts = 2 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86582]: DEBUG cinder.volume.drivers.quobyte [None req-8fd9ff3a-bceb-48df-8c4d-5d06a36d6123 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86582) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 10 10:01:33 devstack cinder-volume[86582]: WARNING cinder.volume.drivers.quobyte [None req-8fd9ff3a-bceb-48df-8c4d-5d06a36d6123 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 10 10:01:33 devstack cinder-volume[86582]: WARNING cinder.volume.drivers.quobyte [None req-8fd9ff3a-bceb-48df-8c4d-5d06a36d6123 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] cache.memcache_dead_retry = 300 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] cache.memcache_pool_maxsize = 10 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] cache.memcache_sasl_enabled = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] cache.password = **** {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86582]: DEBUG oslo_concurrency.processutils [None req-8fd9ff3a-bceb-48df-8c4d-5d06a36d6123 None None] Running cmd (subprocess): mount.quobyte {{(pid=86582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] cache.proxies = [] {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] cache.redis_db = 0 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] cache.redis_sentinel_service_name = mymaster {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] cache.redis_server = localhost:6379 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] cache.retry_attempts = 2 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] cache.retry_delay = 0.0 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] cache.socket_keepalive_count = 1 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] cache.socket_keepalive_idle = 1 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] cache.socket_keepalive_interval = 1 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] cache.socket_timeout = 1.0 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] cache.tls_allowed_ciphers = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] cache.tls_cafile = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] cache.tls_certfile = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] cache.tls_enabled = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] cache.tls_keyfile = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] cache.username = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] coordination.backend_url = **** {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] database.asyncio_connection = **** {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] database.asyncio_slave_connection = **** {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] database.backend = sqlalchemy {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] database.connection = **** {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] database.connection_debug = 0 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] database.connection_parameters = {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] database.connection_recycle_time = 3600 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] database.connection_trace = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] database.db_inc_retry_interval = True {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] database.db_max_retries = 20 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] database.db_max_retry_interval = 10 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] database.db_retry_interval = 1 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] database.max_overflow = 50 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] database.max_pool_size = 5 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] database.max_retries = 10 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] database.mysql_wsrep_sync_wait = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] database.pool_timeout = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] database.retry_interval = 10 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] database.slave_connection = **** {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] database.sqlite_synchronous = True {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] database.synchronous_reader = True {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] database.use_db_reconnect = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] profiler.connection_string = messaging:// {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] profiler.enabled = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] profiler.es_doc_type = notification {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] profiler.es_scroll_size = 10000 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] profiler.es_scroll_time = 2m {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] profiler.filter_error_trace = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] profiler.hmac_keys = **** {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] profiler.sentinel_service_name = mymaster {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] profiler.socket_timeout = 0.1 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] profiler.trace_requests = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] profiler.trace_sqlalchemy = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] profiler_jaeger.process_tags = {} {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] profiler_jaeger.service_name_prefix = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[76142]: DEBUG oslo_concurrency.lockutils [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] Acquiring lock "singleton_lock" {{(pid=76142) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 10:01:33 devstack cinder-volume[76142]: DEBUG oslo_concurrency.lockutils [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] Acquired lock "singleton_lock" {{(pid=76142) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 10:01:33 devstack cinder-volume[76142]: DEBUG oslo_concurrency.lockutils [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] Releasing lock "singleton_lock" {{(pid=76142) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] profiler_otlp.service_name_prefix = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] oslo_policy.enforce_new_defaults = True {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] oslo_policy.enforce_scope = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] oslo_policy.policy_default_rule = default {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] oslo_policy.policy_file = policy.yaml {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] oslo_policy.remote_timeout = 60.0 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] privsep_osbrick.group = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] privsep_osbrick.helper_command = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] privsep_osbrick.user = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] cinder_sys_admin.group = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] cinder_sys_admin.helper_command = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[76142]: WARNING amqp [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] cinder_sys_admin.user = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] service_user.auth_section = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] service_user.auth_type = password {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] service_user.cafile = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] service_user.certfile = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] service_user.collect_timing = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] service_user.insecure = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] service_user.keyfile = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] service_user.send_service_user_token = True {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] service_user.split_loggers = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] service_user.timeout = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] glance.auth_section = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] glance.auth_type = password {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] glance.certfile = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] glance.collect_timing = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] glance.insecure = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] glance.keyfile = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] glance.region_name = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] glance.split_loggers = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] glance.timeout = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_defaults.backend_availability_zone = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_defaults.chap_password = **** {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_defaults.chap_username = {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_defaults.disk_geometry = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_defaults.driver_client_cert = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[76142]: WARNING amqp [None req-c51c9c93-e2bf-4a72-88a7-055164bc9779 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_defaults.driver_client_cert_key = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_defaults.driver_data_namespace = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_defaults.driver_use_ssl = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_defaults.enable_unsupported_driver = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_defaults.extra_capabilities = {} {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_defaults.filter_function = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_defaults.goodness_function = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_defaults.iscsi_target_flags = {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_defaults.iscsi_write_cache = on {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_defaults.iser_helper = tgtadm {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_defaults.iser_ip_address = 192.168.122.152 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_defaults.iser_port = 3260 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_defaults.nas_host = {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_defaults.nas_login = admin {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_defaults.nas_mount_options = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_defaults.nas_password = **** {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_defaults.nas_private_key = {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_defaults.nas_share_path = {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_defaults.nas_ssh_port = 22 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_defaults.num_shell_tries = 3 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_defaults.nvmet_port_id = 1 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_defaults.quobyte_client_cfg = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_defaults.quobyte_volume_url = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_defaults.replication_device = **** {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_defaults.report_discard_supported = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_defaults.reserved_percentage = 0 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_defaults.scst_target_driver = iscsi {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_defaults.scst_target_iqn_name = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_defaults.storage_protocol = iSCSI {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_defaults.target_helper = tgtadm {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_defaults.target_ip_address = 192.168.122.152 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_defaults.target_port = 3260 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_defaults.target_protocol = iscsi {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_defaults.trace_flags = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_defaults.unique_fqdn_network = True {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_defaults.use_chap_auth = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_defaults.volume_backend_name = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_defaults.volume_clear = zero {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_defaults.volume_clear_ionice = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_defaults.volume_clear_size = 0 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] oslo_reports.file_event_handler = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] oslo_reports.log_dir = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] QuobyteHD.backend_availability_zone = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] QuobyteHD.backend_host = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] QuobyteHD.chap_password = **** {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] QuobyteHD.chap_username = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] QuobyteHD.chiscsi_conf = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] QuobyteHD.disk_geometry = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] QuobyteHD.driver_client_cert = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] QuobyteHD.driver_client_cert_key = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] QuobyteHD.driver_data_namespace = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] QuobyteHD.driver_use_ssl = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] QuobyteHD.extra_capabilities = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] QuobyteHD.filter_function = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] QuobyteHD.goodness_function = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] QuobyteHD.iscsi_target_flags = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] QuobyteHD.iscsi_write_cache = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] QuobyteHD.iser_helper = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] QuobyteHD.iser_ip_address = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] QuobyteHD.iser_port = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] QuobyteHD.iser_target_prefix = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] QuobyteHD.nas_host = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] QuobyteHD.nas_login = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] QuobyteHD.nas_mount_options = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] QuobyteHD.nas_password = **** {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] QuobyteHD.nas_private_key = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] QuobyteHD.nas_share_path = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] QuobyteHD.nas_ssh_port = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] QuobyteHD.num_shell_tries = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] QuobyteHD.nvmet_ns_id = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] QuobyteHD.nvmet_port_id = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack quobyte-client[86585]: Reading configuration file: /etc/quobyte/client.cfg Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] QuobyteHD.replication_device = **** {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] QuobyteHD.report_discard_supported = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] QuobyteHD.reserved_percentage = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack quobyte-client[86585]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] QuobyteHD.scst_target_driver = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] QuobyteHD.storage_protocol = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] QuobyteHD.target_helper = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] QuobyteHD.target_ip_address = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] QuobyteHD.target_port = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] QuobyteHD.target_prefix = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] QuobyteHD.target_protocol = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] QuobyteHD.trace_flags = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86582]: DEBUG oslo_concurrency.processutils [None req-8fd9ff3a-bceb-48df-8c4d-5d06a36d6123 None None] CMD "mount.quobyte" returned: 1 in 0.155s {{(pid=86582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:01:33 devstack cinder-volume[86582]: DEBUG oslo_concurrency.lockutils [None req-8fd9ff3a-bceb-48df-8c4d-5d06a36d6123 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:01:33 devstack cinder-volume[86582]: DEBUG oslo_concurrency.lockutils [None req-8fd9ff3a-bceb-48df-8c4d-5d06a36d6123 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:01:33 devstack cinder-volume[86582]: DEBUG cinder.volume.drivers.quobyte [None req-8fd9ff3a-bceb-48df-8c4d-5d06a36d6123 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=86582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:01:33 devstack cinder-volume[86582]: INFO cinder.volume.drivers.quobyte [None req-8fd9ff3a-bceb-48df-8c4d-5d06a36d6123 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 ... Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] QuobyteHD.unique_fqdn_network = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] QuobyteHD.use_chap_auth = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] QuobyteHD.volume_clear = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] QuobyteHD.volume_clear_ionice = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] QuobyteHD.volume_clear_size = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86582]: DEBUG oslo_concurrency.processutils [None req-8fd9ff3a-bceb-48df-8c4d-5d06a36d6123 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 -c /etc/quobyte/client-cinder.cfg {{(pid=86582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] QuobyteHD.volumes_dir = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] oslo_messaging_rabbit.ssl = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] oslo_messaging_rabbit.ssl_version = {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] oslo_messaging_notifications.driver = [] {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] oslo_messaging_notifications.retry = -1 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] oslo_messaging_notifications.transport_url = **** {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] key_manager.fixed_key = **** {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] barbican.barbican_api_version = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] barbican.barbican_endpoint = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] barbican.barbican_endpoint_type = public {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] barbican.barbican_region_name = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] barbican.cafile = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] barbican.certfile = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] barbican.collect_timing = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] barbican.insecure = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] barbican.keyfile = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] barbican.number_of_retries = 60 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] barbican.retry_delay = 1 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] barbican.send_service_user_token = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] barbican.split_loggers = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] barbican.timeout = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] barbican.verify_ssl = True {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] barbican.verify_ssl_path = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] barbican_service_user.auth_section = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] barbican_service_user.auth_type = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] barbican_service_user.cafile = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] barbican_service_user.certfile = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] barbican_service_user.collect_timing = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] barbican_service_user.insecure = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] barbican_service_user.keyfile = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] barbican_service_user.split_loggers = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] barbican_service_user.timeout = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] vault.approle_role_id = **** {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] vault.approle_secret_id = **** {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] vault.kv_mountpoint = secret {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] vault.kv_path = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] vault.kv_version = 2 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] vault.namespace = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] vault.root_token_id = **** {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] vault.ssl_ca_crt_file = None {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] vault.timeout = 60.0 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] vault.use_ssl = False {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:33 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] ******************************************************************************** {{(pid=86317) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 10 10:01:33 devstack sudo[86596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 -c /etc/quobyte/client-cinder.cfg Jul 10 10:01:33 devstack sudo[86596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:01:34 devstack sudo[86596]: pam_unix(sudo:session): session closed for user root Jul 10 10:01:34 devstack cinder-volume[86582]: DEBUG oslo_concurrency.processutils [None req-8fd9ff3a-bceb-48df-8c4d-5d06a36d6123 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.852s {{(pid=86582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:01:34 devstack cinder-volume[86582]: INFO cinder.volume.drivers.quobyte [None req-8fd9ff3a-bceb-48df-8c4d-5d06a36d6123 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 succeeded Jul 10 10:01:34 devstack cinder-volume[86582]: DEBUG cinder.volume.drivers.quobyte [None req-8fd9ff3a-bceb-48df-8c4d-5d06a36d6123 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=86582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:01:34 devstack cinder-volume[86582]: DEBUG oslo_concurrency.lockutils [None req-8fd9ff3a-bceb-48df-8c4d-5d06a36d6123 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.874s {{(pid=86582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:01:34 devstack cinder-volume[86582]: DEBUG oslo_concurrency.processutils [None req-8fd9ff3a-bceb-48df-8c4d-5d06a36d6123 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=86582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:01:34 devstack sudo[86681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:01:34 devstack sudo[86681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:01:35 devstack sudo[86681]: pam_unix(sudo:session): session closed for user root Jul 10 10:01:35 devstack cinder-volume[86582]: DEBUG oslo_concurrency.processutils [None req-8fd9ff3a-bceb-48df-8c4d-5d06a36d6123 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.646s {{(pid=86582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:01:35 devstack cinder-volume[86582]: INFO cinder.volume.driver [None req-8fd9ff3a-bceb-48df-8c4d-5d06a36d6123 None None] Driver hasn't implemented _init_vendor_properties() Jul 10 10:01:35 devstack cinder-volume[86582]: DEBUG cinder.volume.driver [None req-8fd9ff3a-bceb-48df-8c4d-5d06a36d6123 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86582) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 10 10:01:35 devstack cinder-volume[86582]: DEBUG oslo_db.sqlalchemy.engines [None req-8fd9ff3a-bceb-48df-8c4d-5d06a36d6123 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86582) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 10:01:35 devstack cinder-volume[86582]: DEBUG dbcounter [-] [86582] Writer thread running {{(pid=86582) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 10 10:01:35 devstack cinder-volume[86582]: DEBUG cinder.db.api [None req-8fd9ff3a-bceb-48df-8c4d-5d06a36d6123 None None] Building query based on filter {{(pid=86582) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 10 10:01:35 devstack cinder-volume[86582]: DEBUG cinder.image.image_utils [None req-8fd9ff3a-bceb-48df-8c4d-5d06a36d6123 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86582) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 10 10:01:35 devstack cinder-volume[86582]: INFO cinder.keymgr.migration [None req-7df86467-d013-4a3f-b9db-932d529c7d53 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 10 10:01:35 devstack cinder-volume[86582]: DEBUG oslo_concurrency.lockutils [None req-8fd9ff3a-bceb-48df-8c4d-5d06a36d6123 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:01:35 devstack cinder-volume[86582]: DEBUG oslo_concurrency.lockutils [None req-8fd9ff3a-bceb-48df-8c4d-5d06a36d6123 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:01:35 devstack cinder-volume[86582]: DEBUG cinder.volume.drivers.quobyte [None req-8fd9ff3a-bceb-48df-8c4d-5d06a36d6123 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=86582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:01:35 devstack cinder-volume[86582]: DEBUG cinder.volume.drivers.quobyte [None req-8fd9ff3a-bceb-48df-8c4d-5d06a36d6123 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=86582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:01:35 devstack cinder-volume[86582]: DEBUG oslo_concurrency.lockutils [None req-8fd9ff3a-bceb-48df-8c4d-5d06a36d6123 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:01:35 devstack cinder-volume[86582]: DEBUG oslo_concurrency.processutils [None req-8fd9ff3a-bceb-48df-8c4d-5d06a36d6123 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=86582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:01:35 devstack sudo[86700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:01:35 devstack sudo[86700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:01:36 devstack sudo[86700]: pam_unix(sudo:session): session closed for user root Jul 10 10:01:36 devstack cinder-volume[86582]: DEBUG oslo_concurrency.processutils [None req-8fd9ff3a-bceb-48df-8c4d-5d06a36d6123 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.780s {{(pid=86582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:01:36 devstack cinder-volume[86582]: DEBUG cinder.manager [None req-8fd9ff3a-bceb-48df-8c4d-5d06a36d6123 None None] Notifying Schedulers of capabilities ... {{(pid=86582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:01:36 devstack cinder-volume[86582]: INFO cinder.volume.manager [None req-8fd9ff3a-bceb-48df-8c4d-5d06a36d6123 None None] Driver initialization completed successfully. Jul 10 10:01:36 devstack cinder-volume[86582]: INFO cinder.manager [None req-8fd9ff3a-bceb-48df-8c4d-5d06a36d6123 None None] Initiating service 3 cleanup Jul 10 10:01:36 devstack cinder-volume[86582]: INFO cinder.manager [None req-8fd9ff3a-bceb-48df-8c4d-5d06a36d6123 None None] Service 3 cleanup completed. Jul 10 10:01:36 devstack cinder-volume[86582]: DEBUG cinder.service [None req-8fd9ff3a-bceb-48df-8c4d-5d06a36d6123 None None] Creating RPC server for service cinder-volume {{(pid=86582) start /opt/stack/cinder/cinder/service.py:231}} Jul 10 10:01:36 devstack cinder-volume[86582]: DEBUG cinder.service [None req-8fd9ff3a-bceb-48df-8c4d-5d06a36d6123 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86582) start /opt/stack/cinder/cinder/service.py:237}} Jul 10 10:01:36 devstack cinder-volume[86582]: INFO cinder.volume.manager [None req-8fd9ff3a-bceb-48df-8c4d-5d06a36d6123 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 10 10:01:36 devstack cinder-volume[86582]: DEBUG oslo_concurrency.lockutils [None req-8fd9ff3a-bceb-48df-8c4d-5d06a36d6123 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:01:36 devstack cinder-volume[86582]: DEBUG oslo_concurrency.lockutils [None req-8fd9ff3a-bceb-48df-8c4d-5d06a36d6123 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:01:36 devstack cinder-volume[86582]: DEBUG cinder.volume.drivers.quobyte [None req-8fd9ff3a-bceb-48df-8c4d-5d06a36d6123 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=86582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:01:36 devstack cinder-volume[86582]: DEBUG cinder.volume.drivers.quobyte [None req-8fd9ff3a-bceb-48df-8c4d-5d06a36d6123 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=86582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:01:36 devstack cinder-volume[86582]: DEBUG oslo_concurrency.lockutils [None req-8fd9ff3a-bceb-48df-8c4d-5d06a36d6123 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:01:36 devstack cinder-volume[86582]: DEBUG oslo_concurrency.processutils [None req-8fd9ff3a-bceb-48df-8c4d-5d06a36d6123 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=86582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:01:36 devstack sudo[86740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:01:36 devstack sudo[86740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:01:37 devstack sudo[86740]: pam_unix(sudo:session): session closed for user root Jul 10 10:01:37 devstack cinder-volume[86582]: DEBUG oslo_concurrency.processutils [None req-8fd9ff3a-bceb-48df-8c4d-5d06a36d6123 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 1.065s {{(pid=86582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:01:37 devstack cinder-volume[86582]: INFO cinder.volume.manager [None req-8fd9ff3a-bceb-48df-8c4d-5d06a36d6123 None None] Driver post RPC initialization completed successfully. Jul 10 10:01:40 devstack cinder-volume[86582]: DEBUG oslo_concurrency.lockutils [None req-07745225-0e29-482a-a9e7-fa72b4718d68 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:01:40 devstack cinder-volume[86582]: DEBUG oslo_concurrency.lockutils [None req-07745225-0e29-482a-a9e7-fa72b4718d68 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:01:40 devstack cinder-volume[86582]: DEBUG cinder.volume.drivers.quobyte [None req-07745225-0e29-482a-a9e7-fa72b4718d68 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=86582) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:01:40 devstack cinder-volume[86582]: DEBUG cinder.volume.drivers.quobyte [None req-07745225-0e29-482a-a9e7-fa72b4718d68 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=86582) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:01:40 devstack cinder-volume[86582]: DEBUG oslo_concurrency.lockutils [None req-07745225-0e29-482a-a9e7-fa72b4718d68 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86582) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:01:40 devstack cinder-volume[86582]: DEBUG oslo_concurrency.processutils [None req-07745225-0e29-482a-a9e7-fa72b4718d68 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=86582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:01:40 devstack sudo[86904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:01:40 devstack sudo[86904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:01:41 devstack sudo[86904]: pam_unix(sudo:session): session closed for user root Jul 10 10:01:41 devstack cinder-volume[86582]: DEBUG oslo_concurrency.processutils [None req-07745225-0e29-482a-a9e7-fa72b4718d68 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.655s {{(pid=86582) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:01:41 devstack cinder-volume[86582]: DEBUG cinder.manager [None req-07745225-0e29-482a-a9e7-fa72b4718d68 None None] Notifying Schedulers of capabilities ... {{(pid=86582) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:01:42 devstack cinder-volume[86317]: INFO oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] Caught SIGTERM, stopping children Jul 10 10:01:42 devstack cinder-volume[86317]: DEBUG oslo_concurrency.lockutils [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] Acquiring lock "singleton_lock" {{(pid=86317) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 10:01:42 devstack cinder-volume[86317]: DEBUG oslo_concurrency.lockutils [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] Acquired lock "singleton_lock" {{(pid=86317) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 10:01:42 devstack cinder-volume[86317]: DEBUG oslo_concurrency.lockutils [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] Releasing lock "singleton_lock" {{(pid=86317) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 10:01:42 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] Stop services. {{(pid=86317) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 10 10:01:42 devstack cinder-volume[86317]: DEBUG oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] Killing children. {{(pid=86317) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 10 10:01:42 devstack cinder-volume[86317]: INFO oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] Waiting on 1 children to exit Jul 10 10:01:44 devstack cinder-volume[86582]: DEBUG oslo_concurrency.lockutils [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] Acquiring lock "singleton_lock" {{(pid=86582) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 10:01:44 devstack cinder-volume[86582]: DEBUG oslo_concurrency.lockutils [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] Acquired lock "singleton_lock" {{(pid=86582) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 10:01:44 devstack cinder-volume[86582]: DEBUG oslo_concurrency.lockutils [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] Releasing lock "singleton_lock" {{(pid=86582) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 10:01:44 devstack cinder-volume[86582]: WARNING amqp [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 10 10:01:44 devstack cinder-volume[86582]: WARNING amqp [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 10 10:01:44 devstack cinder-volume[86317]: INFO oslo_service.backend._eventlet.service [None req-f7894654-b927-4bad-8a5c-9c9305aa213d None None] Child 86582 exited with status 0 Jul 10 10:01:45 devstack cinder-volume[86981]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 10 10:01:45 devstack cinder-volume[86981]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 10 10:01:45 devstack cinder-volume[86981]: we strongly recommend against using it for new projects. Jul 10 10:01:45 devstack cinder-volume[86981]: If you are already using Eventlet, we recommend migrating to a different Jul 10 10:01:45 devstack cinder-volume[86981]: framework. For more detail see Jul 10 10:01:45 devstack cinder-volume[86981]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 10 10:01:45 devstack cinder-volume[86981]: import eventlet # noqa Jul 10 10:01:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 10:01:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 10:01:48 devstack cinder-volume[86981]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 10:01:49 devstack cinder-volume[86981]: INFO dbcounter [None req-505dd798-355d-496a-9143-e63e17f54878 None None] Registered counter for database cinder Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_db.sqlalchemy.engines [None req-505dd798-355d-496a-9143-e63e17f54878 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86981) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG dbcounter [-] [86981] Writer thread running {{(pid=86981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 10 10:01:49 devstack cinder-volume[86981]: INFO cinder.rpc [None req-505dd798-355d-496a-9143-e63e17f54878 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 10 10:01:49 devstack cinder-volume[86981]: INFO cinder.rpc [None req-505dd798-355d-496a-9143-e63e17f54878 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_db.sqlalchemy.engines [None req-505dd798-355d-496a-9143-e63e17f54878 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86981) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 10:01:49 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-505dd798-355d-496a-9143-e63e17f54878 None None] Determined volume DB was empty at startup. Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG cinder.volume.manager [None req-505dd798-355d-496a-9143-e63e17f54878 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86981) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 10 10:01:49 devstack cinder-volume[86981]: WARNING stevedore.named [None req-505dd798-355d-496a-9143-e63e17f54878 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 10 10:01:49 devstack cinder-volume[86981]: WARNING castellan.key_manager [None req-505dd798-355d-496a-9143-e63e17f54878 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 10:01:49 devstack cinder-volume[86981]: WARNING cinder.keymgr.conf_key_mgr [None req-505dd798-355d-496a-9143-e63e17f54878 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 10:01:49 devstack cinder-volume[86981]: INFO cinder.volume.manager [None req-505dd798-355d-496a-9143-e63e17f54878 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_db.sqlalchemy.engines [None req-505dd798-355d-496a-9143-e63e17f54878 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86981) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 10:01:49 devstack cinder-volume[86981]: INFO oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] Starting 1 workers Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] Started child 87234 {{(pid=86981) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] Full set of CONF: {{(pid=86981) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] ******************************************************************************** {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] Configuration options gathered from: {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] ================================================================================ {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 10 10:01:49 devstack cinder-volume[87234]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] allow_availability_zone_fallback = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] allow_compression_on_image_upload = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] allowed_direct_url_schemes = [] {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] api_rate_limit = True {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] auth_strategy = keystone {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_availability_zone = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_host = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_name = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_stats_polling_interval = 60 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backup_api_class = cinder.backup.api.API {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backup_name_template = backup-%s {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backup_use_same_host = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backup_use_temp_snapshot = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] chap_password = **** {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] chap_username = {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] cinder_internal_tenant_project_id = c19f0fa4fe10412198599da866fab23c {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] cinder_internal_tenant_user_id = b76e0cd8374b48a3b4dd3b2836f37042 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] cluster = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] compression_format = gzip {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] compute_api_class = cinder.compute.nova.API {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] config_dir = [] {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] config_source = [] {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] control_exchange = openstack {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] debug = True {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] default_availability_zone = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] default_group_type = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] default_volume_type = QuobyteHD {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] disk_geometry = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] driver_client_cert = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] driver_client_cert_key = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] driver_data_namespace = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] driver_ssl_cert_path = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] driver_ssl_cert_verify = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] driver_use_ssl = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] enable_new_services = True {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] enable_unsupported_driver = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] enabled_backends = ['QuobyteHD'] {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] enforce_multipath_for_image_xfer = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] filter_function = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] glance_api_insecure = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] glance_api_servers = ['http://192.168.122.152/image'] {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] glance_api_ssl_compression = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] glance_ca_certificates_file = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] glance_catalog_info = image:glance:publicURL {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] glance_certfile = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] glance_keyfile = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] glance_num_retries = 3 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] glance_request_timeout = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] goodness_function = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] graceful_shutdown_timeout = 5 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] group_api_class = cinder.group.api.API {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] host = devstack {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] image_compress_on_upload = True {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] image_conversion_address_space_limit = 1 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] image_conversion_cpu_limit = 60 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] image_conversion_disable = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] image_upload_use_cinder_backend = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] image_upload_use_internal_tenant = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] image_volume_cache_enabled = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] image_volume_cache_max_count = 0 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] image_volume_cache_max_size_gb = 0 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] init_host_max_objects_retrieval = 0 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] instance_format = [instance: %(uuid)s] {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] iscsi_target_flags = {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] iscsi_write_cache = on {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] iser_helper = tgtadm {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] iser_ip_address = 192.168.122.152 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] iser_port = 3260 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] log_color = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] log_config_append = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] log_dir = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-f7941acc-76d2-4fd4-aa01-4d28eade62e1 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] log_file = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-f7941acc-76d2-4fd4-aa01-4d28eade62e1 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87234) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] log_options = True {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] log_rotate_interval = 1 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] log_rotate_interval_type = days {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] log_rotation_type = none {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] max_age = 0 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] max_logfile_count = 30 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] max_logfile_size_mb = 200 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] max_over_subscription_ratio = 20.0 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] message_reap_interval = 86400 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] message_ttl = 2592000 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] migration_create_volume_timeout_secs = 300 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] monkey_patch = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] monkey_patch_modules = [] {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] my_ip = 192.168.122.152 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] no_snapshot_gb_quota = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] num_iser_scan_tries = 3 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] num_shell_tries = 3 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] num_volume_device_scan_tries = 3 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] nvmeof_conn_info_version = 1 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] nvmet_ns_id = 10 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] nvmet_port_id = 1 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] osapi_max_limit = 1000 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] osapi_volume_ext_list = [] {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] osapi_volume_listen_port = 8776 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] osapi_volume_use_ssl = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] osapi_volume_workers = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] per_volume_size_limit = -1 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] periodic_fuzzy_delay = 60 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] periodic_interval = 60 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] public_endpoint = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] publish_errors = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] quota_backup_gigabytes = 1000 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] quota_backups = 10 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] quota_gigabytes = 1000 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] quota_groups = 10 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] quota_snapshots = 10 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] quota_volumes = 10 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] rate_limit_burst = 0 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] rate_limit_except_level = CRITICAL {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] rate_limit_interval = 0 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] reinit_driver_count = 3 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] replication_device = **** {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] report_discard_supported = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] report_interval = 120 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] reservation_clean_interval = 86400 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] reservation_expire = 86400 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] reserved_image_namespaces = [] {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] reserved_percentage = 0 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] rpc_response_timeout = 120 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] run_external_periodic_tasks = True {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] scst_target_driver = iscsi {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] scst_target_iqn_name = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] service_down_time = 720 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] shell_completion = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] snapshot_name_template = snapshot-%s {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] split_loggers = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] state_path = /opt/stack/data/cinder {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] storage_availability_zone = nova {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] storage_protocol = iSCSI {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] syslog_log_facility = LOG_USER {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] target_helper = lioadm {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] target_ip_address = 192.168.122.152 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] target_port = 3260 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] target_protocol = iscsi {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] target_secondary_ip_addresses = [] {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] trace_flags = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] transport_url = **** {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] until_refresh = 0 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] use_chap_auth = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] use_default_quota_class = True {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] use_journal = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] use_json = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] use_multipath_for_image_xfer = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] use_stderr = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] use_syslog = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] verify_glance_signatures = enabled {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] volume_api_class = cinder.volume.api.API {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] volume_backend_name = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] volume_clear = zero {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] volume_clear_ionice = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] volume_clear_size = 0 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] volume_copy_bps_limit = 0 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] volume_dd_blocksize = 1M {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] volume_name_template = volume-%s {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] volume_service_inithost_offload = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] volume_usage_audit_period = month {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] zoning_mode = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] oslo_concurrency.disable_process_locking = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] keystone_authtoken.auth_section = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] keystone_authtoken.auth_type = password {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] keystone_authtoken.auth_version = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] keystone_authtoken.cache = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] keystone_authtoken.certfile = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] keystone_authtoken.include_service_catalog = True {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] keystone_authtoken.insecure = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] keystone_authtoken.interface = public {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] keystone_authtoken.keyfile = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] keystone_authtoken.memcache_password = {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] keystone_authtoken.memcache_username = {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] keystone_authtoken.region_name = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] keystone_authtoken.service_type = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.152/identity {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] cache.backend = dogpile.cache.null {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] cache.backend_argument = **** {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] cache.backend_expiration_time = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] cache.config_prefix = cache.oslo {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] cache.debug_cache_backend = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] cache.enable_retry_client = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] cache.enable_socket_keepalive = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] cache.enabled = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] cache.expiration_time = 600 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] cache.hashclient_retry_attempts = 2 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f7941acc-76d2-4fd4-aa01-4d28eade62e1 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87234) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 10 10:01:49 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.quobyte [None req-f7941acc-76d2-4fd4-aa01-4d28eade62e1 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 10 10:01:49 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.quobyte [None req-f7941acc-76d2-4fd4-aa01-4d28eade62e1 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] cache.memcache_dead_retry = 300 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] cache.memcache_pool_maxsize = 10 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f7941acc-76d2-4fd4-aa01-4d28eade62e1 None None] Running cmd (subprocess): mount.quobyte {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] cache.memcache_sasl_enabled = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] cache.password = **** {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] cache.proxies = [] {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] cache.redis_db = 0 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] cache.redis_server = localhost:6379 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] cache.retry_attempts = 2 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] cache.retry_delay = 0.0 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] cache.socket_keepalive_count = 1 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] cache.socket_keepalive_idle = 1 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] cache.socket_keepalive_interval = 1 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] cache.socket_timeout = 1.0 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] cache.tls_allowed_ciphers = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] cache.tls_cafile = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] cache.tls_certfile = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] cache.tls_enabled = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] cache.tls_keyfile = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] cache.username = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] coordination.backend_url = **** {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] database.asyncio_connection = **** {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] database.asyncio_slave_connection = **** {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] database.backend = sqlalchemy {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] database.connection = **** {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] database.connection_debug = 0 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] database.connection_parameters = {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] database.connection_recycle_time = 3600 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] database.connection_trace = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] database.db_inc_retry_interval = True {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] database.db_max_retries = 20 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] database.db_max_retry_interval = 10 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] database.db_retry_interval = 1 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] database.max_overflow = 50 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] database.max_pool_size = 5 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] database.max_retries = 10 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] database.mysql_wsrep_sync_wait = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] database.pool_timeout = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] database.retry_interval = 10 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] database.slave_connection = **** {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] database.sqlite_synchronous = True {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] database.synchronous_reader = True {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] database.use_db_reconnect = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] profiler.connection_string = messaging:// {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] profiler.enabled = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] profiler.es_doc_type = notification {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] profiler.es_scroll_size = 10000 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] profiler.es_scroll_time = 2m {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] profiler.filter_error_trace = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] profiler.hmac_keys = **** {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] profiler.sentinel_service_name = mymaster {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] profiler.socket_timeout = 0.1 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] profiler.trace_requests = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] profiler.trace_sqlalchemy = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] profiler_jaeger.process_tags = {} {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] profiler_jaeger.service_name_prefix = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] profiler_otlp.service_name_prefix = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] oslo_policy.enforce_new_defaults = True {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] oslo_policy.enforce_scope = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] oslo_policy.policy_default_rule = default {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] oslo_policy.policy_file = policy.yaml {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] privsep_osbrick.group = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] privsep_osbrick.helper_command = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] privsep_osbrick.user = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] cinder_sys_admin.group = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] cinder_sys_admin.helper_command = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] cinder_sys_admin.user = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] service_user.auth_section = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] service_user.auth_type = password {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] service_user.cafile = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] service_user.certfile = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] service_user.collect_timing = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] service_user.insecure = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] service_user.keyfile = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] service_user.send_service_user_token = True {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] service_user.split_loggers = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] service_user.timeout = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] glance.auth_section = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] glance.auth_type = password {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] glance.certfile = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] glance.collect_timing = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] glance.insecure = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] glance.keyfile = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] glance.region_name = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] glance.split_loggers = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] glance.timeout = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_defaults.backend_availability_zone = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_defaults.chap_password = **** {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_defaults.chap_username = {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_defaults.disk_geometry = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_defaults.driver_client_cert = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_defaults.driver_client_cert_key = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_defaults.driver_data_namespace = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_defaults.driver_use_ssl = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_defaults.extra_capabilities = {} {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_defaults.filter_function = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_defaults.goodness_function = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_defaults.iscsi_target_flags = {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_defaults.iscsi_write_cache = on {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_defaults.iser_helper = tgtadm {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_defaults.iser_ip_address = 192.168.122.152 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_defaults.iser_port = 3260 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_defaults.nas_host = {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_defaults.nas_login = admin {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_defaults.nas_mount_options = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_defaults.nas_password = **** {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_defaults.nas_private_key = {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack quobyte-client[87235]: Reading configuration file: /etc/quobyte/client.cfg Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_defaults.nas_share_path = {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack quobyte-client[87235]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_defaults.num_shell_tries = 3 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f7941acc-76d2-4fd4-aa01-4d28eade62e1 None None] CMD "mount.quobyte" returned: 1 in 0.065s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f7941acc-76d2-4fd4-aa01-4d28eade62e1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f7941acc-76d2-4fd4-aa01-4d28eade62e1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f7941acc-76d2-4fd4-aa01-4d28eade62e1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_defaults.quobyte_volume_url = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_defaults.replication_device = **** {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_defaults.report_discard_supported = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_defaults.reserved_percentage = 0 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_defaults.target_helper = tgtadm {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_defaults.target_ip_address = 192.168.122.152 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_defaults.target_port = 3260 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_defaults.target_protocol = iscsi {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_defaults.trace_flags = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_defaults.unique_fqdn_network = True {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_defaults.use_chap_auth = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_defaults.volume_backend_name = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_defaults.volume_clear = zero {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_defaults.volume_clear_ionice = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_defaults.volume_clear_size = 0 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f7941acc-76d2-4fd4-aa01-4d28eade62e1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f7941acc-76d2-4fd4-aa01-4d28eade62e1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f7941acc-76d2-4fd4-aa01-4d28eade62e1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] oslo_reports.file_event_handler = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] oslo_reports.log_dir = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] QuobyteHD.backend_availability_zone = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] QuobyteHD.backend_host = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] QuobyteHD.chap_password = **** {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] QuobyteHD.chap_username = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] QuobyteHD.chiscsi_conf = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] QuobyteHD.disk_geometry = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] QuobyteHD.driver_client_cert = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] QuobyteHD.driver_data_namespace = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] QuobyteHD.driver_use_ssl = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] QuobyteHD.extra_capabilities = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] QuobyteHD.filter_function = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] QuobyteHD.goodness_function = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] QuobyteHD.iser_helper = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] QuobyteHD.iser_ip_address = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] QuobyteHD.iser_port = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] QuobyteHD.iser_target_prefix = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] QuobyteHD.nas_host = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] QuobyteHD.nas_login = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] QuobyteHD.nas_mount_options = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] QuobyteHD.nas_password = **** {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] QuobyteHD.nas_private_key = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] QuobyteHD.nas_share_path = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] QuobyteHD.nas_ssh_port = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] QuobyteHD.num_shell_tries = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] QuobyteHD.nvmet_port_id = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] QuobyteHD.replication_device = **** {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] QuobyteHD.report_discard_supported = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] QuobyteHD.reserved_percentage = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] QuobyteHD.scst_target_driver = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] QuobyteHD.storage_protocol = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] QuobyteHD.target_helper = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] QuobyteHD.target_ip_address = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] QuobyteHD.target_port = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] QuobyteHD.target_prefix = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] QuobyteHD.target_protocol = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] QuobyteHD.trace_flags = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] QuobyteHD.use_chap_auth = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] QuobyteHD.volume_clear = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] QuobyteHD.volume_clear_size = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack sudo[87236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack sudo[87236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] QuobyteHD.volumes_dir = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] oslo_messaging_rabbit.ssl = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] oslo_messaging_notifications.driver = [] {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] oslo_messaging_notifications.retry = -1 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] key_manager.fixed_key = **** {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] barbican.barbican_api_version = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] barbican.barbican_endpoint = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] barbican.barbican_endpoint_type = public {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] barbican.barbican_region_name = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] barbican.cafile = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] barbican.certfile = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:49 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] barbican.collect_timing = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:50 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] barbican.insecure = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:50 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] barbican.keyfile = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:50 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] barbican.number_of_retries = 60 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:50 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] barbican.retry_delay = 1 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:50 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] barbican.send_service_user_token = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:50 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] barbican.split_loggers = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:50 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] barbican.timeout = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:50 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] barbican.verify_ssl = True {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:50 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] barbican.verify_ssl_path = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:50 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] barbican_service_user.auth_section = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:50 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] barbican_service_user.auth_type = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:50 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] barbican_service_user.cafile = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:50 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] barbican_service_user.certfile = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:50 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] barbican_service_user.collect_timing = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:50 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] barbican_service_user.insecure = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:50 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] barbican_service_user.keyfile = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:50 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] barbican_service_user.split_loggers = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:50 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] barbican_service_user.timeout = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:50 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] vault.approle_role_id = **** {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:50 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] vault.approle_secret_id = **** {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:50 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] vault.kv_mountpoint = secret {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:50 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] vault.kv_path = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:50 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] vault.kv_version = 2 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:50 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] vault.namespace = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:50 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] vault.root_token_id = **** {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:50 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] vault.ssl_ca_crt_file = None {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:50 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] vault.timeout = 60.0 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:50 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] vault.use_ssl = False {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:50 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 10:01:50 devstack cinder-volume[86981]: DEBUG oslo_service.backend._eventlet.service [None req-505dd798-355d-496a-9143-e63e17f54878 None None] ******************************************************************************** {{(pid=86981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 10 10:01:50 devstack sudo[87236]: pam_unix(sudo:session): session closed for user root Jul 10 10:01:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f7941acc-76d2-4fd4-aa01-4d28eade62e1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.637s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:01:50 devstack cinder-volume[87234]: INFO cinder.volume.driver [None req-f7941acc-76d2-4fd4-aa01-4d28eade62e1 None None] Driver hasn't implemented _init_vendor_properties() Jul 10 10:01:50 devstack cinder-volume[87234]: DEBUG cinder.volume.driver [None req-f7941acc-76d2-4fd4-aa01-4d28eade62e1 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87234) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 10 10:01:50 devstack cinder-volume[87234]: DEBUG oslo_db.sqlalchemy.engines [None req-f7941acc-76d2-4fd4-aa01-4d28eade62e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87234) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 10:01:50 devstack cinder-volume[87234]: DEBUG dbcounter [-] [87234] Writer thread running {{(pid=87234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 10 10:01:50 devstack cinder-volume[87234]: DEBUG cinder.db.api [None req-f7941acc-76d2-4fd4-aa01-4d28eade62e1 None None] Building query based on filter {{(pid=87234) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 10 10:01:50 devstack cinder-volume[87234]: DEBUG cinder.image.image_utils [None req-f7941acc-76d2-4fd4-aa01-4d28eade62e1 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87234) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 10 10:01:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f7941acc-76d2-4fd4-aa01-4d28eade62e1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:01:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f7941acc-76d2-4fd4-aa01-4d28eade62e1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:01:50 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f7941acc-76d2-4fd4-aa01-4d28eade62e1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:01:50 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f7941acc-76d2-4fd4-aa01-4d28eade62e1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:01:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f7941acc-76d2-4fd4-aa01-4d28eade62e1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:01:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f7941acc-76d2-4fd4-aa01-4d28eade62e1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:01:50 devstack cinder-volume[87234]: INFO cinder.keymgr.migration [None req-cba00119-cb2a-48c2-b1ba-0124dbe4daaa None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 10 10:01:50 devstack sudo[87243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:01:50 devstack sudo[87243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:01:51 devstack sudo[87243]: pam_unix(sudo:session): session closed for user root Jul 10 10:01:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f7941acc-76d2-4fd4-aa01-4d28eade62e1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.596s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:01:51 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-f7941acc-76d2-4fd4-aa01-4d28eade62e1 None None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:01:51 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-f7941acc-76d2-4fd4-aa01-4d28eade62e1 None None] Driver initialization completed successfully. Jul 10 10:01:51 devstack cinder-volume[87234]: INFO cinder.manager [None req-f7941acc-76d2-4fd4-aa01-4d28eade62e1 None None] Initiating service 3 cleanup Jul 10 10:01:51 devstack cinder-volume[87234]: INFO cinder.manager [None req-f7941acc-76d2-4fd4-aa01-4d28eade62e1 None None] Service 3 cleanup completed. Jul 10 10:01:51 devstack cinder-volume[87234]: DEBUG cinder.service [None req-f7941acc-76d2-4fd4-aa01-4d28eade62e1 None None] Creating RPC server for service cinder-volume {{(pid=87234) start /opt/stack/cinder/cinder/service.py:231}} Jul 10 10:01:51 devstack cinder-volume[87234]: DEBUG cinder.service [None req-f7941acc-76d2-4fd4-aa01-4d28eade62e1 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87234) start /opt/stack/cinder/cinder/service.py:237}} Jul 10 10:01:51 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-f7941acc-76d2-4fd4-aa01-4d28eade62e1 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 10 10:01:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f7941acc-76d2-4fd4-aa01-4d28eade62e1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:01:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f7941acc-76d2-4fd4-aa01-4d28eade62e1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:01:51 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f7941acc-76d2-4fd4-aa01-4d28eade62e1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:01:51 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f7941acc-76d2-4fd4-aa01-4d28eade62e1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:01:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f7941acc-76d2-4fd4-aa01-4d28eade62e1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:01:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f7941acc-76d2-4fd4-aa01-4d28eade62e1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:01:51 devstack sudo[87248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:01:51 devstack sudo[87248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:01:52 devstack sudo[87248]: pam_unix(sudo:session): session closed for user root Jul 10 10:01:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f7941acc-76d2-4fd4-aa01-4d28eade62e1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.605s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:01:52 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-f7941acc-76d2-4fd4-aa01-4d28eade62e1 None None] Driver post RPC initialization completed successfully. Jul 10 10:01:59 devstack cinder-volume[86981]: DEBUG dbcounter [-] [86981] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 10:02:01 devstack cinder-volume[87234]: DEBUG dbcounter [-] [87234] Writing DB stats cinder:SELECT=3 {{(pid=87234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 10:02:02 devstack cinder-volume[87234]: DEBUG dbcounter [-] [87234] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 10:02:42 devstack cinder-volume[87234]: DEBUG oslo_service.periodic_task [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Running periodic task VolumeManager._thread_info {{(pid=87234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 10:02:42 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] thread count: 6 {{(pid=87234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 10:02:42 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] thread info: [<_MainThread(MainThread, started 131600773742720)>, , , , , ] {{(pid=87234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 10:02:50 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3b7b39a-344a-4c5e-b9fb-94ec5467eac6 tempest-TaggedAttachmentsTest-1977127549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:02:50 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a3b7b39a-344a-4c5e-b9fb-94ec5467eac6 tempest-TaggedAttachmentsTest-1977127549 None] Flow 'volume_create_manager' (6ef94329-5a63-4b49-9685-6bbace7a0962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:02:50 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a3b7b39a-344a-4c5e-b9fb-94ec5467eac6 tempest-TaggedAttachmentsTest-1977127549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e204774-5190-4340-9852-5a7387a09afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:02:50 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a3b7b39a-344a-4c5e-b9fb-94ec5467eac6 tempest-TaggedAttachmentsTest-1977127549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e204774-5190-4340-9852-5a7387a09afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:02:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1721095099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f81da902-b085-4cfc-a13e-73957b8a004d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b058babdbc12423886c20c216cb1f6d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:02:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:02:51Z,use_quota=True,user_id='1ce67b8963924771be8aaa22aa62c9f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:02:50 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a3b7b39a-344a-4c5e-b9fb-94ec5467eac6 tempest-TaggedAttachmentsTest-1977127549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6705356d-139c-4279-957a-13bf12aff577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:02:50 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a3b7b39a-344a-4c5e-b9fb-94ec5467eac6 tempest-TaggedAttachmentsTest-1977127549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6705356d-139c-4279-957a-13bf12aff577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:02:50 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a3b7b39a-344a-4c5e-b9fb-94ec5467eac6 tempest-TaggedAttachmentsTest-1977127549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43677190-5a7c-42a9-8bca-ab58ff71dcd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:02:50 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a3b7b39a-344a-4c5e-b9fb-94ec5467eac6 tempest-TaggedAttachmentsTest-1977127549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43677190-5a7c-42a9-8bca-ab58ff71dcd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f81da902-b085-4cfc-a13e-73957b8a004d', 'volume_name': 'volume-f81da902-b085-4cfc-a13e-73957b8a004d', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:02:50 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a3b7b39a-344a-4c5e-b9fb-94ec5467eac6 tempest-TaggedAttachmentsTest-1977127549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92be292c-225d-4e35-91f2-659a6ee69a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:02:50 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a3b7b39a-344a-4c5e-b9fb-94ec5467eac6 tempest-TaggedAttachmentsTest-1977127549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92be292c-225d-4e35-91f2-659a6ee69a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:02:50 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a3b7b39a-344a-4c5e-b9fb-94ec5467eac6 tempest-TaggedAttachmentsTest-1977127549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74f99aee-b9ea-4a7c-a124-bb6fb24abc2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:02:50 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-a3b7b39a-344a-4c5e-b9fb-94ec5467eac6 tempest-TaggedAttachmentsTest-1977127549 None] Volume f81da902-b085-4cfc-a13e-73957b8a004d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f81da902-b085-4cfc-a13e-73957b8a004d', 'volume_size': 1} Jul 10 10:02:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-a3b7b39a-344a-4c5e-b9fb-94ec5467eac6 tempest-TaggedAttachmentsTest-1977127549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:02:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-a3b7b39a-344a-4c5e-b9fb-94ec5467eac6 tempest-TaggedAttachmentsTest-1977127549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:02:50 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-a3b7b39a-344a-4c5e-b9fb-94ec5467eac6 tempest-TaggedAttachmentsTest-1977127549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:02:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1721095099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f81da902-b085-4cfc-a13e-73957b8a004d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b058babdbc12423886c20c216cb1f6d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:02:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:02:51Z,use_quota=True,user_id='1ce67b8963924771be8aaa22aa62c9f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:02:50 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-a3b7b39a-344a-4c5e-b9fb-94ec5467eac6 tempest-TaggedAttachmentsTest-1977127549 None] Creating volume f81da902-b085-4cfc-a13e-73957b8a004d {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:02:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-a3b7b39a-344a-4c5e-b9fb-94ec5467eac6 tempest-TaggedAttachmentsTest-1977127549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:02:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-a3b7b39a-344a-4c5e-b9fb-94ec5467eac6 tempest-TaggedAttachmentsTest-1977127549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:02:50 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-a3b7b39a-344a-4c5e-b9fb-94ec5467eac6 tempest-TaggedAttachmentsTest-1977127549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:02:50 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-a3b7b39a-344a-4c5e-b9fb-94ec5467eac6 tempest-TaggedAttachmentsTest-1977127549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:02:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-a3b7b39a-344a-4c5e-b9fb-94ec5467eac6 tempest-TaggedAttachmentsTest-1977127549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:02:50 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-a3b7b39a-344a-4c5e-b9fb-94ec5467eac6 tempest-TaggedAttachmentsTest-1977127549 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:02:50 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-a3b7b39a-344a-4c5e-b9fb-94ec5467eac6 tempest-TaggedAttachmentsTest-1977127549 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:02:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a3b7b39a-344a-4c5e-b9fb-94ec5467eac6 tempest-TaggedAttachmentsTest-1977127549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f81da902-b085-4cfc-a13e-73957b8a004d 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:02:50 devstack sudo[87634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f81da902-b085-4cfc-a13e-73957b8a004d 1073741824 Jul 10 10:02:50 devstack sudo[87634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:02:53 devstack sudo[87634]: pam_unix(sudo:session): session closed for user root Jul 10 10:02:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a3b7b39a-344a-4c5e-b9fb-94ec5467eac6 tempest-TaggedAttachmentsTest-1977127549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f81da902-b085-4cfc-a13e-73957b8a004d 1073741824" returned: 0 in 2.186s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:02:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a3b7b39a-344a-4c5e-b9fb-94ec5467eac6 tempest-TaggedAttachmentsTest-1977127549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f81da902-b085-4cfc-a13e-73957b8a004d {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:02:53 devstack sudo[87993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f81da902-b085-4cfc-a13e-73957b8a004d Jul 10 10:02:53 devstack sudo[87993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:02:54 devstack sudo[87993]: pam_unix(sudo:session): session closed for user root Jul 10 10:02:54 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a3b7b39a-344a-4c5e-b9fb-94ec5467eac6 tempest-TaggedAttachmentsTest-1977127549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f81da902-b085-4cfc-a13e-73957b8a004d" returned: 0 in 1.079s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:02:54 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-a3b7b39a-344a-4c5e-b9fb-94ec5467eac6 tempest-TaggedAttachmentsTest-1977127549 None] <== create_volume: return (3398ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:02:54 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-a3b7b39a-344a-4c5e-b9fb-94ec5467eac6 tempest-TaggedAttachmentsTest-1977127549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.406s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:02:54 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a3b7b39a-344a-4c5e-b9fb-94ec5467eac6 tempest-TaggedAttachmentsTest-1977127549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74f99aee-b9ea-4a7c-a124-bb6fb24abc2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f81da902-b085-4cfc-a13e-73957b8a004d', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:02:54 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a3b7b39a-344a-4c5e-b9fb-94ec5467eac6 tempest-TaggedAttachmentsTest-1977127549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d808d0c-4264-46e9-975b-0de89f3fbcab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:02:54 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-a3b7b39a-344a-4c5e-b9fb-94ec5467eac6 tempest-TaggedAttachmentsTest-1977127549 None] Volume volume-f81da902-b085-4cfc-a13e-73957b8a004d (f81da902-b085-4cfc-a13e-73957b8a004d): created successfully Jul 10 10:02:54 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a3b7b39a-344a-4c5e-b9fb-94ec5467eac6 tempest-TaggedAttachmentsTest-1977127549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d808d0c-4264-46e9-975b-0de89f3fbcab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:02:54 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a3b7b39a-344a-4c5e-b9fb-94ec5467eac6 tempest-TaggedAttachmentsTest-1977127549 None] Flow 'volume_create_manager' (6ef94329-5a63-4b49-9685-6bbace7a0962) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:02:54 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-a3b7b39a-344a-4c5e-b9fb-94ec5467eac6 tempest-TaggedAttachmentsTest-1977127549 None] Created volume successfully. Jul 10 10:03:04 devstack cinder-volume[87234]: DEBUG dbcounter [-] [87234] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=87234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 10:03:04 devstack cinder-volume[87234]: DEBUG dbcounter [-] [87234] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=87234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 10:03:22 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcb9f539-6f0e-40fb-afdb-8539ad10dc68 tempest-ServersNegativeTestJSON-960750541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:03:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-fcb9f539-6f0e-40fb-afdb-8539ad10dc68 tempest-ServersNegativeTestJSON-960750541 None] Flow 'volume_create_manager' (cf758c16-19d7-4a73-a620-ab9b3a3e733c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:03:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-fcb9f539-6f0e-40fb-afdb-8539ad10dc68 tempest-ServersNegativeTestJSON-960750541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (148a7ed2-f2f5-4c4e-8e85-b18b6f32df0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:03:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-fcb9f539-6f0e-40fb-afdb-8539ad10dc68 tempest-ServersNegativeTestJSON-960750541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (148a7ed2-f2f5-4c4e-8e85-b18b6f32df0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:03:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-287976953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ee43c09-7a01-439b-b732-f4f1415dd09b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e54df4cf5e4442f28adadd23ac253ddf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:03:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:03:22Z,use_quota=True,user_id='1e33a4073b4f40459bdcc34e856352cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:03:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-fcb9f539-6f0e-40fb-afdb-8539ad10dc68 tempest-ServersNegativeTestJSON-960750541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ee4a882-5f0a-4cbe-a949-e6dc974e255e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:03:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-fcb9f539-6f0e-40fb-afdb-8539ad10dc68 tempest-ServersNegativeTestJSON-960750541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ee4a882-5f0a-4cbe-a949-e6dc974e255e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:03:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-fcb9f539-6f0e-40fb-afdb-8539ad10dc68 tempest-ServersNegativeTestJSON-960750541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d92bab67-f0d9-4899-aa1b-b1143fb5e76e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:03:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-fcb9f539-6f0e-40fb-afdb-8539ad10dc68 tempest-ServersNegativeTestJSON-960750541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d92bab67-f0d9-4899-aa1b-b1143fb5e76e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ee43c09-7a01-439b-b732-f4f1415dd09b', 'volume_name': 'volume-6ee43c09-7a01-439b-b732-f4f1415dd09b', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:03:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-fcb9f539-6f0e-40fb-afdb-8539ad10dc68 tempest-ServersNegativeTestJSON-960750541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30750f80-00b3-47db-8b39-1fc6610e35c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:03:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-fcb9f539-6f0e-40fb-afdb-8539ad10dc68 tempest-ServersNegativeTestJSON-960750541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30750f80-00b3-47db-8b39-1fc6610e35c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:03:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-fcb9f539-6f0e-40fb-afdb-8539ad10dc68 tempest-ServersNegativeTestJSON-960750541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4700a2a5-29fa-4325-bb1f-106d00622a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:03:22 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-fcb9f539-6f0e-40fb-afdb-8539ad10dc68 tempest-ServersNegativeTestJSON-960750541 None] Volume 6ee43c09-7a01-439b-b732-f4f1415dd09b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ee43c09-7a01-439b-b732-f4f1415dd09b', 'volume_size': 1} Jul 10 10:03:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-fcb9f539-6f0e-40fb-afdb-8539ad10dc68 tempest-ServersNegativeTestJSON-960750541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:03:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-fcb9f539-6f0e-40fb-afdb-8539ad10dc68 tempest-ServersNegativeTestJSON-960750541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:03:22 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-fcb9f539-6f0e-40fb-afdb-8539ad10dc68 tempest-ServersNegativeTestJSON-960750541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:03:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-287976953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ee43c09-7a01-439b-b732-f4f1415dd09b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e54df4cf5e4442f28adadd23ac253ddf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:03:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:03:22Z,use_quota=True,user_id='1e33a4073b4f40459bdcc34e856352cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:03:22 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-fcb9f539-6f0e-40fb-afdb-8539ad10dc68 tempest-ServersNegativeTestJSON-960750541 None] Creating volume 6ee43c09-7a01-439b-b732-f4f1415dd09b {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:03:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-fcb9f539-6f0e-40fb-afdb-8539ad10dc68 tempest-ServersNegativeTestJSON-960750541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:03:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-fcb9f539-6f0e-40fb-afdb-8539ad10dc68 tempest-ServersNegativeTestJSON-960750541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:03:22 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-fcb9f539-6f0e-40fb-afdb-8539ad10dc68 tempest-ServersNegativeTestJSON-960750541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:03:22 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-fcb9f539-6f0e-40fb-afdb-8539ad10dc68 tempest-ServersNegativeTestJSON-960750541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:03:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-fcb9f539-6f0e-40fb-afdb-8539ad10dc68 tempest-ServersNegativeTestJSON-960750541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:03:22 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-fcb9f539-6f0e-40fb-afdb-8539ad10dc68 tempest-ServersNegativeTestJSON-960750541 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:03:22 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-fcb9f539-6f0e-40fb-afdb-8539ad10dc68 tempest-ServersNegativeTestJSON-960750541 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:03:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fcb9f539-6f0e-40fb-afdb-8539ad10dc68 tempest-ServersNegativeTestJSON-960750541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-6ee43c09-7a01-439b-b732-f4f1415dd09b 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:03:22 devstack sudo[88359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-6ee43c09-7a01-439b-b732-f4f1415dd09b 1073741824 Jul 10 10:03:22 devstack sudo[88359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:03:24 devstack sudo[88359]: pam_unix(sudo:session): session closed for user root Jul 10 10:03:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fcb9f539-6f0e-40fb-afdb-8539ad10dc68 tempest-ServersNegativeTestJSON-960750541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-6ee43c09-7a01-439b-b732-f4f1415dd09b 1073741824" returned: 0 in 1.965s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:03:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fcb9f539-6f0e-40fb-afdb-8539ad10dc68 tempest-ServersNegativeTestJSON-960750541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-6ee43c09-7a01-439b-b732-f4f1415dd09b {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:03:24 devstack sudo[88370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-6ee43c09-7a01-439b-b732-f4f1415dd09b Jul 10 10:03:24 devstack sudo[88370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:03:25 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b7074a1-c6f0-4dd5-8b3f-fe17db31c486 tempest-ServerActionsTestOtherA-825407832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:03:25 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4b7074a1-c6f0-4dd5-8b3f-fe17db31c486 tempest-ServerActionsTestOtherA-825407832 None] Flow 'volume_create_manager' (5b871393-7da6-433b-86e6-4e28c7c1d651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:03:25 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4b7074a1-c6f0-4dd5-8b3f-fe17db31c486 tempest-ServerActionsTestOtherA-825407832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b84175ae-23dc-40c0-ae00-4e1e1bb12db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:03:25 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4b7074a1-c6f0-4dd5-8b3f-fe17db31c486 tempest-ServerActionsTestOtherA-825407832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b84175ae-23dc-40c0-ae00-4e1e1bb12db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:03:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-680463155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23cad8a8-d6c3-4651-b661-7e29c56594e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82d2dc917ec948ba9616063fc74b0fe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:03:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:03:25Z,use_quota=True,user_id='d6c30f98c3a84d5f9cbf19397c0ac809',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:03:25 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4b7074a1-c6f0-4dd5-8b3f-fe17db31c486 tempest-ServerActionsTestOtherA-825407832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44fe238a-04e8-43eb-adbd-32e24beb2394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:03:25 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4b7074a1-c6f0-4dd5-8b3f-fe17db31c486 tempest-ServerActionsTestOtherA-825407832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44fe238a-04e8-43eb-adbd-32e24beb2394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:03:25 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4b7074a1-c6f0-4dd5-8b3f-fe17db31c486 tempest-ServerActionsTestOtherA-825407832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1572ea6-7373-40db-a59a-9d2af40d21de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:03:25 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4b7074a1-c6f0-4dd5-8b3f-fe17db31c486 tempest-ServerActionsTestOtherA-825407832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1572ea6-7373-40db-a59a-9d2af40d21de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23cad8a8-d6c3-4651-b661-7e29c56594e7', 'volume_name': 'volume-23cad8a8-d6c3-4651-b661-7e29c56594e7', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:03:25 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4b7074a1-c6f0-4dd5-8b3f-fe17db31c486 tempest-ServerActionsTestOtherA-825407832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1d13bd1-8758-484f-abbb-b8a348c3142f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:03:25 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4b7074a1-c6f0-4dd5-8b3f-fe17db31c486 tempest-ServerActionsTestOtherA-825407832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1d13bd1-8758-484f-abbb-b8a348c3142f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:03:25 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4b7074a1-c6f0-4dd5-8b3f-fe17db31c486 tempest-ServerActionsTestOtherA-825407832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7077de6e-ff08-465a-b6f9-6080204e29a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:03:25 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-4b7074a1-c6f0-4dd5-8b3f-fe17db31c486 tempest-ServerActionsTestOtherA-825407832 None] Volume 23cad8a8-d6c3-4651-b661-7e29c56594e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23cad8a8-d6c3-4651-b661-7e29c56594e7', 'volume_size': 1} Jul 10 10:03:25 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-4b7074a1-c6f0-4dd5-8b3f-fe17db31c486 tempest-ServerActionsTestOtherA-825407832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:03:25 devstack sudo[88370]: pam_unix(sudo:session): session closed for user root Jul 10 10:03:25 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fcb9f539-6f0e-40fb-afdb-8539ad10dc68 tempest-ServersNegativeTestJSON-960750541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-6ee43c09-7a01-439b-b732-f4f1415dd09b" returned: 0 in 1.256s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:03:25 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-fcb9f539-6f0e-40fb-afdb-8539ad10dc68 tempest-ServersNegativeTestJSON-960750541 None] <== create_volume: return (3322ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:03:25 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-fcb9f539-6f0e-40fb-afdb-8539ad10dc68 tempest-ServersNegativeTestJSON-960750541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.325s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:03:25 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-4b7074a1-c6f0-4dd5-8b3f-fe17db31c486 tempest-ServerActionsTestOtherA-825407832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.066s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:03:25 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-4b7074a1-c6f0-4dd5-8b3f-fe17db31c486 tempest-ServerActionsTestOtherA-825407832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:03:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-680463155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23cad8a8-d6c3-4651-b661-7e29c56594e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82d2dc917ec948ba9616063fc74b0fe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:03:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:03:25Z,use_quota=True,user_id='d6c30f98c3a84d5f9cbf19397c0ac809',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:03:25 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-4b7074a1-c6f0-4dd5-8b3f-fe17db31c486 tempest-ServerActionsTestOtherA-825407832 None] Creating volume 23cad8a8-d6c3-4651-b661-7e29c56594e7 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:03:25 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-4b7074a1-c6f0-4dd5-8b3f-fe17db31c486 tempest-ServerActionsTestOtherA-825407832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:03:25 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-4b7074a1-c6f0-4dd5-8b3f-fe17db31c486 tempest-ServerActionsTestOtherA-825407832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:03:25 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-4b7074a1-c6f0-4dd5-8b3f-fe17db31c486 tempest-ServerActionsTestOtherA-825407832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:03:25 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-4b7074a1-c6f0-4dd5-8b3f-fe17db31c486 tempest-ServerActionsTestOtherA-825407832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:03:25 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-4b7074a1-c6f0-4dd5-8b3f-fe17db31c486 tempest-ServerActionsTestOtherA-825407832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:03:25 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-4b7074a1-c6f0-4dd5-8b3f-fe17db31c486 tempest-ServerActionsTestOtherA-825407832 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:03:25 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-4b7074a1-c6f0-4dd5-8b3f-fe17db31c486 tempest-ServerActionsTestOtherA-825407832 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:03:25 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4b7074a1-c6f0-4dd5-8b3f-fe17db31c486 tempest-ServerActionsTestOtherA-825407832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-23cad8a8-d6c3-4651-b661-7e29c56594e7 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:03:25 devstack sudo[88374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-23cad8a8-d6c3-4651-b661-7e29c56594e7 1073741824 Jul 10 10:03:25 devstack sudo[88374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:03:25 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-fcb9f539-6f0e-40fb-afdb-8539ad10dc68 tempest-ServersNegativeTestJSON-960750541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4700a2a5-29fa-4325-bb1f-106d00622a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ee43c09-7a01-439b-b732-f4f1415dd09b', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:03:25 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-fcb9f539-6f0e-40fb-afdb-8539ad10dc68 tempest-ServersNegativeTestJSON-960750541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ddc9acd-2658-4c94-b333-487cdf2c45f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:03:25 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-fcb9f539-6f0e-40fb-afdb-8539ad10dc68 tempest-ServersNegativeTestJSON-960750541 None] Volume volume-6ee43c09-7a01-439b-b732-f4f1415dd09b (6ee43c09-7a01-439b-b732-f4f1415dd09b): created successfully Jul 10 10:03:25 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-fcb9f539-6f0e-40fb-afdb-8539ad10dc68 tempest-ServersNegativeTestJSON-960750541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ddc9acd-2658-4c94-b333-487cdf2c45f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:03:25 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-fcb9f539-6f0e-40fb-afdb-8539ad10dc68 tempest-ServersNegativeTestJSON-960750541 None] Flow 'volume_create_manager' (cf758c16-19d7-4a73-a620-ab9b3a3e733c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:03:25 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-fcb9f539-6f0e-40fb-afdb-8539ad10dc68 tempest-ServersNegativeTestJSON-960750541 None] Created volume successfully. Jul 10 10:03:27 devstack sudo[88374]: pam_unix(sudo:session): session closed for user root Jul 10 10:03:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4b7074a1-c6f0-4dd5-8b3f-fe17db31c486 tempest-ServerActionsTestOtherA-825407832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-23cad8a8-d6c3-4651-b661-7e29c56594e7 1073741824" returned: 0 in 1.506s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:03:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4b7074a1-c6f0-4dd5-8b3f-fe17db31c486 tempest-ServerActionsTestOtherA-825407832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-23cad8a8-d6c3-4651-b661-7e29c56594e7 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:03:27 devstack sudo[88381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-23cad8a8-d6c3-4651-b661-7e29c56594e7 Jul 10 10:03:27 devstack sudo[88381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:03:28 devstack sudo[88381]: pam_unix(sudo:session): session closed for user root Jul 10 10:03:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4b7074a1-c6f0-4dd5-8b3f-fe17db31c486 tempest-ServerActionsTestOtherA-825407832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-23cad8a8-d6c3-4651-b661-7e29c56594e7" returned: 0 in 1.271s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:03:28 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-4b7074a1-c6f0-4dd5-8b3f-fe17db31c486 tempest-ServerActionsTestOtherA-825407832 None] <== create_volume: return (2842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:03:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-4b7074a1-c6f0-4dd5-8b3f-fe17db31c486 tempest-ServerActionsTestOtherA-825407832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.845s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:03:28 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4b7074a1-c6f0-4dd5-8b3f-fe17db31c486 tempest-ServerActionsTestOtherA-825407832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7077de6e-ff08-465a-b6f9-6080204e29a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23cad8a8-d6c3-4651-b661-7e29c56594e7', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:03:28 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4b7074a1-c6f0-4dd5-8b3f-fe17db31c486 tempest-ServerActionsTestOtherA-825407832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (320d6da3-d102-442d-9f53-2893ae266314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:03:28 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-4b7074a1-c6f0-4dd5-8b3f-fe17db31c486 tempest-ServerActionsTestOtherA-825407832 None] Volume volume-23cad8a8-d6c3-4651-b661-7e29c56594e7 (23cad8a8-d6c3-4651-b661-7e29c56594e7): created successfully Jul 10 10:03:28 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4b7074a1-c6f0-4dd5-8b3f-fe17db31c486 tempest-ServerActionsTestOtherA-825407832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (320d6da3-d102-442d-9f53-2893ae266314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:03:28 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4b7074a1-c6f0-4dd5-8b3f-fe17db31c486 tempest-ServerActionsTestOtherA-825407832 None] Flow 'volume_create_manager' (5b871393-7da6-433b-86e6-4e28c7c1d651) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:03:28 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-4b7074a1-c6f0-4dd5-8b3f-fe17db31c486 tempest-ServerActionsTestOtherA-825407832 None] Created volume successfully. Jul 10 10:03:31 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a7d6153-4408-44e1-8cd7-2bc457fa6069 tempest-ServersNegativeTestJSON-960750541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:03:31 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8a7d6153-4408-44e1-8cd7-2bc457fa6069 tempest-ServersNegativeTestJSON-960750541 None] Flow 'volume_create_manager' (e3809c53-0dab-4cdb-9b70-286ff28808c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:03:31 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8a7d6153-4408-44e1-8cd7-2bc457fa6069 tempest-ServersNegativeTestJSON-960750541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1ac2e84-903e-4d12-859b-068c37285ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:03:31 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8a7d6153-4408-44e1-8cd7-2bc457fa6069 tempest-ServersNegativeTestJSON-960750541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1ac2e84-903e-4d12-859b-068c37285ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:03:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1209608882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d24153e-326f-457c-ad90-11c4fb3518af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e54df4cf5e4442f28adadd23ac253ddf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:03:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:03:32Z,use_quota=True,user_id='1e33a4073b4f40459bdcc34e856352cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:03:31 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8a7d6153-4408-44e1-8cd7-2bc457fa6069 tempest-ServersNegativeTestJSON-960750541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (921f3243-dbf3-4f98-a544-87028fbd0fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:03:31 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8a7d6153-4408-44e1-8cd7-2bc457fa6069 tempest-ServersNegativeTestJSON-960750541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (921f3243-dbf3-4f98-a544-87028fbd0fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:03:31 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8a7d6153-4408-44e1-8cd7-2bc457fa6069 tempest-ServersNegativeTestJSON-960750541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bcb44d9-e302-4477-be87-ce1fe7237b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:03:31 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8a7d6153-4408-44e1-8cd7-2bc457fa6069 tempest-ServersNegativeTestJSON-960750541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bcb44d9-e302-4477-be87-ce1fe7237b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d24153e-326f-457c-ad90-11c4fb3518af', 'volume_name': 'volume-3d24153e-326f-457c-ad90-11c4fb3518af', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:03:31 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8a7d6153-4408-44e1-8cd7-2bc457fa6069 tempest-ServersNegativeTestJSON-960750541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8147f76f-41d4-40be-9a00-e6a6a63cdaaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:03:31 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8a7d6153-4408-44e1-8cd7-2bc457fa6069 tempest-ServersNegativeTestJSON-960750541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8147f76f-41d4-40be-9a00-e6a6a63cdaaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:03:31 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8a7d6153-4408-44e1-8cd7-2bc457fa6069 tempest-ServersNegativeTestJSON-960750541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab60bfd7-4a06-4ae6-b444-e0b076515f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:03:31 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-8a7d6153-4408-44e1-8cd7-2bc457fa6069 tempest-ServersNegativeTestJSON-960750541 None] Volume 3d24153e-326f-457c-ad90-11c4fb3518af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d24153e-326f-457c-ad90-11c4fb3518af', 'volume_size': 1} Jul 10 10:03:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-8a7d6153-4408-44e1-8cd7-2bc457fa6069 tempest-ServersNegativeTestJSON-960750541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:03:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-8a7d6153-4408-44e1-8cd7-2bc457fa6069 tempest-ServersNegativeTestJSON-960750541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:03:31 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-8a7d6153-4408-44e1-8cd7-2bc457fa6069 tempest-ServersNegativeTestJSON-960750541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:03:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1209608882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d24153e-326f-457c-ad90-11c4fb3518af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e54df4cf5e4442f28adadd23ac253ddf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:03:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:03:32Z,use_quota=True,user_id='1e33a4073b4f40459bdcc34e856352cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:03:31 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-8a7d6153-4408-44e1-8cd7-2bc457fa6069 tempest-ServersNegativeTestJSON-960750541 None] Creating volume 3d24153e-326f-457c-ad90-11c4fb3518af {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:03:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-8a7d6153-4408-44e1-8cd7-2bc457fa6069 tempest-ServersNegativeTestJSON-960750541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:03:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-8a7d6153-4408-44e1-8cd7-2bc457fa6069 tempest-ServersNegativeTestJSON-960750541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:03:31 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-8a7d6153-4408-44e1-8cd7-2bc457fa6069 tempest-ServersNegativeTestJSON-960750541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:03:31 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-8a7d6153-4408-44e1-8cd7-2bc457fa6069 tempest-ServersNegativeTestJSON-960750541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:03:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-8a7d6153-4408-44e1-8cd7-2bc457fa6069 tempest-ServersNegativeTestJSON-960750541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:03:31 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-8a7d6153-4408-44e1-8cd7-2bc457fa6069 tempest-ServersNegativeTestJSON-960750541 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:03:31 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-8a7d6153-4408-44e1-8cd7-2bc457fa6069 tempest-ServersNegativeTestJSON-960750541 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:03:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-8a7d6153-4408-44e1-8cd7-2bc457fa6069 tempest-ServersNegativeTestJSON-960750541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3d24153e-326f-457c-ad90-11c4fb3518af 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:03:31 devstack sudo[88394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3d24153e-326f-457c-ad90-11c4fb3518af 1073741824 Jul 10 10:03:31 devstack sudo[88394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:03:33 devstack sudo[88394]: pam_unix(sudo:session): session closed for user root Jul 10 10:03:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-8a7d6153-4408-44e1-8cd7-2bc457fa6069 tempest-ServersNegativeTestJSON-960750541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3d24153e-326f-457c-ad90-11c4fb3518af 1073741824" returned: 0 in 1.310s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:03:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-8a7d6153-4408-44e1-8cd7-2bc457fa6069 tempest-ServersNegativeTestJSON-960750541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3d24153e-326f-457c-ad90-11c4fb3518af {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:03:33 devstack sudo[88404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3d24153e-326f-457c-ad90-11c4fb3518af Jul 10 10:03:33 devstack sudo[88404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:03:34 devstack sudo[88404]: pam_unix(sudo:session): session closed for user root Jul 10 10:03:34 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-8a7d6153-4408-44e1-8cd7-2bc457fa6069 tempest-ServersNegativeTestJSON-960750541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3d24153e-326f-457c-ad90-11c4fb3518af" returned: 0 in 0.792s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:03:34 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-8a7d6153-4408-44e1-8cd7-2bc457fa6069 tempest-ServersNegativeTestJSON-960750541 None] <== create_volume: return (2160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:03:34 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-8a7d6153-4408-44e1-8cd7-2bc457fa6069 tempest-ServersNegativeTestJSON-960750541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.164s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:03:34 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8a7d6153-4408-44e1-8cd7-2bc457fa6069 tempest-ServersNegativeTestJSON-960750541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab60bfd7-4a06-4ae6-b444-e0b076515f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d24153e-326f-457c-ad90-11c4fb3518af', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:03:34 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8a7d6153-4408-44e1-8cd7-2bc457fa6069 tempest-ServersNegativeTestJSON-960750541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ecc5a7a-521c-4a02-8253-453575fa9855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:03:34 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-8a7d6153-4408-44e1-8cd7-2bc457fa6069 tempest-ServersNegativeTestJSON-960750541 None] Volume volume-3d24153e-326f-457c-ad90-11c4fb3518af (3d24153e-326f-457c-ad90-11c4fb3518af): created successfully Jul 10 10:03:34 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8a7d6153-4408-44e1-8cd7-2bc457fa6069 tempest-ServersNegativeTestJSON-960750541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ecc5a7a-521c-4a02-8253-453575fa9855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:03:34 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8a7d6153-4408-44e1-8cd7-2bc457fa6069 tempest-ServersNegativeTestJSON-960750541 None] Flow 'volume_create_manager' (e3809c53-0dab-4cdb-9b70-286ff28808c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:03:34 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-8a7d6153-4408-44e1-8cd7-2bc457fa6069 tempest-ServersNegativeTestJSON-960750541 None] Created volume successfully. Jul 10 10:03:35 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-5315e309-e835-4351-917a-8f6777c96e7f tempest-ServersNegativeTestJSON-960750541 None] Acquiring lock "cinder-3d24153e-326f-457c-ad90-11c4fb3518af-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:03:35 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-5315e309-e835-4351-917a-8f6777c96e7f tempest-ServersNegativeTestJSON-960750541 None] Lock "cinder-3d24153e-326f-457c-ad90-11c4fb3518af-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:03:35 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-5315e309-e835-4351-917a-8f6777c96e7f tempest-ServersNegativeTestJSON-960750541 None] Acquiring lock "cinder-quobyte-3d24153e-326f-457c-ad90-11c4fb3518af" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:03:35 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-5315e309-e835-4351-917a-8f6777c96e7f tempest-ServersNegativeTestJSON-960750541 None] Lock "cinder-quobyte-3d24153e-326f-457c-ad90-11c4fb3518af" acquired by "delete_volume" :: waited 0.032s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:03:35 devstack cinder-volume[87234]: INFO oslo.privsep.daemon [None req-5315e309-e835-4351-917a-8f6777c96e7f tempest-ServersNegativeTestJSON-960750541 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp2y38mkrj/privsep.sock'] Jul 10 10:03:35 devstack sudo[88431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp2y38mkrj/privsep.sock Jul 10 10:03:35 devstack sudo[88431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:03:36 devstack cinder-volume[87234]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 10 10:03:36 devstack cinder-volume[87234]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 10 10:03:36 devstack cinder-volume[87234]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 10 10:03:36 devstack cinder-volume[87234]: WARNING oslo.privsep.daemon [-] privsep log: Jul 10 10:03:36 devstack cinder-volume[87234]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 10 10:03:36 devstack cinder-volume[87234]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 10 10:03:36 devstack cinder-volume[87234]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 10 10:03:36 devstack cinder-volume[87234]: WARNING oslo.privsep.daemon [-] privsep log: Jul 10 10:03:36 devstack cinder-volume[87234]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 10 10:03:37 devstack cinder-volume[87234]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 10 10:03:37 devstack cinder-volume[87234]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 10 10:03:37 devstack cinder-volume[87234]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 10 10:03:37 devstack cinder-volume[87234]: WARNING oslo.privsep.daemon [-] privsep log: Jul 10 10:03:37 devstack cinder-volume[87234]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 10 10:03:37 devstack cinder-volume[87234]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 10 10:03:37 devstack cinder-volume[87234]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 10 10:03:37 devstack cinder-volume[87234]: WARNING oslo.privsep.daemon [-] privsep log: Jul 10 10:03:37 devstack cinder-volume[87234]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 10 10:03:37 devstack sudo[88431]: pam_unix(sudo:session): session closed for user root Jul 10 10:03:37 devstack cinder-volume[87234]: INFO oslo.privsep.daemon [None req-5315e309-e835-4351-917a-8f6777c96e7f tempest-ServersNegativeTestJSON-960750541 None] Spawned new privsep daemon via rootwrap Jul 10 10:03:37 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [None req-5315e309-e835-4351-917a-8f6777c96e7f tempest-ServersNegativeTestJSON-960750541 None] Accepted privsep connection to /tmp/tmp2y38mkrj/privsep.sock {{(pid=87234) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 10 10:03:37 devstack cinder-volume[87234]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 10 10:03:37 devstack cinder-volume[87234]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 10 10:03:37 devstack cinder-volume[87234]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 10 10:03:37 devstack cinder-volume[87234]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88435 Jul 10 10:03:37 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb80f02-a25a-4541-bd59-ada2fa1e522f]: (2,) {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:03:37 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd4df9fb-989a-4f82-ab05-bace25a855a6]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:03:37 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5315e309-e835-4351-917a-8f6777c96e7f tempest-ServersNegativeTestJSON-960750541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3d24153e-326f-457c-ad90-11c4fb3518af {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:03:37 devstack sudo[88437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3d24153e-326f-457c-ad90-11c4fb3518af Jul 10 10:03:37 devstack sudo[88437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:03:38 devstack sudo[88437]: pam_unix(sudo:session): session closed for user root Jul 10 10:03:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5315e309-e835-4351-917a-8f6777c96e7f tempest-ServersNegativeTestJSON-960750541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3d24153e-326f-457c-ad90-11c4fb3518af" returned: 0 in 1.038s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:03:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5315e309-e835-4351-917a-8f6777c96e7f tempest-ServersNegativeTestJSON-960750541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3d24153e-326f-457c-ad90-11c4fb3518af {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:03:38 devstack sudo[88444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3d24153e-326f-457c-ad90-11c4fb3518af Jul 10 10:03:38 devstack sudo[88444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:03:39 devstack sudo[88444]: pam_unix(sudo:session): session closed for user root Jul 10 10:03:39 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5315e309-e835-4351-917a-8f6777c96e7f tempest-ServersNegativeTestJSON-960750541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3d24153e-326f-457c-ad90-11c4fb3518af" returned: 0 in 0.812s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:03:39 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-5315e309-e835-4351-917a-8f6777c96e7f tempest-ServersNegativeTestJSON-960750541 None] Lock "cinder-quobyte-3d24153e-326f-457c-ad90-11c4fb3518af" released by "delete_volume" :: held 3.642s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:03:39 devstack cinder-volume[87234]: WARNING cinder.quota [None req-5315e309-e835-4351-917a-8f6777c96e7f tempest-ServersNegativeTestJSON-960750541 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 10 10:03:39 devstack cinder-volume[87234]: WARNING cinder.quota [None req-5315e309-e835-4351-917a-8f6777c96e7f tempest-ServersNegativeTestJSON-960750541 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 10 10:03:39 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-5315e309-e835-4351-917a-8f6777c96e7f tempest-ServersNegativeTestJSON-960750541 None] Created reservations ['8236b7a8-7f92-47c3-9ef2-025e2704e9f5', '66e1d7af-d681-4610-9147-fd409c475d1c', '66475219-3de7-4b03-bef6-b60e7fd419bd', 'ff7b1d46-595a-4384-8023-76cd615b9fb0'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:03:39 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-5315e309-e835-4351-917a-8f6777c96e7f tempest-ServersNegativeTestJSON-960750541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:03:39 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-5315e309-e835-4351-917a-8f6777c96e7f tempest-ServersNegativeTestJSON-960750541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:03:39 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-5315e309-e835-4351-917a-8f6777c96e7f tempest-ServersNegativeTestJSON-960750541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:03:39 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-5315e309-e835-4351-917a-8f6777c96e7f tempest-ServersNegativeTestJSON-960750541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:03:39 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-5315e309-e835-4351-917a-8f6777c96e7f tempest-ServersNegativeTestJSON-960750541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:03:39 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5315e309-e835-4351-917a-8f6777c96e7f tempest-ServersNegativeTestJSON-960750541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:03:39 devstack sudo[88447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:03:39 devstack sudo[88447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:03:40 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-368547e5-1b6b-456a-8428-ba824391f167 tempest-ServersNegativeTestJSON-960750541 None] Acquiring lock "cinder-6ee43c09-7a01-439b-b732-f4f1415dd09b-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:03:40 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-368547e5-1b6b-456a-8428-ba824391f167 tempest-ServersNegativeTestJSON-960750541 None] Lock "cinder-6ee43c09-7a01-439b-b732-f4f1415dd09b-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:03:40 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-368547e5-1b6b-456a-8428-ba824391f167 tempest-ServersNegativeTestJSON-960750541 None] Acquiring lock "cinder-quobyte-6ee43c09-7a01-439b-b732-f4f1415dd09b" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:03:40 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-368547e5-1b6b-456a-8428-ba824391f167 tempest-ServersNegativeTestJSON-960750541 None] Lock "cinder-quobyte-6ee43c09-7a01-439b-b732-f4f1415dd09b" acquired by "delete_volume" :: waited 0.023s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:03:40 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[99bafa9e-5c3d-49ae-bd3f-d899a687ddf9]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:03:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-368547e5-1b6b-456a-8428-ba824391f167 tempest-ServersNegativeTestJSON-960750541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-6ee43c09-7a01-439b-b732-f4f1415dd09b {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:03:40 devstack sudo[88447]: pam_unix(sudo:session): session closed for user root Jul 10 10:03:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5315e309-e835-4351-917a-8f6777c96e7f tempest-ServersNegativeTestJSON-960750541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.892s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:03:40 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-5315e309-e835-4351-917a-8f6777c96e7f tempest-ServersNegativeTestJSON-960750541 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:03:40 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-5315e309-e835-4351-917a-8f6777c96e7f tempest-ServersNegativeTestJSON-960750541 None] Deleted volume successfully. Jul 10 10:03:40 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-5315e309-e835-4351-917a-8f6777c96e7f tempest-ServersNegativeTestJSON-960750541 None] Lock "cinder-3d24153e-326f-457c-ad90-11c4fb3518af-delete_volume" released by "delete_volume" :: held 4.862s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:03:40 devstack sudo[88466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-6ee43c09-7a01-439b-b732-f4f1415dd09b Jul 10 10:03:40 devstack sudo[88466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:03:41 devstack sudo[88466]: pam_unix(sudo:session): session closed for user root Jul 10 10:03:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-368547e5-1b6b-456a-8428-ba824391f167 tempest-ServersNegativeTestJSON-960750541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-6ee43c09-7a01-439b-b732-f4f1415dd09b" returned: 0 in 0.953s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:03:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-368547e5-1b6b-456a-8428-ba824391f167 tempest-ServersNegativeTestJSON-960750541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-6ee43c09-7a01-439b-b732-f4f1415dd09b {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:03:41 devstack sudo[88473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-6ee43c09-7a01-439b-b732-f4f1415dd09b Jul 10 10:03:41 devstack sudo[88473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:03:42 devstack cinder-volume[87234]: DEBUG oslo_service.periodic_task [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 10:03:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:03:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:03:42 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:03:42 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:03:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:03:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:03:42 devstack sudo[88476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:03:42 devstack sudo[88476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:03:42 devstack sudo[88473]: pam_unix(sudo:session): session closed for user root Jul 10 10:03:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-368547e5-1b6b-456a-8428-ba824391f167 tempest-ServersNegativeTestJSON-960750541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-6ee43c09-7a01-439b-b732-f4f1415dd09b" returned: 0 in 0.894s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:03:42 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-368547e5-1b6b-456a-8428-ba824391f167 tempest-ServersNegativeTestJSON-960750541 None] Lock "cinder-quobyte-6ee43c09-7a01-439b-b732-f4f1415dd09b" released by "delete_volume" :: held 1.915s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:03:42 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-368547e5-1b6b-456a-8428-ba824391f167 tempest-ServersNegativeTestJSON-960750541 None] Created reservations ['508df0ce-1dcd-49d9-ad5a-456a812b2108', '25b67a00-532d-4f26-81a0-ad95ba2d7a77', '412007bd-a914-4a15-9489-3a660246dc2d', '68b70689-e62b-44ac-8efb-54acea2d5202'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:03:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-368547e5-1b6b-456a-8428-ba824391f167 tempest-ServersNegativeTestJSON-960750541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:03:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-368547e5-1b6b-456a-8428-ba824391f167 tempest-ServersNegativeTestJSON-960750541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:03:42 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-368547e5-1b6b-456a-8428-ba824391f167 tempest-ServersNegativeTestJSON-960750541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:03:42 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-368547e5-1b6b-456a-8428-ba824391f167 tempest-ServersNegativeTestJSON-960750541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:03:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-368547e5-1b6b-456a-8428-ba824391f167 tempest-ServersNegativeTestJSON-960750541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:03:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-368547e5-1b6b-456a-8428-ba824391f167 tempest-ServersNegativeTestJSON-960750541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:03:42 devstack sudo[88478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:03:42 devstack sudo[88478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:03:42 devstack sudo[88476]: pam_unix(sudo:session): session closed for user root Jul 10 10:03:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.851s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:03:42 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:03:42 devstack cinder-volume[87234]: DEBUG oslo_service.periodic_task [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Running periodic task VolumeManager._thread_info {{(pid=87234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 10:03:42 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] thread count: 8 {{(pid=87234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 10:03:42 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] thread info: [<_MainThread(MainThread, started 131600773742720)>, , , , , , , ] {{(pid=87234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 10:03:43 devstack sudo[88478]: pam_unix(sudo:session): session closed for user root Jul 10 10:03:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-368547e5-1b6b-456a-8428-ba824391f167 tempest-ServersNegativeTestJSON-960750541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.872s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:03:43 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-368547e5-1b6b-456a-8428-ba824391f167 tempest-ServersNegativeTestJSON-960750541 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:03:43 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-368547e5-1b6b-456a-8428-ba824391f167 tempest-ServersNegativeTestJSON-960750541 None] Deleted volume successfully. Jul 10 10:03:43 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-368547e5-1b6b-456a-8428-ba824391f167 tempest-ServersNegativeTestJSON-960750541 None] Lock "cinder-6ee43c09-7a01-439b-b732-f4f1415dd09b-delete_volume" released by "delete_volume" :: held 3.212s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:04:02 devstack cinder-volume[87234]: DEBUG dbcounter [-] [87234] Writing DB stats cinder:SELECT=17,cinder:UPDATE=27,cinder:DELETE=4,cinder:INSERT=5 {{(pid=87234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 10:04:02 devstack cinder-volume[87234]: DEBUG dbcounter [-] [87234] Writing DB stats cinder:SELECT=16,cinder:UPDATE=24,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 10:04:04 devstack cinder-volume[87234]: WARNING py.warnings [req-e260590f-3e18-41ac-8df2-df78bd3b928b req-10f12bfc-09d2-473e-8ac3-e84ea9511600 tempest-TaggedAttachmentsTest-1977127549 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes". Apply join condition(s) between each element to resolve. Jul 10 10:04:04 devstack cinder-volume[87234]: .first() Jul 10 10:04:04 devstack cinder-volume[87234]: Jul 10 10:04:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-e260590f-3e18-41ac-8df2-df78bd3b928b req-10f12bfc-09d2-473e-8ac3-e84ea9511600 tempest-TaggedAttachmentsTest-1977127549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:04:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-e260590f-3e18-41ac-8df2-df78bd3b928b req-10f12bfc-09d2-473e-8ac3-e84ea9511600 tempest-TaggedAttachmentsTest-1977127549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:04:04 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[a68a5c32-e5c9-4a61-8e38-89136a26a058]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:04:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-e260590f-3e18-41ac-8df2-df78bd3b928b req-10f12bfc-09d2-473e-8ac3-e84ea9511600 tempest-TaggedAttachmentsTest-1977127549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f81da902-b085-4cfc-a13e-73957b8a004d {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:04:04 devstack sudo[88694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f81da902-b085-4cfc-a13e-73957b8a004d Jul 10 10:04:04 devstack sudo[88694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:04:05 devstack sudo[88694]: pam_unix(sudo:session): session closed for user root Jul 10 10:04:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-e260590f-3e18-41ac-8df2-df78bd3b928b req-10f12bfc-09d2-473e-8ac3-e84ea9511600 tempest-TaggedAttachmentsTest-1977127549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f81da902-b085-4cfc-a13e-73957b8a004d" returned: 0 in 0.894s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:04:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-e260590f-3e18-41ac-8df2-df78bd3b928b req-10f12bfc-09d2-473e-8ac3-e84ea9511600 tempest-TaggedAttachmentsTest-1977127549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.926s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:04:05 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [req-e260590f-3e18-41ac-8df2-df78bd3b928b req-10f12bfc-09d2-473e-8ac3-e84ea9511600 tempest-TaggedAttachmentsTest-1977127549 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091', 'name': 'volume-f81da902-b085-4cfc-a13e-73957b8a004d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '676dafbc-14bc-4720-b5f6-ceca4643f0fd', 'enforce_multipath': True} {{(pid=87234) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 10:04:05 devstack cinder-volume[87234]: INFO cinder.volume.manager [req-e260590f-3e18-41ac-8df2-df78bd3b928b req-10f12bfc-09d2-473e-8ac3-e84ea9511600 tempest-TaggedAttachmentsTest-1977127549 None] attachment_update completed successfully. Jul 10 10:04:13 devstack cinder-volume[87234]: INFO cinder.volume.manager [req-2f8a22b8-2ece-47a3-a5dc-e4cfe7f29a17 req-c6dcd7d4-b38d-46f8-943d-7ee583a2fa21 tempest-TaggedAttachmentsTest-1977127549 None] Terminate volume connection completed successfully. Jul 10 10:04:13 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [req-2f8a22b8-2ece-47a3-a5dc-e4cfe7f29a17 req-c6dcd7d4-b38d-46f8-943d-7ee583a2fa21 tempest-TaggedAttachmentsTest-1977127549 None] Deleting attachment 676dafbc-14bc-4720-b5f6-ceca4643f0fd. {{(pid=87234) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 10:04:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-3bead642-7c96-43c5-8243-3e744a0c98b9 req-5e8a4f48-71ba-41fd-a235-cfd6f0a0ac63 tempest-ServerActionsTestOtherA-825407832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:04:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-3bead642-7c96-43c5-8243-3e744a0c98b9 req-5e8a4f48-71ba-41fd-a235-cfd6f0a0ac63 tempest-ServerActionsTestOtherA-825407832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:04:16 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[7760cada-6453-4cee-99cb-c1812f74929d]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:04:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-3bead642-7c96-43c5-8243-3e744a0c98b9 req-5e8a4f48-71ba-41fd-a235-cfd6f0a0ac63 tempest-ServerActionsTestOtherA-825407832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-23cad8a8-d6c3-4651-b661-7e29c56594e7 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:04:16 devstack sudo[89258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-23cad8a8-d6c3-4651-b661-7e29c56594e7 Jul 10 10:04:16 devstack sudo[89258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:04:17 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1270d98-d6e9-42c8-b2a8-35f63932d0cd tempest-VolumesAdminNegativeTest-310301082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:04:17 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a1270d98-d6e9-42c8-b2a8-35f63932d0cd tempest-VolumesAdminNegativeTest-310301082 None] Flow 'volume_create_manager' (af258f5e-a9e3-42b5-b123-5b2635471dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:04:17 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a1270d98-d6e9-42c8-b2a8-35f63932d0cd tempest-VolumesAdminNegativeTest-310301082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b17f159-405c-4064-8469-754f1ed1257b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:04:17 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a1270d98-d6e9-42c8-b2a8-35f63932d0cd tempest-VolumesAdminNegativeTest-310301082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b17f159-405c-4064-8469-754f1ed1257b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:04:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1415926833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ebb37ce-b913-4c6b-b62b-3208759e81e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f5009501ecf4eb687f72fa3f5b57b9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:04:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:04:17Z,use_quota=True,user_id='c7ec44d2750a48f48114dcc369f41f68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:04:17 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a1270d98-d6e9-42c8-b2a8-35f63932d0cd tempest-VolumesAdminNegativeTest-310301082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d42dd192-7cee-47fe-a58b-9d57fab0c721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:04:17 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a1270d98-d6e9-42c8-b2a8-35f63932d0cd tempest-VolumesAdminNegativeTest-310301082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d42dd192-7cee-47fe-a58b-9d57fab0c721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:04:17 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a1270d98-d6e9-42c8-b2a8-35f63932d0cd tempest-VolumesAdminNegativeTest-310301082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49368fdf-7f5f-4f21-b91e-25fff827768e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:04:17 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a1270d98-d6e9-42c8-b2a8-35f63932d0cd tempest-VolumesAdminNegativeTest-310301082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49368fdf-7f5f-4f21-b91e-25fff827768e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ebb37ce-b913-4c6b-b62b-3208759e81e2', 'volume_name': 'volume-8ebb37ce-b913-4c6b-b62b-3208759e81e2', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:04:17 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a1270d98-d6e9-42c8-b2a8-35f63932d0cd tempest-VolumesAdminNegativeTest-310301082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7854163c-b168-4192-8e5a-d0f562f2415d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:04:17 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a1270d98-d6e9-42c8-b2a8-35f63932d0cd tempest-VolumesAdminNegativeTest-310301082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7854163c-b168-4192-8e5a-d0f562f2415d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:04:17 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a1270d98-d6e9-42c8-b2a8-35f63932d0cd tempest-VolumesAdminNegativeTest-310301082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bce6bcd0-7d69-43c7-a98d-3e71246ec96a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:04:17 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-a1270d98-d6e9-42c8-b2a8-35f63932d0cd tempest-VolumesAdminNegativeTest-310301082 None] Volume 8ebb37ce-b913-4c6b-b62b-3208759e81e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ebb37ce-b913-4c6b-b62b-3208759e81e2', 'volume_size': 1} Jul 10 10:04:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-a1270d98-d6e9-42c8-b2a8-35f63932d0cd tempest-VolumesAdminNegativeTest-310301082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:04:17 devstack sudo[89258]: pam_unix(sudo:session): session closed for user root Jul 10 10:04:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-3bead642-7c96-43c5-8243-3e744a0c98b9 req-5e8a4f48-71ba-41fd-a235-cfd6f0a0ac63 tempest-ServerActionsTestOtherA-825407832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-23cad8a8-d6c3-4651-b661-7e29c56594e7" returned: 0 in 1.390s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:04:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-3bead642-7c96-43c5-8243-3e744a0c98b9 req-5e8a4f48-71ba-41fd-a235-cfd6f0a0ac63 tempest-ServerActionsTestOtherA-825407832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.415s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:04:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-a1270d98-d6e9-42c8-b2a8-35f63932d0cd tempest-VolumesAdminNegativeTest-310301082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.153s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:04:17 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-a1270d98-d6e9-42c8-b2a8-35f63932d0cd tempest-VolumesAdminNegativeTest-310301082 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:04:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1415926833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ebb37ce-b913-4c6b-b62b-3208759e81e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f5009501ecf4eb687f72fa3f5b57b9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:04:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:04:17Z,use_quota=True,user_id='c7ec44d2750a48f48114dcc369f41f68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:04:17 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-a1270d98-d6e9-42c8-b2a8-35f63932d0cd tempest-VolumesAdminNegativeTest-310301082 None] Creating volume 8ebb37ce-b913-4c6b-b62b-3208759e81e2 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:04:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-a1270d98-d6e9-42c8-b2a8-35f63932d0cd tempest-VolumesAdminNegativeTest-310301082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:04:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-a1270d98-d6e9-42c8-b2a8-35f63932d0cd tempest-VolumesAdminNegativeTest-310301082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:04:17 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-a1270d98-d6e9-42c8-b2a8-35f63932d0cd tempest-VolumesAdminNegativeTest-310301082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:04:17 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-a1270d98-d6e9-42c8-b2a8-35f63932d0cd tempest-VolumesAdminNegativeTest-310301082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:04:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-a1270d98-d6e9-42c8-b2a8-35f63932d0cd tempest-VolumesAdminNegativeTest-310301082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:04:17 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-a1270d98-d6e9-42c8-b2a8-35f63932d0cd tempest-VolumesAdminNegativeTest-310301082 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:04:17 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-a1270d98-d6e9-42c8-b2a8-35f63932d0cd tempest-VolumesAdminNegativeTest-310301082 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:04:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a1270d98-d6e9-42c8-b2a8-35f63932d0cd tempest-VolumesAdminNegativeTest-310301082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8ebb37ce-b913-4c6b-b62b-3208759e81e2 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:04:17 devstack sudo[89285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8ebb37ce-b913-4c6b-b62b-3208759e81e2 1073741824 Jul 10 10:04:17 devstack sudo[89285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:04:17 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [req-3bead642-7c96-43c5-8243-3e744a0c98b9 req-5e8a4f48-71ba-41fd-a235-cfd6f0a0ac63 tempest-ServerActionsTestOtherA-825407832 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091', 'name': 'volume-23cad8a8-d6c3-4651-b661-7e29c56594e7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '156a1e2a-9b85-456e-9245-8cdf4af617f7', 'enforce_multipath': True} {{(pid=87234) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 10:04:17 devstack cinder-volume[87234]: INFO cinder.volume.manager [req-3bead642-7c96-43c5-8243-3e744a0c98b9 req-5e8a4f48-71ba-41fd-a235-cfd6f0a0ac63 tempest-ServerActionsTestOtherA-825407832 None] attachment_update completed successfully. Jul 10 10:04:19 devstack sudo[89285]: pam_unix(sudo:session): session closed for user root Jul 10 10:04:19 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a1270d98-d6e9-42c8-b2a8-35f63932d0cd tempest-VolumesAdminNegativeTest-310301082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8ebb37ce-b913-4c6b-b62b-3208759e81e2 1073741824" returned: 0 in 1.362s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:04:19 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a1270d98-d6e9-42c8-b2a8-35f63932d0cd tempest-VolumesAdminNegativeTest-310301082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8ebb37ce-b913-4c6b-b62b-3208759e81e2 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:04:19 devstack sudo[89361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8ebb37ce-b913-4c6b-b62b-3208759e81e2 Jul 10 10:04:19 devstack sudo[89361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:04:19 devstack sudo[89361]: pam_unix(sudo:session): session closed for user root Jul 10 10:04:19 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a1270d98-d6e9-42c8-b2a8-35f63932d0cd tempest-VolumesAdminNegativeTest-310301082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8ebb37ce-b913-4c6b-b62b-3208759e81e2" returned: 0 in 0.662s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:04:19 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-a1270d98-d6e9-42c8-b2a8-35f63932d0cd tempest-VolumesAdminNegativeTest-310301082 None] <== create_volume: return (2063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:04:19 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-a1270d98-d6e9-42c8-b2a8-35f63932d0cd tempest-VolumesAdminNegativeTest-310301082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.068s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:04:19 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a1270d98-d6e9-42c8-b2a8-35f63932d0cd tempest-VolumesAdminNegativeTest-310301082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bce6bcd0-7d69-43c7-a98d-3e71246ec96a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ebb37ce-b913-4c6b-b62b-3208759e81e2', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:04:19 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a1270d98-d6e9-42c8-b2a8-35f63932d0cd tempest-VolumesAdminNegativeTest-310301082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c39ab4e-7659-4d33-9572-06f5569f9acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:04:19 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-a1270d98-d6e9-42c8-b2a8-35f63932d0cd tempest-VolumesAdminNegativeTest-310301082 None] Volume volume-8ebb37ce-b913-4c6b-b62b-3208759e81e2 (8ebb37ce-b913-4c6b-b62b-3208759e81e2): created successfully Jul 10 10:04:19 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a1270d98-d6e9-42c8-b2a8-35f63932d0cd tempest-VolumesAdminNegativeTest-310301082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c39ab4e-7659-4d33-9572-06f5569f9acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:04:19 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a1270d98-d6e9-42c8-b2a8-35f63932d0cd tempest-VolumesAdminNegativeTest-310301082 None] Flow 'volume_create_manager' (af258f5e-a9e3-42b5-b123-5b2635471dc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:04:19 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-a1270d98-d6e9-42c8-b2a8-35f63932d0cd tempest-VolumesAdminNegativeTest-310301082 None] Created volume successfully. Jul 10 10:04:20 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-77c6614c-1b2f-4325-ba26-dfc6a7fc66e1 tempest-VolumesAdminNegativeTest-310301082 None] Acquiring lock "cinder-8ebb37ce-b913-4c6b-b62b-3208759e81e2-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:04:20 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-77c6614c-1b2f-4325-ba26-dfc6a7fc66e1 tempest-VolumesAdminNegativeTest-310301082 None] Lock "cinder-8ebb37ce-b913-4c6b-b62b-3208759e81e2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:04:20 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-77c6614c-1b2f-4325-ba26-dfc6a7fc66e1 tempest-VolumesAdminNegativeTest-310301082 None] Acquiring lock "cinder-quobyte-8ebb37ce-b913-4c6b-b62b-3208759e81e2" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:04:20 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-77c6614c-1b2f-4325-ba26-dfc6a7fc66e1 tempest-VolumesAdminNegativeTest-310301082 None] Lock "cinder-quobyte-8ebb37ce-b913-4c6b-b62b-3208759e81e2" acquired by "delete_volume" :: waited 0.018s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:04:20 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea84bcc-9cab-42f7-bb9e-2e62059f82cb]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:04:20 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-77c6614c-1b2f-4325-ba26-dfc6a7fc66e1 tempest-VolumesAdminNegativeTest-310301082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8ebb37ce-b913-4c6b-b62b-3208759e81e2 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:04:21 devstack sudo[89682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8ebb37ce-b913-4c6b-b62b-3208759e81e2 Jul 10 10:04:21 devstack sudo[89682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:04:22 devstack sudo[89682]: pam_unix(sudo:session): session closed for user root Jul 10 10:04:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-77c6614c-1b2f-4325-ba26-dfc6a7fc66e1 tempest-VolumesAdminNegativeTest-310301082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8ebb37ce-b913-4c6b-b62b-3208759e81e2" returned: 0 in 1.014s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:04:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-77c6614c-1b2f-4325-ba26-dfc6a7fc66e1 tempest-VolumesAdminNegativeTest-310301082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8ebb37ce-b913-4c6b-b62b-3208759e81e2 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:04:22 devstack sudo[89688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8ebb37ce-b913-4c6b-b62b-3208759e81e2 Jul 10 10:04:22 devstack sudo[89688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:04:23 devstack sudo[89688]: pam_unix(sudo:session): session closed for user root Jul 10 10:04:23 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-77c6614c-1b2f-4325-ba26-dfc6a7fc66e1 tempest-VolumesAdminNegativeTest-310301082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8ebb37ce-b913-4c6b-b62b-3208759e81e2" returned: 0 in 1.189s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:04:23 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-77c6614c-1b2f-4325-ba26-dfc6a7fc66e1 tempest-VolumesAdminNegativeTest-310301082 None] Lock "cinder-quobyte-8ebb37ce-b913-4c6b-b62b-3208759e81e2" released by "delete_volume" :: held 2.264s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:04:23 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-77c6614c-1b2f-4325-ba26-dfc6a7fc66e1 tempest-VolumesAdminNegativeTest-310301082 None] Created reservations ['c957b497-fcb4-4322-9674-be40ed251d73', '2759d36a-1d7e-4b83-8974-e4594f18652c', '9269fedd-8789-456e-ae2d-1d24e2dfa4d2', 'a139ea47-5c87-420a-90d6-e192122d8a64'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:04:23 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-77c6614c-1b2f-4325-ba26-dfc6a7fc66e1 tempest-VolumesAdminNegativeTest-310301082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:04:23 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-77c6614c-1b2f-4325-ba26-dfc6a7fc66e1 tempest-VolumesAdminNegativeTest-310301082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:04:23 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-77c6614c-1b2f-4325-ba26-dfc6a7fc66e1 tempest-VolumesAdminNegativeTest-310301082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:04:23 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-77c6614c-1b2f-4325-ba26-dfc6a7fc66e1 tempest-VolumesAdminNegativeTest-310301082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:04:23 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-77c6614c-1b2f-4325-ba26-dfc6a7fc66e1 tempest-VolumesAdminNegativeTest-310301082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:04:23 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-77c6614c-1b2f-4325-ba26-dfc6a7fc66e1 tempest-VolumesAdminNegativeTest-310301082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:04:23 devstack sudo[89693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:04:23 devstack sudo[89693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:04:24 devstack sudo[89693]: pam_unix(sudo:session): session closed for user root Jul 10 10:04:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-77c6614c-1b2f-4325-ba26-dfc6a7fc66e1 tempest-VolumesAdminNegativeTest-310301082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 1.200s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:04:24 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-77c6614c-1b2f-4325-ba26-dfc6a7fc66e1 tempest-VolumesAdminNegativeTest-310301082 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:04:24 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-77c6614c-1b2f-4325-ba26-dfc6a7fc66e1 tempest-VolumesAdminNegativeTest-310301082 None] Deleted volume successfully. Jul 10 10:04:24 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-77c6614c-1b2f-4325-ba26-dfc6a7fc66e1 tempest-VolumesAdminNegativeTest-310301082 None] Lock "cinder-8ebb37ce-b913-4c6b-b62b-3208759e81e2-delete_volume" released by "delete_volume" :: held 3.918s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:04:27 devstack cinder-volume[87234]: INFO cinder.volume.manager [req-4eab155a-84ae-4061-b13f-b2dfe49d0d8c req-e77d9bf4-e8cb-46b7-919b-8f533d4f3e0b tempest-ServerActionsTestOtherA-825407832 None] Terminate volume connection completed successfully. Jul 10 10:04:27 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [req-4eab155a-84ae-4061-b13f-b2dfe49d0d8c req-e77d9bf4-e8cb-46b7-919b-8f533d4f3e0b tempest-ServerActionsTestOtherA-825407832 None] Deleting attachment 156a1e2a-9b85-456e-9245-8cdf4af617f7. {{(pid=87234) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 10:04:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-4eab155a-84ae-4061-b13f-b2dfe49d0d8c req-cc70cc2d-37a8-4ad3-a99f-f0d23cfc890f tempest-ServerActionsTestOtherA-825407832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:04:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-4eab155a-84ae-4061-b13f-b2dfe49d0d8c req-cc70cc2d-37a8-4ad3-a99f-f0d23cfc890f tempest-ServerActionsTestOtherA-825407832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:04:30 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[877eca70-cc63-45c1-abcb-e92d1a5d7db8]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:04:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-4eab155a-84ae-4061-b13f-b2dfe49d0d8c req-cc70cc2d-37a8-4ad3-a99f-f0d23cfc890f tempest-ServerActionsTestOtherA-825407832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-23cad8a8-d6c3-4651-b661-7e29c56594e7 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:04:30 devstack sudo[89891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-23cad8a8-d6c3-4651-b661-7e29c56594e7 Jul 10 10:04:30 devstack sudo[89891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:04:31 devstack sudo[89891]: pam_unix(sudo:session): session closed for user root Jul 10 10:04:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-4eab155a-84ae-4061-b13f-b2dfe49d0d8c req-cc70cc2d-37a8-4ad3-a99f-f0d23cfc890f tempest-ServerActionsTestOtherA-825407832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-23cad8a8-d6c3-4651-b661-7e29c56594e7" returned: 0 in 0.876s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:04:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-4eab155a-84ae-4061-b13f-b2dfe49d0d8c req-cc70cc2d-37a8-4ad3-a99f-f0d23cfc890f tempest-ServerActionsTestOtherA-825407832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.900s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:04:31 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [req-4eab155a-84ae-4061-b13f-b2dfe49d0d8c req-cc70cc2d-37a8-4ad3-a99f-f0d23cfc890f tempest-ServerActionsTestOtherA-825407832 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091', 'name': 'volume-23cad8a8-d6c3-4651-b661-7e29c56594e7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c1694a58-7dd1-46c6-a7d9-6810afd5828c', 'enforce_multipath': True} {{(pid=87234) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 10:04:31 devstack cinder-volume[87234]: INFO cinder.volume.manager [req-4eab155a-84ae-4061-b13f-b2dfe49d0d8c req-cc70cc2d-37a8-4ad3-a99f-f0d23cfc890f tempest-ServerActionsTestOtherA-825407832 None] attachment_update completed successfully. Jul 10 10:04:36 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-1379f26f-8556-4787-8a94-750eb0705383 tempest-TaggedAttachmentsTest-1977127549 None] Acquiring lock "cinder-f81da902-b085-4cfc-a13e-73957b8a004d-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:04:36 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-1379f26f-8556-4787-8a94-750eb0705383 tempest-TaggedAttachmentsTest-1977127549 None] Lock "cinder-f81da902-b085-4cfc-a13e-73957b8a004d-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:04:36 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-1379f26f-8556-4787-8a94-750eb0705383 tempest-TaggedAttachmentsTest-1977127549 None] Acquiring lock "cinder-quobyte-f81da902-b085-4cfc-a13e-73957b8a004d" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:04:36 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-1379f26f-8556-4787-8a94-750eb0705383 tempest-TaggedAttachmentsTest-1977127549 None] Lock "cinder-quobyte-f81da902-b085-4cfc-a13e-73957b8a004d" acquired by "delete_volume" :: waited 0.026s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:04:36 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e0c547-92a5-422a-9c21-96113eb73d52]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:04:36 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1379f26f-8556-4787-8a94-750eb0705383 tempest-TaggedAttachmentsTest-1977127549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f81da902-b085-4cfc-a13e-73957b8a004d {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:04:36 devstack sudo[90025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f81da902-b085-4cfc-a13e-73957b8a004d Jul 10 10:04:36 devstack sudo[90025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:04:37 devstack sudo[90025]: pam_unix(sudo:session): session closed for user root Jul 10 10:04:37 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1379f26f-8556-4787-8a94-750eb0705383 tempest-TaggedAttachmentsTest-1977127549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f81da902-b085-4cfc-a13e-73957b8a004d" returned: 0 in 1.152s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:04:37 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1379f26f-8556-4787-8a94-750eb0705383 tempest-TaggedAttachmentsTest-1977127549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f81da902-b085-4cfc-a13e-73957b8a004d {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:04:37 devstack sudo[90051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f81da902-b085-4cfc-a13e-73957b8a004d Jul 10 10:04:37 devstack sudo[90051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:04:38 devstack sudo[90051]: pam_unix(sudo:session): session closed for user root Jul 10 10:04:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1379f26f-8556-4787-8a94-750eb0705383 tempest-TaggedAttachmentsTest-1977127549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f81da902-b085-4cfc-a13e-73957b8a004d" returned: 0 in 0.939s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:04:38 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-1379f26f-8556-4787-8a94-750eb0705383 tempest-TaggedAttachmentsTest-1977127549 None] Lock "cinder-quobyte-f81da902-b085-4cfc-a13e-73957b8a004d" released by "delete_volume" :: held 2.191s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:04:38 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-1379f26f-8556-4787-8a94-750eb0705383 tempest-TaggedAttachmentsTest-1977127549 None] Created reservations ['79566d8d-2836-45d0-bf60-a0e9caffcd63', '4aba4f4a-d024-475f-a1da-6c7c891012b6', '7b1befc7-572f-4488-9d08-c33088a4c4e1', '59902627-4115-40a0-a597-48b9a2e8bac4'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:04:39 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-1379f26f-8556-4787-8a94-750eb0705383 tempest-TaggedAttachmentsTest-1977127549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:04:39 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-1379f26f-8556-4787-8a94-750eb0705383 tempest-TaggedAttachmentsTest-1977127549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:04:39 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-1379f26f-8556-4787-8a94-750eb0705383 tempest-TaggedAttachmentsTest-1977127549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:04:39 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-1379f26f-8556-4787-8a94-750eb0705383 tempest-TaggedAttachmentsTest-1977127549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:04:39 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-1379f26f-8556-4787-8a94-750eb0705383 tempest-TaggedAttachmentsTest-1977127549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:04:39 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1379f26f-8556-4787-8a94-750eb0705383 tempest-TaggedAttachmentsTest-1977127549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:04:39 devstack sudo[90373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:04:39 devstack sudo[90373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:04:40 devstack sudo[90373]: pam_unix(sudo:session): session closed for user root Jul 10 10:04:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1379f26f-8556-4787-8a94-750eb0705383 tempest-TaggedAttachmentsTest-1977127549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 1.419s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:04:40 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-1379f26f-8556-4787-8a94-750eb0705383 tempest-TaggedAttachmentsTest-1977127549 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:04:40 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-1379f26f-8556-4787-8a94-750eb0705383 tempest-TaggedAttachmentsTest-1977127549 None] Deleted volume successfully. Jul 10 10:04:40 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-1379f26f-8556-4787-8a94-750eb0705383 tempest-TaggedAttachmentsTest-1977127549 None] Lock "cinder-f81da902-b085-4cfc-a13e-73957b8a004d-delete_volume" released by "delete_volume" :: held 3.977s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:04:42 devstack cinder-volume[87234]: DEBUG oslo_service.periodic_task [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 10:04:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:04:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:04:42 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:04:42 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:04:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:04:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:04:42 devstack sudo[90381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:04:42 devstack sudo[90381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:04:43 devstack sudo[90381]: pam_unix(sudo:session): session closed for user root Jul 10 10:04:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 1.200s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:04:43 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:04:43 devstack cinder-volume[87234]: DEBUG oslo_service.periodic_task [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Running periodic task VolumeManager._thread_info {{(pid=87234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 10:04:43 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] thread count: 8 {{(pid=87234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 10:04:43 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] thread info: [<_MainThread(MainThread, started 131600773742720)>, , , , , , , ] {{(pid=87234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 10:04:49 devstack cinder-volume[87234]: DEBUG dbcounter [-] [87234] Writing DB stats cinder:SELECT=28,cinder:UPDATE=25,cinder:DELETE=1,cinder:INSERT=6 {{(pid=87234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 10:04:50 devstack cinder-volume[87234]: DEBUG dbcounter [-] [87234] Writing DB stats cinder:SELECT=33,cinder:UPDATE=22,cinder:INSERT=3,cinder:DELETE=2 {{(pid=87234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 10:04:55 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-e71570c4-00de-4f8d-8f43-d40bbdead5ad tempest-VolumesTestJSON-1609307471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:04:55 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-e71570c4-00de-4f8d-8f43-d40bbdead5ad tempest-VolumesTestJSON-1609307471 None] Flow 'volume_create_manager' (e88972f6-9f22-42bd-b4c0-6bb6e09a9a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:04:55 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-e71570c4-00de-4f8d-8f43-d40bbdead5ad tempest-VolumesTestJSON-1609307471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3907b942-ef2d-4ee2-bb9c-64f8c3ca83a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:04:55 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-e71570c4-00de-4f8d-8f43-d40bbdead5ad tempest-VolumesTestJSON-1609307471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3907b942-ef2d-4ee2-bb9c-64f8c3ca83a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:04:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1734423652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=442db2d9-6d6b-4fd1-b618-978448a28bb8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f4bdb0bbfad74fe185c9a5509c0cd452',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:04:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:04:56Z,use_quota=True,user_id='6485cabd0351402c83fdf5ba2309b353',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:04:55 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-e71570c4-00de-4f8d-8f43-d40bbdead5ad tempest-VolumesTestJSON-1609307471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8ae8034-13ee-4201-a695-f8e6e9aee1a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:04:55 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-e71570c4-00de-4f8d-8f43-d40bbdead5ad tempest-VolumesTestJSON-1609307471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8ae8034-13ee-4201-a695-f8e6e9aee1a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:04:55 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-e71570c4-00de-4f8d-8f43-d40bbdead5ad tempest-VolumesTestJSON-1609307471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c70e9c1f-fa8f-432b-b95d-7bb52186183f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:04:55 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-e71570c4-00de-4f8d-8f43-d40bbdead5ad tempest-VolumesTestJSON-1609307471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c70e9c1f-fa8f-432b-b95d-7bb52186183f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '442db2d9-6d6b-4fd1-b618-978448a28bb8', 'volume_name': 'volume-442db2d9-6d6b-4fd1-b618-978448a28bb8', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:04:55 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-e71570c4-00de-4f8d-8f43-d40bbdead5ad tempest-VolumesTestJSON-1609307471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3780458-225b-411a-ba96-19e65dc69628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:04:55 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-e71570c4-00de-4f8d-8f43-d40bbdead5ad tempest-VolumesTestJSON-1609307471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3780458-225b-411a-ba96-19e65dc69628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:04:55 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-e71570c4-00de-4f8d-8f43-d40bbdead5ad tempest-VolumesTestJSON-1609307471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bbe3676-e05a-49fb-9e07-33dee57c7643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:04:55 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-e71570c4-00de-4f8d-8f43-d40bbdead5ad tempest-VolumesTestJSON-1609307471 None] Volume 442db2d9-6d6b-4fd1-b618-978448a28bb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-442db2d9-6d6b-4fd1-b618-978448a28bb8', 'volume_size': 1} Jul 10 10:04:55 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-e71570c4-00de-4f8d-8f43-d40bbdead5ad tempest-VolumesTestJSON-1609307471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:04:55 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-e71570c4-00de-4f8d-8f43-d40bbdead5ad tempest-VolumesTestJSON-1609307471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:04:55 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-e71570c4-00de-4f8d-8f43-d40bbdead5ad tempest-VolumesTestJSON-1609307471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:04:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1734423652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=442db2d9-6d6b-4fd1-b618-978448a28bb8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f4bdb0bbfad74fe185c9a5509c0cd452',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:04:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:04:56Z,use_quota=True,user_id='6485cabd0351402c83fdf5ba2309b353',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:04:55 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-e71570c4-00de-4f8d-8f43-d40bbdead5ad tempest-VolumesTestJSON-1609307471 None] Creating volume 442db2d9-6d6b-4fd1-b618-978448a28bb8 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:04:55 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-e71570c4-00de-4f8d-8f43-d40bbdead5ad tempest-VolumesTestJSON-1609307471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:04:55 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-e71570c4-00de-4f8d-8f43-d40bbdead5ad tempest-VolumesTestJSON-1609307471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:04:55 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-e71570c4-00de-4f8d-8f43-d40bbdead5ad tempest-VolumesTestJSON-1609307471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:04:55 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-e71570c4-00de-4f8d-8f43-d40bbdead5ad tempest-VolumesTestJSON-1609307471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:04:55 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-e71570c4-00de-4f8d-8f43-d40bbdead5ad tempest-VolumesTestJSON-1609307471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:04:55 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-e71570c4-00de-4f8d-8f43-d40bbdead5ad tempest-VolumesTestJSON-1609307471 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:04:55 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-e71570c4-00de-4f8d-8f43-d40bbdead5ad tempest-VolumesTestJSON-1609307471 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:04:55 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e71570c4-00de-4f8d-8f43-d40bbdead5ad tempest-VolumesTestJSON-1609307471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-442db2d9-6d6b-4fd1-b618-978448a28bb8 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:04:55 devstack sudo[90486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-442db2d9-6d6b-4fd1-b618-978448a28bb8 1073741824 Jul 10 10:04:55 devstack sudo[90486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:04:56 devstack sudo[90486]: pam_unix(sudo:session): session closed for user root Jul 10 10:04:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e71570c4-00de-4f8d-8f43-d40bbdead5ad tempest-VolumesTestJSON-1609307471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-442db2d9-6d6b-4fd1-b618-978448a28bb8 1073741824" returned: 0 in 0.963s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:04:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e71570c4-00de-4f8d-8f43-d40bbdead5ad tempest-VolumesTestJSON-1609307471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-442db2d9-6d6b-4fd1-b618-978448a28bb8 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:04:56 devstack sudo[90493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-442db2d9-6d6b-4fd1-b618-978448a28bb8 Jul 10 10:04:56 devstack sudo[90493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:04:57 devstack sudo[90493]: pam_unix(sudo:session): session closed for user root Jul 10 10:04:57 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e71570c4-00de-4f8d-8f43-d40bbdead5ad tempest-VolumesTestJSON-1609307471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-442db2d9-6d6b-4fd1-b618-978448a28bb8" returned: 0 in 0.722s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:04:57 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-e71570c4-00de-4f8d-8f43-d40bbdead5ad tempest-VolumesTestJSON-1609307471 None] <== create_volume: return (1741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:04:57 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-e71570c4-00de-4f8d-8f43-d40bbdead5ad tempest-VolumesTestJSON-1609307471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.744s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:04:57 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-e71570c4-00de-4f8d-8f43-d40bbdead5ad tempest-VolumesTestJSON-1609307471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bbe3676-e05a-49fb-9e07-33dee57c7643) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-442db2d9-6d6b-4fd1-b618-978448a28bb8', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:04:57 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-e71570c4-00de-4f8d-8f43-d40bbdead5ad tempest-VolumesTestJSON-1609307471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20576b5f-ee61-49de-ba5a-588e9c490e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:04:57 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-e71570c4-00de-4f8d-8f43-d40bbdead5ad tempest-VolumesTestJSON-1609307471 None] Volume volume-442db2d9-6d6b-4fd1-b618-978448a28bb8 (442db2d9-6d6b-4fd1-b618-978448a28bb8): created successfully Jul 10 10:04:57 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-e71570c4-00de-4f8d-8f43-d40bbdead5ad tempest-VolumesTestJSON-1609307471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20576b5f-ee61-49de-ba5a-588e9c490e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:04:57 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-e71570c4-00de-4f8d-8f43-d40bbdead5ad tempest-VolumesTestJSON-1609307471 None] Flow 'volume_create_manager' (e88972f6-9f22-42bd-b4c0-6bb6e09a9a99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:04:57 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-e71570c4-00de-4f8d-8f43-d40bbdead5ad tempest-VolumesTestJSON-1609307471 None] Created volume successfully. Jul 10 10:04:58 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5f67b19-9e19-4540-8eb5-04131172349f tempest-VolumesTestJSON-1609307471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:04:58 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a5f67b19-9e19-4540-8eb5-04131172349f tempest-VolumesTestJSON-1609307471 None] Flow 'volume_create_manager' (672738ad-4537-4063-bb44-2bfc6938c3f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:04:58 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a5f67b19-9e19-4540-8eb5-04131172349f tempest-VolumesTestJSON-1609307471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffdf1753-25c8-4328-a3c8-24cdef7dd8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:04:58 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a5f67b19-9e19-4540-8eb5-04131172349f tempest-VolumesTestJSON-1609307471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffdf1753-25c8-4328-a3c8-24cdef7dd8f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:04:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1059086372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db9fc914-0bb6-42df-85ff-45ba6edb0f98,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f4bdb0bbfad74fe185c9a5509c0cd452',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:04:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:04:58Z,use_quota=True,user_id='6485cabd0351402c83fdf5ba2309b353',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:04:58 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a5f67b19-9e19-4540-8eb5-04131172349f tempest-VolumesTestJSON-1609307471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c919186-b4ef-4257-9f93-0b1e24555eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:04:58 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a5f67b19-9e19-4540-8eb5-04131172349f tempest-VolumesTestJSON-1609307471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c919186-b4ef-4257-9f93-0b1e24555eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:04:58 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a5f67b19-9e19-4540-8eb5-04131172349f tempest-VolumesTestJSON-1609307471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a985c706-8893-415e-be46-92743d1aa72d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:04:58 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a5f67b19-9e19-4540-8eb5-04131172349f tempest-VolumesTestJSON-1609307471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a985c706-8893-415e-be46-92743d1aa72d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db9fc914-0bb6-42df-85ff-45ba6edb0f98', 'volume_name': 'volume-db9fc914-0bb6-42df-85ff-45ba6edb0f98', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:04:58 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a5f67b19-9e19-4540-8eb5-04131172349f tempest-VolumesTestJSON-1609307471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d5a79ed-b587-462d-b90a-f29b44a00587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:04:58 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a5f67b19-9e19-4540-8eb5-04131172349f tempest-VolumesTestJSON-1609307471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d5a79ed-b587-462d-b90a-f29b44a00587) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:04:58 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a5f67b19-9e19-4540-8eb5-04131172349f tempest-VolumesTestJSON-1609307471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae1b806c-e9c4-4e90-984a-8e67543acfeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:04:58 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-a5f67b19-9e19-4540-8eb5-04131172349f tempest-VolumesTestJSON-1609307471 None] Volume db9fc914-0bb6-42df-85ff-45ba6edb0f98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db9fc914-0bb6-42df-85ff-45ba6edb0f98', 'volume_size': 1} Jul 10 10:04:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-a5f67b19-9e19-4540-8eb5-04131172349f tempest-VolumesTestJSON-1609307471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:04:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-a5f67b19-9e19-4540-8eb5-04131172349f tempest-VolumesTestJSON-1609307471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:04:58 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-a5f67b19-9e19-4540-8eb5-04131172349f tempest-VolumesTestJSON-1609307471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:04:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1059086372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db9fc914-0bb6-42df-85ff-45ba6edb0f98,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f4bdb0bbfad74fe185c9a5509c0cd452',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:04:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:04:58Z,use_quota=True,user_id='6485cabd0351402c83fdf5ba2309b353',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:04:58 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-a5f67b19-9e19-4540-8eb5-04131172349f tempest-VolumesTestJSON-1609307471 None] Creating volume db9fc914-0bb6-42df-85ff-45ba6edb0f98 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:04:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-a5f67b19-9e19-4540-8eb5-04131172349f tempest-VolumesTestJSON-1609307471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:04:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-a5f67b19-9e19-4540-8eb5-04131172349f tempest-VolumesTestJSON-1609307471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:04:58 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-a5f67b19-9e19-4540-8eb5-04131172349f tempest-VolumesTestJSON-1609307471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:04:58 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-a5f67b19-9e19-4540-8eb5-04131172349f tempest-VolumesTestJSON-1609307471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:04:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-a5f67b19-9e19-4540-8eb5-04131172349f tempest-VolumesTestJSON-1609307471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:04:58 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-a5f67b19-9e19-4540-8eb5-04131172349f tempest-VolumesTestJSON-1609307471 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:04:58 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-a5f67b19-9e19-4540-8eb5-04131172349f tempest-VolumesTestJSON-1609307471 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:04:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a5f67b19-9e19-4540-8eb5-04131172349f tempest-VolumesTestJSON-1609307471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-db9fc914-0bb6-42df-85ff-45ba6edb0f98 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:04:58 devstack sudo[90501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-db9fc914-0bb6-42df-85ff-45ba6edb0f98 1073741824 Jul 10 10:04:58 devstack sudo[90501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:04:59 devstack sudo[90501]: pam_unix(sudo:session): session closed for user root Jul 10 10:04:59 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a5f67b19-9e19-4540-8eb5-04131172349f tempest-VolumesTestJSON-1609307471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-db9fc914-0bb6-42df-85ff-45ba6edb0f98 1073741824" returned: 0 in 1.102s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:04:59 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd6f0c38-5e3e-471d-b120-a0f56050fde9 tempest-AttachVolumeShelveTestJSON-932158510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:04:59 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-cd6f0c38-5e3e-471d-b120-a0f56050fde9 tempest-AttachVolumeShelveTestJSON-932158510 None] Flow 'volume_create_manager' (ee1627e3-5896-4fa8-94b9-5fd2b8b77c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:04:59 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-cd6f0c38-5e3e-471d-b120-a0f56050fde9 tempest-AttachVolumeShelveTestJSON-932158510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5edf422-31cd-432e-bc4f-7f6a8ce2c404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:04:59 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-cd6f0c38-5e3e-471d-b120-a0f56050fde9 tempest-AttachVolumeShelveTestJSON-932158510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5edf422-31cd-432e-bc4f-7f6a8ce2c404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:04:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1836095797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1714a1ce-74a3-4919-a1b4-7fe0a683230f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13f69faec0c64dbab8814688d574621b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:05:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:05:00Z,use_quota=True,user_id='927745964a6444909c59e3f36abd7466',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:04:59 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-cd6f0c38-5e3e-471d-b120-a0f56050fde9 tempest-AttachVolumeShelveTestJSON-932158510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48b1d7af-079a-4fa9-aa93-0e9ccb13a4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:04:59 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-cd6f0c38-5e3e-471d-b120-a0f56050fde9 tempest-AttachVolumeShelveTestJSON-932158510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48b1d7af-079a-4fa9-aa93-0e9ccb13a4f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:04:59 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-cd6f0c38-5e3e-471d-b120-a0f56050fde9 tempest-AttachVolumeShelveTestJSON-932158510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a8f26c1-5d35-4db2-bc0c-8d9b10279e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:04:59 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-cd6f0c38-5e3e-471d-b120-a0f56050fde9 tempest-AttachVolumeShelveTestJSON-932158510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a8f26c1-5d35-4db2-bc0c-8d9b10279e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1714a1ce-74a3-4919-a1b4-7fe0a683230f', 'volume_name': 'volume-1714a1ce-74a3-4919-a1b4-7fe0a683230f', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:04:59 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-cd6f0c38-5e3e-471d-b120-a0f56050fde9 tempest-AttachVolumeShelveTestJSON-932158510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56f82de7-bf3b-49ee-a441-575d32a7e27c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:04:59 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-cd6f0c38-5e3e-471d-b120-a0f56050fde9 tempest-AttachVolumeShelveTestJSON-932158510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56f82de7-bf3b-49ee-a441-575d32a7e27c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:04:59 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-cd6f0c38-5e3e-471d-b120-a0f56050fde9 tempest-AttachVolumeShelveTestJSON-932158510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cf61f1e-7aab-4656-a195-a6bbc6563be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:04:59 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-cd6f0c38-5e3e-471d-b120-a0f56050fde9 tempest-AttachVolumeShelveTestJSON-932158510 None] Volume 1714a1ce-74a3-4919-a1b4-7fe0a683230f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1714a1ce-74a3-4919-a1b4-7fe0a683230f', 'volume_size': 1} Jul 10 10:04:59 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-cd6f0c38-5e3e-471d-b120-a0f56050fde9 tempest-AttachVolumeShelveTestJSON-932158510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:05:00 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a5f67b19-9e19-4540-8eb5-04131172349f tempest-VolumesTestJSON-1609307471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-db9fc914-0bb6-42df-85ff-45ba6edb0f98 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:05:00 devstack sudo[90528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-db9fc914-0bb6-42df-85ff-45ba6edb0f98 Jul 10 10:05:00 devstack sudo[90528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:05:00 devstack sudo[90528]: pam_unix(sudo:session): session closed for user root Jul 10 10:05:00 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a5f67b19-9e19-4540-8eb5-04131172349f tempest-VolumesTestJSON-1609307471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-db9fc914-0bb6-42df-85ff-45ba6edb0f98" returned: 0 in 0.872s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:05:00 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-a5f67b19-9e19-4540-8eb5-04131172349f tempest-VolumesTestJSON-1609307471 None] <== create_volume: return (2209ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:05:00 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-a5f67b19-9e19-4540-8eb5-04131172349f tempest-VolumesTestJSON-1609307471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.218s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:05:00 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-cd6f0c38-5e3e-471d-b120-a0f56050fde9 tempest-AttachVolumeShelveTestJSON-932158510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.923s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:05:00 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-cd6f0c38-5e3e-471d-b120-a0f56050fde9 tempest-AttachVolumeShelveTestJSON-932158510 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:04:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1836095797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1714a1ce-74a3-4919-a1b4-7fe0a683230f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13f69faec0c64dbab8814688d574621b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:05:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:05:00Z,use_quota=True,user_id='927745964a6444909c59e3f36abd7466',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:05:00 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-cd6f0c38-5e3e-471d-b120-a0f56050fde9 tempest-AttachVolumeShelveTestJSON-932158510 None] Creating volume 1714a1ce-74a3-4919-a1b4-7fe0a683230f {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:05:00 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-cd6f0c38-5e3e-471d-b120-a0f56050fde9 tempest-AttachVolumeShelveTestJSON-932158510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:05:00 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-cd6f0c38-5e3e-471d-b120-a0f56050fde9 tempest-AttachVolumeShelveTestJSON-932158510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:05:00 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-cd6f0c38-5e3e-471d-b120-a0f56050fde9 tempest-AttachVolumeShelveTestJSON-932158510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:05:00 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-cd6f0c38-5e3e-471d-b120-a0f56050fde9 tempest-AttachVolumeShelveTestJSON-932158510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:05:00 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-cd6f0c38-5e3e-471d-b120-a0f56050fde9 tempest-AttachVolumeShelveTestJSON-932158510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:05:00 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-cd6f0c38-5e3e-471d-b120-a0f56050fde9 tempest-AttachVolumeShelveTestJSON-932158510 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:05:00 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-cd6f0c38-5e3e-471d-b120-a0f56050fde9 tempest-AttachVolumeShelveTestJSON-932158510 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:05:00 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-cd6f0c38-5e3e-471d-b120-a0f56050fde9 tempest-AttachVolumeShelveTestJSON-932158510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-1714a1ce-74a3-4919-a1b4-7fe0a683230f 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:05:00 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a5f67b19-9e19-4540-8eb5-04131172349f tempest-VolumesTestJSON-1609307471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae1b806c-e9c4-4e90-984a-8e67543acfeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db9fc914-0bb6-42df-85ff-45ba6edb0f98', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:05:00 devstack sudo[90532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-1714a1ce-74a3-4919-a1b4-7fe0a683230f 1073741824 Jul 10 10:05:00 devstack sudo[90532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:05:00 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a5f67b19-9e19-4540-8eb5-04131172349f tempest-VolumesTestJSON-1609307471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ab2d6b6-01f4-4fce-b70a-eb461b613707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:05:00 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-a5f67b19-9e19-4540-8eb5-04131172349f tempest-VolumesTestJSON-1609307471 None] Volume volume-db9fc914-0bb6-42df-85ff-45ba6edb0f98 (db9fc914-0bb6-42df-85ff-45ba6edb0f98): created successfully Jul 10 10:05:01 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a5f67b19-9e19-4540-8eb5-04131172349f tempest-VolumesTestJSON-1609307471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ab2d6b6-01f4-4fce-b70a-eb461b613707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:05:01 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a5f67b19-9e19-4540-8eb5-04131172349f tempest-VolumesTestJSON-1609307471 None] Flow 'volume_create_manager' (672738ad-4537-4063-bb44-2bfc6938c3f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:05:01 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-a5f67b19-9e19-4540-8eb5-04131172349f tempest-VolumesTestJSON-1609307471 None] Created volume successfully. Jul 10 10:05:02 devstack sudo[90532]: pam_unix(sudo:session): session closed for user root Jul 10 10:05:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-cd6f0c38-5e3e-471d-b120-a0f56050fde9 tempest-AttachVolumeShelveTestJSON-932158510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-1714a1ce-74a3-4919-a1b4-7fe0a683230f 1073741824" returned: 0 in 1.130s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:05:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-cd6f0c38-5e3e-471d-b120-a0f56050fde9 tempest-AttachVolumeShelveTestJSON-932158510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-1714a1ce-74a3-4919-a1b4-7fe0a683230f {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:05:02 devstack sudo[90543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-1714a1ce-74a3-4919-a1b4-7fe0a683230f Jul 10 10:05:02 devstack sudo[90543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:05:02 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0f5ee8b-a6d9-4b53-b06f-1a5e34dc5066 tempest-VolumesTestJSON-1609307471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:05:02 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f0f5ee8b-a6d9-4b53-b06f-1a5e34dc5066 tempest-VolumesTestJSON-1609307471 None] Flow 'volume_create_manager' (06feefe2-b7f7-48e0-95a2-37ec6ffe7a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:05:02 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f0f5ee8b-a6d9-4b53-b06f-1a5e34dc5066 tempest-VolumesTestJSON-1609307471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10634699-3ebd-4e46-870f-eb18f1ba8d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:05:02 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f0f5ee8b-a6d9-4b53-b06f-1a5e34dc5066 tempest-VolumesTestJSON-1609307471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10634699-3ebd-4e46-870f-eb18f1ba8d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:05:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-857843976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e4272f6-e89b-4acf-94e9-78086b6ed58d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f4bdb0bbfad74fe185c9a5509c0cd452',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:05:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:05:02Z,use_quota=True,user_id='6485cabd0351402c83fdf5ba2309b353',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:05:02 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f0f5ee8b-a6d9-4b53-b06f-1a5e34dc5066 tempest-VolumesTestJSON-1609307471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3e8f6d7-93cc-490c-bf84-08405de6b43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:05:02 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f0f5ee8b-a6d9-4b53-b06f-1a5e34dc5066 tempest-VolumesTestJSON-1609307471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3e8f6d7-93cc-490c-bf84-08405de6b43f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:05:02 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f0f5ee8b-a6d9-4b53-b06f-1a5e34dc5066 tempest-VolumesTestJSON-1609307471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcbb5f4c-39eb-43c1-8030-b63f3c2defa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:05:02 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f0f5ee8b-a6d9-4b53-b06f-1a5e34dc5066 tempest-VolumesTestJSON-1609307471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcbb5f4c-39eb-43c1-8030-b63f3c2defa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e4272f6-e89b-4acf-94e9-78086b6ed58d', 'volume_name': 'volume-6e4272f6-e89b-4acf-94e9-78086b6ed58d', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:05:02 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f0f5ee8b-a6d9-4b53-b06f-1a5e34dc5066 tempest-VolumesTestJSON-1609307471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36a6dd09-3bee-4a51-aa0a-fbee0b153613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:05:02 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f0f5ee8b-a6d9-4b53-b06f-1a5e34dc5066 tempest-VolumesTestJSON-1609307471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36a6dd09-3bee-4a51-aa0a-fbee0b153613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:05:02 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f0f5ee8b-a6d9-4b53-b06f-1a5e34dc5066 tempest-VolumesTestJSON-1609307471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb4434a1-1bf4-457e-a407-67e7c7e1cb23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:05:02 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-f0f5ee8b-a6d9-4b53-b06f-1a5e34dc5066 tempest-VolumesTestJSON-1609307471 None] Volume 6e4272f6-e89b-4acf-94e9-78086b6ed58d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e4272f6-e89b-4acf-94e9-78086b6ed58d', 'volume_size': 1} Jul 10 10:05:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f0f5ee8b-a6d9-4b53-b06f-1a5e34dc5066 tempest-VolumesTestJSON-1609307471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:05:02 devstack sudo[90543]: pam_unix(sudo:session): session closed for user root Jul 10 10:05:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-cd6f0c38-5e3e-471d-b120-a0f56050fde9 tempest-AttachVolumeShelveTestJSON-932158510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-1714a1ce-74a3-4919-a1b4-7fe0a683230f" returned: 0 in 0.869s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:05:02 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-cd6f0c38-5e3e-471d-b120-a0f56050fde9 tempest-AttachVolumeShelveTestJSON-932158510 None] <== create_volume: return (2056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:05:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-cd6f0c38-5e3e-471d-b120-a0f56050fde9 tempest-AttachVolumeShelveTestJSON-932158510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.061s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:05:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f0f5ee8b-a6d9-4b53-b06f-1a5e34dc5066 tempest-VolumesTestJSON-1609307471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.392s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:05:02 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f0f5ee8b-a6d9-4b53-b06f-1a5e34dc5066 tempest-VolumesTestJSON-1609307471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:05:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-857843976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e4272f6-e89b-4acf-94e9-78086b6ed58d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f4bdb0bbfad74fe185c9a5509c0cd452',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:05:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:05:02Z,use_quota=True,user_id='6485cabd0351402c83fdf5ba2309b353',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:05:02 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-f0f5ee8b-a6d9-4b53-b06f-1a5e34dc5066 tempest-VolumesTestJSON-1609307471 None] Creating volume 6e4272f6-e89b-4acf-94e9-78086b6ed58d {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:05:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f0f5ee8b-a6d9-4b53-b06f-1a5e34dc5066 tempest-VolumesTestJSON-1609307471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:05:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f0f5ee8b-a6d9-4b53-b06f-1a5e34dc5066 tempest-VolumesTestJSON-1609307471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:05:02 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f0f5ee8b-a6d9-4b53-b06f-1a5e34dc5066 tempest-VolumesTestJSON-1609307471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:05:02 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f0f5ee8b-a6d9-4b53-b06f-1a5e34dc5066 tempest-VolumesTestJSON-1609307471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:05:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f0f5ee8b-a6d9-4b53-b06f-1a5e34dc5066 tempest-VolumesTestJSON-1609307471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:05:02 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f0f5ee8b-a6d9-4b53-b06f-1a5e34dc5066 tempest-VolumesTestJSON-1609307471 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:05:02 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-f0f5ee8b-a6d9-4b53-b06f-1a5e34dc5066 tempest-VolumesTestJSON-1609307471 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:05:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f0f5ee8b-a6d9-4b53-b06f-1a5e34dc5066 tempest-VolumesTestJSON-1609307471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-6e4272f6-e89b-4acf-94e9-78086b6ed58d 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:05:02 devstack sudo[90546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-6e4272f6-e89b-4acf-94e9-78086b6ed58d 1073741824 Jul 10 10:05:02 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-cd6f0c38-5e3e-471d-b120-a0f56050fde9 tempest-AttachVolumeShelveTestJSON-932158510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cf61f1e-7aab-4656-a195-a6bbc6563be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1714a1ce-74a3-4919-a1b4-7fe0a683230f', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:05:02 devstack sudo[90546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:05:02 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-cd6f0c38-5e3e-471d-b120-a0f56050fde9 tempest-AttachVolumeShelveTestJSON-932158510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (173eebc1-9302-4b1f-9901-e7168073afc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:05:03 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-cd6f0c38-5e3e-471d-b120-a0f56050fde9 tempest-AttachVolumeShelveTestJSON-932158510 None] Volume volume-1714a1ce-74a3-4919-a1b4-7fe0a683230f (1714a1ce-74a3-4919-a1b4-7fe0a683230f): created successfully Jul 10 10:05:03 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-cd6f0c38-5e3e-471d-b120-a0f56050fde9 tempest-AttachVolumeShelveTestJSON-932158510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (173eebc1-9302-4b1f-9901-e7168073afc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:05:03 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-cd6f0c38-5e3e-471d-b120-a0f56050fde9 tempest-AttachVolumeShelveTestJSON-932158510 None] Flow 'volume_create_manager' (ee1627e3-5896-4fa8-94b9-5fd2b8b77c33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:05:03 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-cd6f0c38-5e3e-471d-b120-a0f56050fde9 tempest-AttachVolumeShelveTestJSON-932158510 None] Created volume successfully. Jul 10 10:05:03 devstack sudo[90546]: pam_unix(sudo:session): session closed for user root Jul 10 10:05:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f0f5ee8b-a6d9-4b53-b06f-1a5e34dc5066 tempest-VolumesTestJSON-1609307471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-6e4272f6-e89b-4acf-94e9-78086b6ed58d 1073741824" returned: 0 in 0.867s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:05:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f0f5ee8b-a6d9-4b53-b06f-1a5e34dc5066 tempest-VolumesTestJSON-1609307471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-6e4272f6-e89b-4acf-94e9-78086b6ed58d {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:05:03 devstack sudo[90551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-6e4272f6-e89b-4acf-94e9-78086b6ed58d Jul 10 10:05:03 devstack sudo[90551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:05:04 devstack sudo[90551]: pam_unix(sudo:session): session closed for user root Jul 10 10:05:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f0f5ee8b-a6d9-4b53-b06f-1a5e34dc5066 tempest-VolumesTestJSON-1609307471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-6e4272f6-e89b-4acf-94e9-78086b6ed58d" returned: 0 in 0.758s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:05:04 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f0f5ee8b-a6d9-4b53-b06f-1a5e34dc5066 tempest-VolumesTestJSON-1609307471 None] <== create_volume: return (1672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:05:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f0f5ee8b-a6d9-4b53-b06f-1a5e34dc5066 tempest-VolumesTestJSON-1609307471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.675s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:05:04 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f0f5ee8b-a6d9-4b53-b06f-1a5e34dc5066 tempest-VolumesTestJSON-1609307471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb4434a1-1bf4-457e-a407-67e7c7e1cb23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e4272f6-e89b-4acf-94e9-78086b6ed58d', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:05:04 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f0f5ee8b-a6d9-4b53-b06f-1a5e34dc5066 tempest-VolumesTestJSON-1609307471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6348682a-e67b-4a6a-9a64-99fb374987ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:05:04 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-f0f5ee8b-a6d9-4b53-b06f-1a5e34dc5066 tempest-VolumesTestJSON-1609307471 None] Volume volume-6e4272f6-e89b-4acf-94e9-78086b6ed58d (6e4272f6-e89b-4acf-94e9-78086b6ed58d): created successfully Jul 10 10:05:04 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f0f5ee8b-a6d9-4b53-b06f-1a5e34dc5066 tempest-VolumesTestJSON-1609307471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6348682a-e67b-4a6a-9a64-99fb374987ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:05:04 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f0f5ee8b-a6d9-4b53-b06f-1a5e34dc5066 tempest-VolumesTestJSON-1609307471 None] Flow 'volume_create_manager' (06feefe2-b7f7-48e0-95a2-37ec6ffe7a69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:05:04 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-f0f5ee8b-a6d9-4b53-b06f-1a5e34dc5066 tempest-VolumesTestJSON-1609307471 None] Created volume successfully. Jul 10 10:05:06 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-38f20e6a-a21d-460c-b517-2933af7c9b21 tempest-VolumesTestJSON-1609307471 None] Acquiring lock "cinder-6e4272f6-e89b-4acf-94e9-78086b6ed58d-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:05:06 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-38f20e6a-a21d-460c-b517-2933af7c9b21 tempest-VolumesTestJSON-1609307471 None] Lock "cinder-6e4272f6-e89b-4acf-94e9-78086b6ed58d-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:05:07 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-38f20e6a-a21d-460c-b517-2933af7c9b21 tempest-VolumesTestJSON-1609307471 None] Acquiring lock "cinder-quobyte-6e4272f6-e89b-4acf-94e9-78086b6ed58d" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:05:07 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-38f20e6a-a21d-460c-b517-2933af7c9b21 tempest-VolumesTestJSON-1609307471 None] Lock "cinder-quobyte-6e4272f6-e89b-4acf-94e9-78086b6ed58d" acquired by "delete_volume" :: waited 0.020s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:05:07 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[78138671-242e-4380-b54d-ed402578e9d5]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:05:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-38f20e6a-a21d-460c-b517-2933af7c9b21 tempest-VolumesTestJSON-1609307471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-6e4272f6-e89b-4acf-94e9-78086b6ed58d {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:05:07 devstack sudo[90611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-6e4272f6-e89b-4acf-94e9-78086b6ed58d Jul 10 10:05:07 devstack sudo[90611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:05:07 devstack sudo[90611]: pam_unix(sudo:session): session closed for user root Jul 10 10:05:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-38f20e6a-a21d-460c-b517-2933af7c9b21 tempest-VolumesTestJSON-1609307471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-6e4272f6-e89b-4acf-94e9-78086b6ed58d" returned: 0 in 0.803s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:05:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-38f20e6a-a21d-460c-b517-2933af7c9b21 tempest-VolumesTestJSON-1609307471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-6e4272f6-e89b-4acf-94e9-78086b6ed58d {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:05:07 devstack sudo[90616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-6e4272f6-e89b-4acf-94e9-78086b6ed58d Jul 10 10:05:07 devstack sudo[90616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:05:08 devstack cinder-volume[87234]: INFO cinder.volume.manager [req-ae9f90e4-cc53-4cb7-85ca-1edd995f0dee req-22941456-d3a0-4eff-acf2-3d5033b53291 tempest-ServerActionsTestOtherA-825407832 None] Terminate volume connection completed successfully. Jul 10 10:05:08 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [req-ae9f90e4-cc53-4cb7-85ca-1edd995f0dee req-22941456-d3a0-4eff-acf2-3d5033b53291 tempest-ServerActionsTestOtherA-825407832 None] Deleting attachment c1694a58-7dd1-46c6-a7d9-6810afd5828c. {{(pid=87234) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 10:05:08 devstack sudo[90616]: pam_unix(sudo:session): session closed for user root Jul 10 10:05:08 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-38f20e6a-a21d-460c-b517-2933af7c9b21 tempest-VolumesTestJSON-1609307471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-6e4272f6-e89b-4acf-94e9-78086b6ed58d" returned: 0 in 0.770s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:05:08 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-38f20e6a-a21d-460c-b517-2933af7c9b21 tempest-VolumesTestJSON-1609307471 None] Lock "cinder-quobyte-6e4272f6-e89b-4acf-94e9-78086b6ed58d" released by "delete_volume" :: held 1.616s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:05:08 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-38f20e6a-a21d-460c-b517-2933af7c9b21 tempest-VolumesTestJSON-1609307471 None] Created reservations ['c54fe274-fb72-4f83-a004-792de39f68ba', '4700ea58-0077-4667-90f3-e65646a3b5b4', '5aa2cfa2-3d6d-4518-ac5f-eda5a7138e4d', 'bb4d5c71-c418-4932-970e-ff5acadfc64d'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:05:08 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-38f20e6a-a21d-460c-b517-2933af7c9b21 tempest-VolumesTestJSON-1609307471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:05:08 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-38f20e6a-a21d-460c-b517-2933af7c9b21 tempest-VolumesTestJSON-1609307471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:05:08 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-38f20e6a-a21d-460c-b517-2933af7c9b21 tempest-VolumesTestJSON-1609307471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:05:08 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-38f20e6a-a21d-460c-b517-2933af7c9b21 tempest-VolumesTestJSON-1609307471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:05:08 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-38f20e6a-a21d-460c-b517-2933af7c9b21 tempest-VolumesTestJSON-1609307471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:05:08 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-38f20e6a-a21d-460c-b517-2933af7c9b21 tempest-VolumesTestJSON-1609307471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:05:08 devstack sudo[90622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:05:08 devstack sudo[90622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:05:09 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-fa88e553-3a33-4378-9a02-7e9d0904d1dd tempest-VolumesTestJSON-1609307471 None] Acquiring lock "cinder-db9fc914-0bb6-42df-85ff-45ba6edb0f98-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:05:09 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-fa88e553-3a33-4378-9a02-7e9d0904d1dd tempest-VolumesTestJSON-1609307471 None] Lock "cinder-db9fc914-0bb6-42df-85ff-45ba6edb0f98-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:05:09 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-fa88e553-3a33-4378-9a02-7e9d0904d1dd tempest-VolumesTestJSON-1609307471 None] Acquiring lock "cinder-quobyte-db9fc914-0bb6-42df-85ff-45ba6edb0f98" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:05:09 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-fa88e553-3a33-4378-9a02-7e9d0904d1dd tempest-VolumesTestJSON-1609307471 None] Lock "cinder-quobyte-db9fc914-0bb6-42df-85ff-45ba6edb0f98" acquired by "delete_volume" :: waited 0.022s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:05:09 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a51b28-3303-4b23-b730-8a2513b9cf0f]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:05:09 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fa88e553-3a33-4378-9a02-7e9d0904d1dd tempest-VolumesTestJSON-1609307471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-db9fc914-0bb6-42df-85ff-45ba6edb0f98 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:05:09 devstack sudo[90631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-db9fc914-0bb6-42df-85ff-45ba6edb0f98 Jul 10 10:05:09 devstack sudo[90631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:05:09 devstack sudo[90622]: pam_unix(sudo:session): session closed for user root Jul 10 10:05:09 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-38f20e6a-a21d-460c-b517-2933af7c9b21 tempest-VolumesTestJSON-1609307471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.781s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:05:09 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-38f20e6a-a21d-460c-b517-2933af7c9b21 tempest-VolumesTestJSON-1609307471 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:05:09 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-38f20e6a-a21d-460c-b517-2933af7c9b21 tempest-VolumesTestJSON-1609307471 None] Deleted volume successfully. Jul 10 10:05:09 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-38f20e6a-a21d-460c-b517-2933af7c9b21 tempest-VolumesTestJSON-1609307471 None] Lock "cinder-6e4272f6-e89b-4acf-94e9-78086b6ed58d-delete_volume" released by "delete_volume" :: held 2.633s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:05:10 devstack sudo[90631]: pam_unix(sudo:session): session closed for user root Jul 10 10:05:10 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fa88e553-3a33-4378-9a02-7e9d0904d1dd tempest-VolumesTestJSON-1609307471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-db9fc914-0bb6-42df-85ff-45ba6edb0f98" returned: 0 in 0.814s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:05:10 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fa88e553-3a33-4378-9a02-7e9d0904d1dd tempest-VolumesTestJSON-1609307471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-db9fc914-0bb6-42df-85ff-45ba6edb0f98 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:05:10 devstack sudo[90637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-db9fc914-0bb6-42df-85ff-45ba6edb0f98 Jul 10 10:05:10 devstack sudo[90637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:05:11 devstack sudo[90637]: pam_unix(sudo:session): session closed for user root Jul 10 10:05:11 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fa88e553-3a33-4378-9a02-7e9d0904d1dd tempest-VolumesTestJSON-1609307471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-db9fc914-0bb6-42df-85ff-45ba6edb0f98" returned: 0 in 0.820s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:05:11 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-fa88e553-3a33-4378-9a02-7e9d0904d1dd tempest-VolumesTestJSON-1609307471 None] Lock "cinder-quobyte-db9fc914-0bb6-42df-85ff-45ba6edb0f98" released by "delete_volume" :: held 1.697s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:05:11 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-fa88e553-3a33-4378-9a02-7e9d0904d1dd tempest-VolumesTestJSON-1609307471 None] Created reservations ['889310f1-1cf0-4ef5-9204-74a271b53b6f', 'cad8def7-7c01-4ebe-bfc0-a2cd6b687e0f', 'f3c9e278-7af5-4e83-aedc-308476421541', '688f84e9-2f37-4848-a4d3-f919d7edb8c0'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:05:11 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-fa88e553-3a33-4378-9a02-7e9d0904d1dd tempest-VolumesTestJSON-1609307471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:05:11 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-fa88e553-3a33-4378-9a02-7e9d0904d1dd tempest-VolumesTestJSON-1609307471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:05:11 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-fa88e553-3a33-4378-9a02-7e9d0904d1dd tempest-VolumesTestJSON-1609307471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:05:11 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-fa88e553-3a33-4378-9a02-7e9d0904d1dd tempest-VolumesTestJSON-1609307471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:05:11 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-fa88e553-3a33-4378-9a02-7e9d0904d1dd tempest-VolumesTestJSON-1609307471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:05:11 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fa88e553-3a33-4378-9a02-7e9d0904d1dd tempest-VolumesTestJSON-1609307471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:05:11 devstack sudo[90641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:05:11 devstack sudo[90641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:05:11 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-2d5ea8f9-6531-487d-b0b4-37a0f886df08 tempest-VolumesTestJSON-1609307471 None] Acquiring lock "cinder-442db2d9-6d6b-4fd1-b618-978448a28bb8-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:05:11 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-2d5ea8f9-6531-487d-b0b4-37a0f886df08 tempest-VolumesTestJSON-1609307471 None] Lock "cinder-442db2d9-6d6b-4fd1-b618-978448a28bb8-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:05:11 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-2d5ea8f9-6531-487d-b0b4-37a0f886df08 tempest-VolumesTestJSON-1609307471 None] Acquiring lock "cinder-quobyte-442db2d9-6d6b-4fd1-b618-978448a28bb8" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:05:11 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-2d5ea8f9-6531-487d-b0b4-37a0f886df08 tempest-VolumesTestJSON-1609307471 None] Lock "cinder-quobyte-442db2d9-6d6b-4fd1-b618-978448a28bb8" acquired by "delete_volume" :: waited 0.017s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:05:11 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aeb63d7-6bd8-4711-8f65-d471e5ec3332]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:05:11 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-2d5ea8f9-6531-487d-b0b4-37a0f886df08 tempest-VolumesTestJSON-1609307471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-442db2d9-6d6b-4fd1-b618-978448a28bb8 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:05:11 devstack sudo[90643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-442db2d9-6d6b-4fd1-b618-978448a28bb8 Jul 10 10:05:11 devstack sudo[90643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:05:12 devstack sudo[90641]: pam_unix(sudo:session): session closed for user root Jul 10 10:05:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fa88e553-3a33-4378-9a02-7e9d0904d1dd tempest-VolumesTestJSON-1609307471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 1.025s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:05:12 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-fa88e553-3a33-4378-9a02-7e9d0904d1dd tempest-VolumesTestJSON-1609307471 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:05:12 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-fa88e553-3a33-4378-9a02-7e9d0904d1dd tempest-VolumesTestJSON-1609307471 None] Deleted volume successfully. Jul 10 10:05:12 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-fa88e553-3a33-4378-9a02-7e9d0904d1dd tempest-VolumesTestJSON-1609307471 None] Lock "cinder-db9fc914-0bb6-42df-85ff-45ba6edb0f98-delete_volume" released by "delete_volume" :: held 3.110s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:05:12 devstack sudo[90643]: pam_unix(sudo:session): session closed for user root Jul 10 10:05:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-2d5ea8f9-6531-487d-b0b4-37a0f886df08 tempest-VolumesTestJSON-1609307471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-442db2d9-6d6b-4fd1-b618-978448a28bb8" returned: 0 in 1.247s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:05:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-2d5ea8f9-6531-487d-b0b4-37a0f886df08 tempest-VolumesTestJSON-1609307471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-442db2d9-6d6b-4fd1-b618-978448a28bb8 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:05:12 devstack sudo[90668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-442db2d9-6d6b-4fd1-b618-978448a28bb8 Jul 10 10:05:12 devstack sudo[90668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:05:13 devstack sudo[90668]: pam_unix(sudo:session): session closed for user root Jul 10 10:05:13 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-2d5ea8f9-6531-487d-b0b4-37a0f886df08 tempest-VolumesTestJSON-1609307471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-442db2d9-6d6b-4fd1-b618-978448a28bb8" returned: 0 in 0.852s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:05:13 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-2d5ea8f9-6531-487d-b0b4-37a0f886df08 tempest-VolumesTestJSON-1609307471 None] Lock "cinder-quobyte-442db2d9-6d6b-4fd1-b618-978448a28bb8" released by "delete_volume" :: held 2.172s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:05:13 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-2d5ea8f9-6531-487d-b0b4-37a0f886df08 tempest-VolumesTestJSON-1609307471 None] Created reservations ['9bcb105c-e2ad-4701-9c27-6dc6117b4a49', '6edfa883-4b5c-4125-83ae-eddecd96d8d6', 'ce2e35f0-0423-4e89-a034-5abdb4401b03', '9aaa3666-72c3-4548-8a33-9ac598e423da'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:05:14 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-2d5ea8f9-6531-487d-b0b4-37a0f886df08 tempest-VolumesTestJSON-1609307471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:05:14 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-2d5ea8f9-6531-487d-b0b4-37a0f886df08 tempest-VolumesTestJSON-1609307471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:05:14 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-2d5ea8f9-6531-487d-b0b4-37a0f886df08 tempest-VolumesTestJSON-1609307471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:05:14 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-2d5ea8f9-6531-487d-b0b4-37a0f886df08 tempest-VolumesTestJSON-1609307471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:05:14 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-2d5ea8f9-6531-487d-b0b4-37a0f886df08 tempest-VolumesTestJSON-1609307471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:05:14 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-2d5ea8f9-6531-487d-b0b4-37a0f886df08 tempest-VolumesTestJSON-1609307471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:05:14 devstack sudo[90694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:05:14 devstack sudo[90694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:05:14 devstack sudo[90694]: pam_unix(sudo:session): session closed for user root Jul 10 10:05:14 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-2d5ea8f9-6531-487d-b0b4-37a0f886df08 tempest-VolumesTestJSON-1609307471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.751s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:05:14 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-2d5ea8f9-6531-487d-b0b4-37a0f886df08 tempest-VolumesTestJSON-1609307471 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:05:14 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-2d5ea8f9-6531-487d-b0b4-37a0f886df08 tempest-VolumesTestJSON-1609307471 None] Deleted volume successfully. Jul 10 10:05:14 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-2d5ea8f9-6531-487d-b0b4-37a0f886df08 tempest-VolumesTestJSON-1609307471 None] Lock "cinder-442db2d9-6d6b-4fd1-b618-978448a28bb8-delete_volume" released by "delete_volume" :: held 3.288s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:05:21 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-3304ef23-52f0-4f07-b80b-6f5a254e42e4 tempest-ServerActionsTestOtherA-825407832 None] Acquiring lock "cinder-23cad8a8-d6c3-4651-b661-7e29c56594e7-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:05:21 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-3304ef23-52f0-4f07-b80b-6f5a254e42e4 tempest-ServerActionsTestOtherA-825407832 None] Lock "cinder-23cad8a8-d6c3-4651-b661-7e29c56594e7-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:05:21 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-3304ef23-52f0-4f07-b80b-6f5a254e42e4 tempest-ServerActionsTestOtherA-825407832 None] Acquiring lock "cinder-quobyte-23cad8a8-d6c3-4651-b661-7e29c56594e7" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:05:21 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-3304ef23-52f0-4f07-b80b-6f5a254e42e4 tempest-ServerActionsTestOtherA-825407832 None] Lock "cinder-quobyte-23cad8a8-d6c3-4651-b661-7e29c56594e7" acquired by "delete_volume" :: waited 0.029s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:05:22 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c8a3fd-2eaa-4805-a738-12ae5b1d2f81]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:05:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3304ef23-52f0-4f07-b80b-6f5a254e42e4 tempest-ServerActionsTestOtherA-825407832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-23cad8a8-d6c3-4651-b661-7e29c56594e7 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:05:22 devstack sudo[90795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-23cad8a8-d6c3-4651-b661-7e29c56594e7 Jul 10 10:05:22 devstack sudo[90795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:05:23 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-e11ef1e3-22fb-4c8b-8c38-780508846cb7 tempest-DeleteServersTestJSON-351982828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:05:23 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-e11ef1e3-22fb-4c8b-8c38-780508846cb7 tempest-DeleteServersTestJSON-351982828 None] Flow 'volume_create_manager' (ee28fb7e-2035-4157-ad13-bae7a5ad2410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:05:23 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-e11ef1e3-22fb-4c8b-8c38-780508846cb7 tempest-DeleteServersTestJSON-351982828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20857c78-8914-4469-b556-095ae22ccdb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:05:23 devstack sudo[90795]: pam_unix(sudo:session): session closed for user root Jul 10 10:05:23 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3304ef23-52f0-4f07-b80b-6f5a254e42e4 tempest-ServerActionsTestOtherA-825407832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-23cad8a8-d6c3-4651-b661-7e29c56594e7" returned: 0 in 1.285s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:05:23 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3304ef23-52f0-4f07-b80b-6f5a254e42e4 tempest-ServerActionsTestOtherA-825407832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-23cad8a8-d6c3-4651-b661-7e29c56594e7 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:05:23 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-e11ef1e3-22fb-4c8b-8c38-780508846cb7 tempest-DeleteServersTestJSON-351982828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20857c78-8914-4469-b556-095ae22ccdb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:05:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-688110019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d450c457-09e5-43a3-8081-74725cc4a030,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab6e4b6cbfdc45d09c1cb1bc380fce83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:05:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:05:23Z,use_quota=True,user_id='44bf5efac99a43e99f0d6c3d36619e44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:05:23 devstack sudo[90802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-23cad8a8-d6c3-4651-b661-7e29c56594e7 Jul 10 10:05:23 devstack sudo[90802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:05:23 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-e11ef1e3-22fb-4c8b-8c38-780508846cb7 tempest-DeleteServersTestJSON-351982828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c31336f5-9674-4236-8363-2c4f1e23c530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:05:23 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-e11ef1e3-22fb-4c8b-8c38-780508846cb7 tempest-DeleteServersTestJSON-351982828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c31336f5-9674-4236-8363-2c4f1e23c530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:05:23 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-e11ef1e3-22fb-4c8b-8c38-780508846cb7 tempest-DeleteServersTestJSON-351982828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c78b8571-ee16-44b5-91ea-ee1497dd4873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:05:23 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-e11ef1e3-22fb-4c8b-8c38-780508846cb7 tempest-DeleteServersTestJSON-351982828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c78b8571-ee16-44b5-91ea-ee1497dd4873) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd450c457-09e5-43a3-8081-74725cc4a030', 'volume_name': 'volume-d450c457-09e5-43a3-8081-74725cc4a030', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:05:23 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-e11ef1e3-22fb-4c8b-8c38-780508846cb7 tempest-DeleteServersTestJSON-351982828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93677841-03a6-4636-ad1d-2d7087f04530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:05:23 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-e11ef1e3-22fb-4c8b-8c38-780508846cb7 tempest-DeleteServersTestJSON-351982828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93677841-03a6-4636-ad1d-2d7087f04530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:05:23 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-e11ef1e3-22fb-4c8b-8c38-780508846cb7 tempest-DeleteServersTestJSON-351982828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45ad9f76-3a8a-4d97-b888-34e1f806ce85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:05:23 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-e11ef1e3-22fb-4c8b-8c38-780508846cb7 tempest-DeleteServersTestJSON-351982828 None] Volume d450c457-09e5-43a3-8081-74725cc4a030: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d450c457-09e5-43a3-8081-74725cc4a030', 'volume_size': 1} Jul 10 10:05:23 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-e11ef1e3-22fb-4c8b-8c38-780508846cb7 tempest-DeleteServersTestJSON-351982828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:05:23 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-e11ef1e3-22fb-4c8b-8c38-780508846cb7 tempest-DeleteServersTestJSON-351982828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:05:23 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-e11ef1e3-22fb-4c8b-8c38-780508846cb7 tempest-DeleteServersTestJSON-351982828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:05:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-688110019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d450c457-09e5-43a3-8081-74725cc4a030,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab6e4b6cbfdc45d09c1cb1bc380fce83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:05:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:05:23Z,use_quota=True,user_id='44bf5efac99a43e99f0d6c3d36619e44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:05:23 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-e11ef1e3-22fb-4c8b-8c38-780508846cb7 tempest-DeleteServersTestJSON-351982828 None] Creating volume d450c457-09e5-43a3-8081-74725cc4a030 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:05:23 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-e11ef1e3-22fb-4c8b-8c38-780508846cb7 tempest-DeleteServersTestJSON-351982828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:05:23 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-e11ef1e3-22fb-4c8b-8c38-780508846cb7 tempest-DeleteServersTestJSON-351982828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:05:23 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-e11ef1e3-22fb-4c8b-8c38-780508846cb7 tempest-DeleteServersTestJSON-351982828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:05:23 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-e11ef1e3-22fb-4c8b-8c38-780508846cb7 tempest-DeleteServersTestJSON-351982828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:05:23 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-e11ef1e3-22fb-4c8b-8c38-780508846cb7 tempest-DeleteServersTestJSON-351982828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:05:23 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-e11ef1e3-22fb-4c8b-8c38-780508846cb7 tempest-DeleteServersTestJSON-351982828 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:05:23 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-e11ef1e3-22fb-4c8b-8c38-780508846cb7 tempest-DeleteServersTestJSON-351982828 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:05:23 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e11ef1e3-22fb-4c8b-8c38-780508846cb7 tempest-DeleteServersTestJSON-351982828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d450c457-09e5-43a3-8081-74725cc4a030 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:05:23 devstack sudo[90804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d450c457-09e5-43a3-8081-74725cc4a030 1073741824 Jul 10 10:05:23 devstack sudo[90804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:05:23 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [req-7964a76d-cf9f-4e84-abb3-0a028898183d req-5b04c617-eb44-4beb-b526-251e153cf328 tempest-AttachVolumeShelveTestJSON-932158510 None] No connector for attachment 142ff17f-de51-4a68-86e4-02636db3d5ba; skipping storage backend terminate_connection call. {{(pid=87234) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 10 10:05:23 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [req-7964a76d-cf9f-4e84-abb3-0a028898183d req-5b04c617-eb44-4beb-b526-251e153cf328 tempest-AttachVolumeShelveTestJSON-932158510 None] Deleting attachment 142ff17f-de51-4a68-86e4-02636db3d5ba. {{(pid=87234) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 10:05:24 devstack sudo[90802]: pam_unix(sudo:session): session closed for user root Jul 10 10:05:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3304ef23-52f0-4f07-b80b-6f5a254e42e4 tempest-ServerActionsTestOtherA-825407832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-23cad8a8-d6c3-4651-b661-7e29c56594e7" returned: 0 in 1.080s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:05:24 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-3304ef23-52f0-4f07-b80b-6f5a254e42e4 tempest-ServerActionsTestOtherA-825407832 None] Lock "cinder-quobyte-23cad8a8-d6c3-4651-b661-7e29c56594e7" released by "delete_volume" :: held 2.443s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:05:24 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-3304ef23-52f0-4f07-b80b-6f5a254e42e4 tempest-ServerActionsTestOtherA-825407832 None] Created reservations ['f6010332-9140-4881-9570-a9635e1741ef', '2213f05d-cd82-4c47-8458-5fd864e0da35', '71b210c0-0bc7-433c-97ff-d9e9983c11d5', '3cb28bdf-235f-4fa9-9c43-a1c7ba702897'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:05:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-3304ef23-52f0-4f07-b80b-6f5a254e42e4 tempest-ServerActionsTestOtherA-825407832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:05:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-3304ef23-52f0-4f07-b80b-6f5a254e42e4 tempest-ServerActionsTestOtherA-825407832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:05:24 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-3304ef23-52f0-4f07-b80b-6f5a254e42e4 tempest-ServerActionsTestOtherA-825407832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:05:24 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-3304ef23-52f0-4f07-b80b-6f5a254e42e4 tempest-ServerActionsTestOtherA-825407832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:05:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-3304ef23-52f0-4f07-b80b-6f5a254e42e4 tempest-ServerActionsTestOtherA-825407832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:05:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3304ef23-52f0-4f07-b80b-6f5a254e42e4 tempest-ServerActionsTestOtherA-825407832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:05:24 devstack sudo[90811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:05:24 devstack sudo[90811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:05:25 devstack sudo[90804]: pam_unix(sudo:session): session closed for user root Jul 10 10:05:25 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e11ef1e3-22fb-4c8b-8c38-780508846cb7 tempest-DeleteServersTestJSON-351982828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d450c457-09e5-43a3-8081-74725cc4a030 1073741824" returned: 0 in 1.598s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:05:25 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e11ef1e3-22fb-4c8b-8c38-780508846cb7 tempest-DeleteServersTestJSON-351982828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d450c457-09e5-43a3-8081-74725cc4a030 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:05:25 devstack sudo[90813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d450c457-09e5-43a3-8081-74725cc4a030 Jul 10 10:05:25 devstack sudo[90813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:05:25 devstack sudo[90811]: pam_unix(sudo:session): session closed for user root Jul 10 10:05:25 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3304ef23-52f0-4f07-b80b-6f5a254e42e4 tempest-ServerActionsTestOtherA-825407832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 1.067s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:05:25 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-3304ef23-52f0-4f07-b80b-6f5a254e42e4 tempest-ServerActionsTestOtherA-825407832 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:05:25 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-3304ef23-52f0-4f07-b80b-6f5a254e42e4 tempest-ServerActionsTestOtherA-825407832 None] Deleted volume successfully. Jul 10 10:05:25 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-3304ef23-52f0-4f07-b80b-6f5a254e42e4 tempest-ServerActionsTestOtherA-825407832 None] Lock "cinder-23cad8a8-d6c3-4651-b661-7e29c56594e7-delete_volume" released by "delete_volume" :: held 3.964s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:05:26 devstack sudo[90813]: pam_unix(sudo:session): session closed for user root Jul 10 10:05:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e11ef1e3-22fb-4c8b-8c38-780508846cb7 tempest-DeleteServersTestJSON-351982828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d450c457-09e5-43a3-8081-74725cc4a030" returned: 0 in 1.208s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:05:26 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-e11ef1e3-22fb-4c8b-8c38-780508846cb7 tempest-DeleteServersTestJSON-351982828 None] <== create_volume: return (2886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:05:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-e11ef1e3-22fb-4c8b-8c38-780508846cb7 tempest-DeleteServersTestJSON-351982828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.889s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:05:26 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-e11ef1e3-22fb-4c8b-8c38-780508846cb7 tempest-DeleteServersTestJSON-351982828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45ad9f76-3a8a-4d97-b888-34e1f806ce85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d450c457-09e5-43a3-8081-74725cc4a030', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:05:26 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-e11ef1e3-22fb-4c8b-8c38-780508846cb7 tempest-DeleteServersTestJSON-351982828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6f5122d-c3e5-47b3-9824-f7abeba7a5b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:05:26 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-e11ef1e3-22fb-4c8b-8c38-780508846cb7 tempest-DeleteServersTestJSON-351982828 None] Volume volume-d450c457-09e5-43a3-8081-74725cc4a030 (d450c457-09e5-43a3-8081-74725cc4a030): created successfully Jul 10 10:05:26 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-e11ef1e3-22fb-4c8b-8c38-780508846cb7 tempest-DeleteServersTestJSON-351982828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6f5122d-c3e5-47b3-9824-f7abeba7a5b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:05:26 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-e11ef1e3-22fb-4c8b-8c38-780508846cb7 tempest-DeleteServersTestJSON-351982828 None] Flow 'volume_create_manager' (ee28fb7e-2035-4157-ad13-bae7a5ad2410) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:05:26 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-e11ef1e3-22fb-4c8b-8c38-780508846cb7 tempest-DeleteServersTestJSON-351982828 None] Created volume successfully. Jul 10 10:05:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-cefed49c-fc84-443e-b6d4-00e4e6eadead req-2cad2772-bb83-49af-915d-79f7add12202 tempest-DeleteServersTestJSON-351982828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:05:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-cefed49c-fc84-443e-b6d4-00e4e6eadead req-2cad2772-bb83-49af-915d-79f7add12202 tempest-DeleteServersTestJSON-351982828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:05:30 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8776e52-3f09-4a6f-8175-d9614ee4dde5]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:05:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-cefed49c-fc84-443e-b6d4-00e4e6eadead req-2cad2772-bb83-49af-915d-79f7add12202 tempest-DeleteServersTestJSON-351982828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d450c457-09e5-43a3-8081-74725cc4a030 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:05:31 devstack sudo[90870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d450c457-09e5-43a3-8081-74725cc4a030 Jul 10 10:05:31 devstack sudo[90870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:05:32 devstack sudo[90870]: pam_unix(sudo:session): session closed for user root Jul 10 10:05:32 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-cefed49c-fc84-443e-b6d4-00e4e6eadead req-2cad2772-bb83-49af-915d-79f7add12202 tempest-DeleteServersTestJSON-351982828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d450c457-09e5-43a3-8081-74725cc4a030" returned: 0 in 1.078s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:05:32 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-cefed49c-fc84-443e-b6d4-00e4e6eadead req-2cad2772-bb83-49af-915d-79f7add12202 tempest-DeleteServersTestJSON-351982828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.102s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:05:32 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [req-cefed49c-fc84-443e-b6d4-00e4e6eadead req-2cad2772-bb83-49af-915d-79f7add12202 tempest-DeleteServersTestJSON-351982828 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091', 'name': 'volume-d450c457-09e5-43a3-8081-74725cc4a030', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5654e9c1-cb2f-4428-8e70-ff46bf19bf55', 'enforce_multipath': True} {{(pid=87234) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 10:05:32 devstack cinder-volume[87234]: INFO cinder.volume.manager [req-cefed49c-fc84-443e-b6d4-00e4e6eadead req-2cad2772-bb83-49af-915d-79f7add12202 tempest-DeleteServersTestJSON-351982828 None] attachment_update completed successfully. Jul 10 10:05:33 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-eaedc48e-9cec-437b-8b37-d830ef989fe4 tempest-GroupsV314Test-667406949 None] Group tempest-GroupsV314Test-Group-561198288: creating Jul 10 10:05:33 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-eaedc48e-9cec-437b-8b37-d830ef989fe4 tempest-GroupsV314Test-667406949 None] Group tempest-GroupsV314Test-Group-561198288: created successfully Jul 10 10:05:33 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-eaedc48e-9cec-437b-8b37-d830ef989fe4 tempest-GroupsV314Test-667406949 None] Create group completed successfully. Jul 10 10:05:35 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd7565fe-33db-480e-8e67-17f17b684187 tempest-GroupsV314Test-667406949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:05:35 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-dd7565fe-33db-480e-8e67-17f17b684187 tempest-GroupsV314Test-667406949 None] Flow 'volume_create_manager' (db74cc9b-85e0-4574-ac23-efa7b566bc94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:05:35 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-dd7565fe-33db-480e-8e67-17f17b684187 tempest-GroupsV314Test-667406949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (661a2d13-025d-429f-a165-f681a0b77015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:05:35 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-dd7565fe-33db-480e-8e67-17f17b684187 tempest-GroupsV314Test-667406949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (661a2d13-025d-429f-a165-f681a0b77015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:05:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1922469601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0b3cddfc-18b0-4359-b39a-3d49beb2e90b,host='devstack@QuobyteHD#QuobyteHD',id=d0f18e84-2801-4a28-af75-2919488621d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4a0456d8ab54c62b86498e80d3b7efb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:05:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:05:35Z,use_quota=True,user_id='f8df08c2df964f1eae2ad71ac7b63ffa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1774306e-f4b2-4e4f-a78a-59f1d0c585ea),volume_type_id=1774306e-f4b2-4e4f-a78a-59f1d0c585ea)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:05:35 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-dd7565fe-33db-480e-8e67-17f17b684187 tempest-GroupsV314Test-667406949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aeb33363-07de-4c80-afba-d5fc539060ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:05:35 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-dd7565fe-33db-480e-8e67-17f17b684187 tempest-GroupsV314Test-667406949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aeb33363-07de-4c80-afba-d5fc539060ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:05:35 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-dd7565fe-33db-480e-8e67-17f17b684187 tempest-GroupsV314Test-667406949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db53173c-99d4-4870-9334-5089fd4b59f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:05:35 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-dd7565fe-33db-480e-8e67-17f17b684187 tempest-GroupsV314Test-667406949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db53173c-99d4-4870-9334-5089fd4b59f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0f18e84-2801-4a28-af75-2919488621d9', 'volume_name': 'volume-d0f18e84-2801-4a28-af75-2919488621d9', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:05:35 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-dd7565fe-33db-480e-8e67-17f17b684187 tempest-GroupsV314Test-667406949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61de48f7-a4b7-4632-ada7-34e548e4d11b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:05:35 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-dd7565fe-33db-480e-8e67-17f17b684187 tempest-GroupsV314Test-667406949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61de48f7-a4b7-4632-ada7-34e548e4d11b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:05:35 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-dd7565fe-33db-480e-8e67-17f17b684187 tempest-GroupsV314Test-667406949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49ff38ad-d77f-4350-9bdb-1ef8cd438832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:05:35 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-dd7565fe-33db-480e-8e67-17f17b684187 tempest-GroupsV314Test-667406949 None] Volume d0f18e84-2801-4a28-af75-2919488621d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0f18e84-2801-4a28-af75-2919488621d9', 'volume_size': 1} Jul 10 10:05:35 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-dd7565fe-33db-480e-8e67-17f17b684187 tempest-GroupsV314Test-667406949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:05:35 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-dd7565fe-33db-480e-8e67-17f17b684187 tempest-GroupsV314Test-667406949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:05:35 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-dd7565fe-33db-480e-8e67-17f17b684187 tempest-GroupsV314Test-667406949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0b3cddfc-18b0-4359-b39a-3d49beb2e90b,created_at=2026-07-10T08:05:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1922469601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0b3cddfc-18b0-4359-b39a-3d49beb2e90b,host='devstack@QuobyteHD#QuobyteHD',id=d0f18e84-2801-4a28-af75-2919488621d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4a0456d8ab54c62b86498e80d3b7efb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:05:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:05:35Z,use_quota=True,user_id='f8df08c2df964f1eae2ad71ac7b63ffa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1774306e-f4b2-4e4f-a78a-59f1d0c585ea),volume_type_id=1774306e-f4b2-4e4f-a78a-59f1d0c585ea)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:05:35 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-dd7565fe-33db-480e-8e67-17f17b684187 tempest-GroupsV314Test-667406949 None] Creating volume d0f18e84-2801-4a28-af75-2919488621d9 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:05:35 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-dd7565fe-33db-480e-8e67-17f17b684187 tempest-GroupsV314Test-667406949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:05:35 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-dd7565fe-33db-480e-8e67-17f17b684187 tempest-GroupsV314Test-667406949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:05:35 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-dd7565fe-33db-480e-8e67-17f17b684187 tempest-GroupsV314Test-667406949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:05:35 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-dd7565fe-33db-480e-8e67-17f17b684187 tempest-GroupsV314Test-667406949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:05:35 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-dd7565fe-33db-480e-8e67-17f17b684187 tempest-GroupsV314Test-667406949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:05:35 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-dd7565fe-33db-480e-8e67-17f17b684187 tempest-GroupsV314Test-667406949 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:05:35 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-dd7565fe-33db-480e-8e67-17f17b684187 tempest-GroupsV314Test-667406949 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:05:35 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-dd7565fe-33db-480e-8e67-17f17b684187 tempest-GroupsV314Test-667406949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d0f18e84-2801-4a28-af75-2919488621d9 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:05:35 devstack sudo[91274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d0f18e84-2801-4a28-af75-2919488621d9 1073741824 Jul 10 10:05:35 devstack sudo[91274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:05:36 devstack sudo[91274]: pam_unix(sudo:session): session closed for user root Jul 10 10:05:36 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-dd7565fe-33db-480e-8e67-17f17b684187 tempest-GroupsV314Test-667406949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d0f18e84-2801-4a28-af75-2919488621d9 1073741824" returned: 0 in 1.000s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:05:36 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-dd7565fe-33db-480e-8e67-17f17b684187 tempest-GroupsV314Test-667406949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d0f18e84-2801-4a28-af75-2919488621d9 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:05:36 devstack sudo[91281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d0f18e84-2801-4a28-af75-2919488621d9 Jul 10 10:05:36 devstack sudo[91281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:05:37 devstack sudo[91281]: pam_unix(sudo:session): session closed for user root Jul 10 10:05:37 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-dd7565fe-33db-480e-8e67-17f17b684187 tempest-GroupsV314Test-667406949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d0f18e84-2801-4a28-af75-2919488621d9" returned: 0 in 0.859s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:05:37 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-dd7565fe-33db-480e-8e67-17f17b684187 tempest-GroupsV314Test-667406949 None] <== create_volume: return (1943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:05:37 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-dd7565fe-33db-480e-8e67-17f17b684187 tempest-GroupsV314Test-667406949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.945s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:05:37 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-dd7565fe-33db-480e-8e67-17f17b684187 tempest-GroupsV314Test-667406949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49ff38ad-d77f-4350-9bdb-1ef8cd438832) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0f18e84-2801-4a28-af75-2919488621d9', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:05:37 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-dd7565fe-33db-480e-8e67-17f17b684187 tempest-GroupsV314Test-667406949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91b06cc8-2da0-4dac-8ccf-65853587688b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:05:37 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-dd7565fe-33db-480e-8e67-17f17b684187 tempest-GroupsV314Test-667406949 None] Volume volume-d0f18e84-2801-4a28-af75-2919488621d9 (d0f18e84-2801-4a28-af75-2919488621d9): created successfully Jul 10 10:05:37 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-dd7565fe-33db-480e-8e67-17f17b684187 tempest-GroupsV314Test-667406949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91b06cc8-2da0-4dac-8ccf-65853587688b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:05:37 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-dd7565fe-33db-480e-8e67-17f17b684187 tempest-GroupsV314Test-667406949 None] Flow 'volume_create_manager' (db74cc9b-85e0-4574-ac23-efa7b566bc94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:05:37 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-dd7565fe-33db-480e-8e67-17f17b684187 tempest-GroupsV314Test-667406949 None] Created volume successfully. Jul 10 10:05:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-cdbd30a3-aca4-42ff-ba26-70d3c770a249 tempest-GroupsV314Test-667406949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:05:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-cdbd30a3-aca4-42ff-ba26-70d3c770a249 tempest-GroupsV314Test-667406949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:05:38 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-cdbd30a3-aca4-42ff-ba26-70d3c770a249 tempest-GroupsV314Test-667406949 None] Cloning volume d0f18e84-2801-4a28-af75-2919488621d9 to volume b187e0cf-2a43-4809-a1e6-c7ec756b18b5 Jul 10 10:05:39 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-cdbd30a3-aca4-42ff-ba26-70d3c770a249 tempest-GroupsV314Test-667406949 None] Creating offline snapshot 52141ede-62c2-4769-8da5-7b385cb87388 of volume d0f18e84-2801-4a28-af75-2919488621d9 {{(pid=87234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 10:05:39 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d0441b8-e16c-4e55-876e-c02b21f9455f]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:05:39 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-cdbd30a3-aca4-42ff-ba26-70d3c770a249 tempest-GroupsV314Test-667406949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d0f18e84-2801-4a28-af75-2919488621d9 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:05:39 devstack sudo[91318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d0f18e84-2801-4a28-af75-2919488621d9 Jul 10 10:05:39 devstack sudo[91318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:05:40 devstack sudo[91318]: pam_unix(sudo:session): session closed for user root Jul 10 10:05:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-cdbd30a3-aca4-42ff-ba26-70d3c770a249 tempest-GroupsV314Test-667406949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d0f18e84-2801-4a28-af75-2919488621d9" returned: 0 in 1.199s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:05:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-cdbd30a3-aca4-42ff-ba26-70d3c770a249 tempest-GroupsV314Test-667406949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d0f18e84-2801-4a28-af75-2919488621d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d0f18e84-2801-4a28-af75-2919488621d9.52141ede-62c2-4769-8da5-7b385cb87388 1G {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:05:40 devstack sudo[91375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d0f18e84-2801-4a28-af75-2919488621d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d0f18e84-2801-4a28-af75-2919488621d9.52141ede-62c2-4769-8da5-7b385cb87388 1G Jul 10 10:05:40 devstack sudo[91375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:05:41 devstack sudo[91375]: pam_unix(sudo:session): session closed for user root Jul 10 10:05:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-cdbd30a3-aca4-42ff-ba26-70d3c770a249 tempest-GroupsV314Test-667406949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d0f18e84-2801-4a28-af75-2919488621d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d0f18e84-2801-4a28-af75-2919488621d9.52141ede-62c2-4769-8da5-7b385cb87388 1G" returned: 0 in 1.378s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:05:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-cdbd30a3-aca4-42ff-ba26-70d3c770a249 tempest-GroupsV314Test-667406949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0f18e84-2801-4a28-af75-2919488621d9 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d0f18e84-2801-4a28-af75-2919488621d9.52141ede-62c2-4769-8da5-7b385cb87388 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:05:41 devstack sudo[91386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0f18e84-2801-4a28-af75-2919488621d9 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d0f18e84-2801-4a28-af75-2919488621d9.52141ede-62c2-4769-8da5-7b385cb87388 Jul 10 10:05:41 devstack sudo[91386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:05:41 devstack cinder-volume[87234]: INFO cinder.volume.manager [req-a91aa190-e75a-462a-84d0-0cf1d7707e07 req-0a31b15a-3082-45a8-b987-28724a3d8658 tempest-DeleteServersTestJSON-351982828 None] Terminate volume connection completed successfully. Jul 10 10:05:41 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [req-a91aa190-e75a-462a-84d0-0cf1d7707e07 req-0a31b15a-3082-45a8-b987-28724a3d8658 tempest-DeleteServersTestJSON-351982828 None] Deleting attachment 5654e9c1-cb2f-4428-8e70-ff46bf19bf55. {{(pid=87234) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 10:05:42 devstack cinder-volume[87234]: DEBUG oslo_service.periodic_task [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 10:05:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:05:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:05:42 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:05:42 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:05:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:05:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:05:42 devstack sudo[91389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:05:42 devstack sudo[91389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:05:42 devstack sudo[91386]: pam_unix(sudo:session): session closed for user root Jul 10 10:05:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-cdbd30a3-aca4-42ff-ba26-70d3c770a249 tempest-GroupsV314Test-667406949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0f18e84-2801-4a28-af75-2919488621d9 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d0f18e84-2801-4a28-af75-2919488621d9.52141ede-62c2-4769-8da5-7b385cb87388" returned: 0 in 0.965s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:05:42 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-cdbd30a3-aca4-42ff-ba26-70d3c770a249 tempest-GroupsV314Test-667406949 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d0f18e84-2801-4a28-af75-2919488621d9.52141ede-62c2-4769-8da5-7b385cb87388 is being set with open permissions: ugo+rw: NotImplementedError Jul 10 10:05:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-cdbd30a3-aca4-42ff-ba26-70d3c770a249 tempest-GroupsV314Test-667406949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d0f18e84-2801-4a28-af75-2919488621d9.52141ede-62c2-4769-8da5-7b385cb87388 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:05:42 devstack sudo[91395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d0f18e84-2801-4a28-af75-2919488621d9.52141ede-62c2-4769-8da5-7b385cb87388 Jul 10 10:05:42 devstack sudo[91395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:05:42 devstack sudo[91389]: pam_unix(sudo:session): session closed for user root Jul 10 10:05:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.850s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:05:42 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:05:43 devstack sudo[91395]: pam_unix(sudo:session): session closed for user root Jul 10 10:05:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-cdbd30a3-aca4-42ff-ba26-70d3c770a249 tempest-GroupsV314Test-667406949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d0f18e84-2801-4a28-af75-2919488621d9.52141ede-62c2-4769-8da5-7b385cb87388" returned: 0 in 0.716s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:05:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-cdbd30a3-aca4-42ff-ba26-70d3c770a249 tempest-GroupsV314Test-667406949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d0f18e84-2801-4a28-af75-2919488621d9.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:05:43 devstack sudo[91399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d0f18e84-2801-4a28-af75-2919488621d9.info Jul 10 10:05:43 devstack sudo[91399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:05:44 devstack sudo[91399]: pam_unix(sudo:session): session closed for user root Jul 10 10:05:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-cdbd30a3-aca4-42ff-ba26-70d3c770a249 tempest-GroupsV314Test-667406949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d0f18e84-2801-4a28-af75-2919488621d9.info" returned: 0 in 1.027s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:05:44 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-cdbd30a3-aca4-42ff-ba26-70d3c770a249 tempest-GroupsV314Test-667406949 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d0f18e84-2801-4a28-af75-2919488621d9.info is being set with open permissions: ugo+rw: NotImplementedError Jul 10 10:05:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-cdbd30a3-aca4-42ff-ba26-70d3c770a249 tempest-GroupsV314Test-667406949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d0f18e84-2801-4a28-af75-2919488621d9.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:05:44 devstack sudo[91444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d0f18e84-2801-4a28-af75-2919488621d9.info Jul 10 10:05:44 devstack sudo[91444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:05:45 devstack sudo[91444]: pam_unix(sudo:session): session closed for user root Jul 10 10:05:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-cdbd30a3-aca4-42ff-ba26-70d3c770a249 tempest-GroupsV314Test-667406949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d0f18e84-2801-4a28-af75-2919488621d9.info" returned: 0 in 0.776s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:05:45 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-cdbd30a3-aca4-42ff-ba26-70d3c770a249 tempest-GroupsV314Test-667406949 None] Acquiring lock "cinder-quobyte-b187e0cf-2a43-4809-a1e6-c7ec756b18b5" by "_copy_volume_from_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:05:45 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-cdbd30a3-aca4-42ff-ba26-70d3c770a249 tempest-GroupsV314Test-667406949 None] Lock "cinder-quobyte-b187e0cf-2a43-4809-a1e6-c7ec756b18b5" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:05:45 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-cdbd30a3-aca4-42ff-ba26-70d3c770a249 tempest-GroupsV314Test-667406949 None] snapshot: 52141ede-62c2-4769-8da5-7b385cb87388, volume: b187e0cf-2a43-4809-a1e6-c7ec756b18b5, {{(pid=87234) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 10:05:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-cdbd30a3-aca4-42ff-ba26-70d3c770a249 tempest-GroupsV314Test-667406949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:05:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-cdbd30a3-aca4-42ff-ba26-70d3c770a249 tempest-GroupsV314Test-667406949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:05:45 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-cdbd30a3-aca4-42ff-ba26-70d3c770a249 tempest-GroupsV314Test-667406949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:05:45 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-cdbd30a3-aca4-42ff-ba26-70d3c770a249 tempest-GroupsV314Test-667406949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:05:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-cdbd30a3-aca4-42ff-ba26-70d3c770a249 tempest-GroupsV314Test-667406949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:05:45 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd556b7a-5707-46c0-99e1-0535d9e7c55f]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:05:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-cdbd30a3-aca4-42ff-ba26-70d3c770a249 tempest-GroupsV314Test-667406949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d0f18e84-2801-4a28-af75-2919488621d9.52141ede-62c2-4769-8da5-7b385cb87388 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:05:45 devstack sudo[91462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d0f18e84-2801-4a28-af75-2919488621d9.52141ede-62c2-4769-8da5-7b385cb87388 Jul 10 10:05:45 devstack sudo[91462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:05:46 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-9406a8db-064e-44b6-8faf-79db9855d860 tempest-DeleteServersTestJSON-351982828 None] Acquiring lock "cinder-d450c457-09e5-43a3-8081-74725cc4a030-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:05:46 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-9406a8db-064e-44b6-8faf-79db9855d860 tempest-DeleteServersTestJSON-351982828 None] Lock "cinder-d450c457-09e5-43a3-8081-74725cc4a030-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:05:46 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-9406a8db-064e-44b6-8faf-79db9855d860 tempest-DeleteServersTestJSON-351982828 None] Acquiring lock "cinder-quobyte-d450c457-09e5-43a3-8081-74725cc4a030" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:05:46 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-9406a8db-064e-44b6-8faf-79db9855d860 tempest-DeleteServersTestJSON-351982828 None] Lock "cinder-quobyte-d450c457-09e5-43a3-8081-74725cc4a030" acquired by "delete_volume" :: waited 0.018s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:05:46 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f327eb-e240-4370-8768-18bd0fcf2b3a]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:05:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9406a8db-064e-44b6-8faf-79db9855d860 tempest-DeleteServersTestJSON-351982828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d450c457-09e5-43a3-8081-74725cc4a030 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:05:46 devstack sudo[91462]: pam_unix(sudo:session): session closed for user root Jul 10 10:05:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-cdbd30a3-aca4-42ff-ba26-70d3c770a249 tempest-GroupsV314Test-667406949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d0f18e84-2801-4a28-af75-2919488621d9.52141ede-62c2-4769-8da5-7b385cb87388" returned: 0 in 0.928s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:05:46 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-cdbd30a3-aca4-42ff-ba26-70d3c770a249 tempest-GroupsV314Test-667406949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0f18e84-2801-4a28-af75-2919488621d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 10:05:46 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-cdbd30a3-aca4-42ff-ba26-70d3c770a249 tempest-GroupsV314Test-667406949 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d0f18e84-2801-4a28-af75-2919488621d9 {{(pid=87234) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 10:05:46 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-cdbd30a3-aca4-42ff-ba26-70d3c770a249 tempest-GroupsV314Test-667406949 None] Creating direct copy from snapshot {{(pid=87234) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 10:05:46 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c2dcb6-4858-4b6a-8ebb-769a5813ed57]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:05:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-cdbd30a3-aca4-42ff-ba26-70d3c770a249 tempest-GroupsV314Test-667406949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d0f18e84-2801-4a28-af75-2919488621d9 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:05:46 devstack sudo[91477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d450c457-09e5-43a3-8081-74725cc4a030 Jul 10 10:05:46 devstack sudo[91477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:05:46 devstack sudo[91479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d0f18e84-2801-4a28-af75-2919488621d9 Jul 10 10:05:46 devstack sudo[91479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:05:46 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-2653e071-e119-4ff5-9a3a-ef2fdef5fb13 tempest-BackendsCapabilitiesAdminTestsJSON-850314404 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87234) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 10 10:05:47 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-631be3eb-d6d1-4047-830f-12e12bb3fc04 tempest-BackendsCapabilitiesAdminTestsJSON-850314404 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87234) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 10 10:05:47 devstack sudo[91477]: pam_unix(sudo:session): session closed for user root Jul 10 10:05:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9406a8db-064e-44b6-8faf-79db9855d860 tempest-DeleteServersTestJSON-351982828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d450c457-09e5-43a3-8081-74725cc4a030" returned: 0 in 1.167s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:05:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9406a8db-064e-44b6-8faf-79db9855d860 tempest-DeleteServersTestJSON-351982828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d450c457-09e5-43a3-8081-74725cc4a030 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:05:47 devstack sudo[91491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d450c457-09e5-43a3-8081-74725cc4a030 Jul 10 10:05:47 devstack sudo[91491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:05:47 devstack sudo[91479]: pam_unix(sudo:session): session closed for user root Jul 10 10:05:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-cdbd30a3-aca4-42ff-ba26-70d3c770a249 tempest-GroupsV314Test-667406949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d0f18e84-2801-4a28-af75-2919488621d9" returned: 0 in 1.112s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:05:47 devstack cinder-volume[87234]: DEBUG cinder.utils [None req-cdbd30a3-aca4-42ff-ba26-70d3c770a249 tempest-GroupsV314Test-667406949 None] Path /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b187e0cf-2a43-4809-a1e6-c7ec756b18b5 not found in is_blk_device check {{(pid=87234) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 10:05:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-cdbd30a3-aca4-42ff-ba26-70d3c770a249 tempest-GroupsV314Test-667406949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d0f18e84-2801-4a28-af75-2919488621d9 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b187e0cf-2a43-4809-a1e6-c7ec756b18b5 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:05:47 devstack sudo[91494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d0f18e84-2801-4a28-af75-2919488621d9 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b187e0cf-2a43-4809-a1e6-c7ec756b18b5 Jul 10 10:05:47 devstack sudo[91494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:05:48 devstack sudo[91491]: pam_unix(sudo:session): session closed for user root Jul 10 10:05:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9406a8db-064e-44b6-8faf-79db9855d860 tempest-DeleteServersTestJSON-351982828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d450c457-09e5-43a3-8081-74725cc4a030" returned: 0 in 0.938s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:05:48 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-9406a8db-064e-44b6-8faf-79db9855d860 tempest-DeleteServersTestJSON-351982828 None] Lock "cinder-quobyte-d450c457-09e5-43a3-8081-74725cc4a030" released by "delete_volume" :: held 2.167s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:05:48 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-9406a8db-064e-44b6-8faf-79db9855d860 tempest-DeleteServersTestJSON-351982828 None] Created reservations ['6b8e7e0e-a6fb-4360-9124-e85cc2bea190', '72226591-7229-4639-9ff8-fcdd96246d51', '1bdf649c-3855-41c0-872a-17331832ed29', '9ea35bd6-bd26-4cb3-bbea-7a56ddc7c960'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:05:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-9406a8db-064e-44b6-8faf-79db9855d860 tempest-DeleteServersTestJSON-351982828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:05:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-9406a8db-064e-44b6-8faf-79db9855d860 tempest-DeleteServersTestJSON-351982828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:05:48 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-9406a8db-064e-44b6-8faf-79db9855d860 tempest-DeleteServersTestJSON-351982828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:05:48 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-9406a8db-064e-44b6-8faf-79db9855d860 tempest-DeleteServersTestJSON-351982828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:05:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-9406a8db-064e-44b6-8faf-79db9855d860 tempest-DeleteServersTestJSON-351982828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:05:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9406a8db-064e-44b6-8faf-79db9855d860 tempest-DeleteServersTestJSON-351982828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:05:48 devstack sudo[91500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:05:48 devstack sudo[91500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:05:51 devstack sudo[91500]: pam_unix(sudo:session): session closed for user root Jul 10 10:05:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9406a8db-064e-44b6-8faf-79db9855d860 tempest-DeleteServersTestJSON-351982828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 2.540s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:05:51 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-9406a8db-064e-44b6-8faf-79db9855d860 tempest-DeleteServersTestJSON-351982828 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:05:51 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-9406a8db-064e-44b6-8faf-79db9855d860 tempest-DeleteServersTestJSON-351982828 None] Deleted volume successfully. Jul 10 10:05:51 devstack cinder-volume[87234]: DEBUG dbcounter [-] [87234] Writing DB stats cinder:SELECT=54,cinder:INSERT=10,cinder:UPDATE=59,cinder:DELETE=7 {{(pid=87234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 10:05:51 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-9406a8db-064e-44b6-8faf-79db9855d860 tempest-DeleteServersTestJSON-351982828 None] Lock "cinder-d450c457-09e5-43a3-8081-74725cc4a030-delete_volume" released by "delete_volume" :: held 5.141s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:05:52 devstack cinder-volume[87234]: DEBUG dbcounter [-] [87234] Writing DB stats cinder:UPDATE=64,cinder:SELECT=51,cinder:INSERT=18,cinder:DELETE=4 {{(pid=87234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 10:05:54 devstack sudo[91494]: pam_unix(sudo:session): session closed for user root Jul 10 10:05:54 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-cdbd30a3-aca4-42ff-ba26-70d3c770a249 tempest-GroupsV314Test-667406949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d0f18e84-2801-4a28-af75-2919488621d9 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b187e0cf-2a43-4809-a1e6-c7ec756b18b5" returned: 0 in 7.474s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:05:54 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[837ce759-99d0-4778-8b08-95182e775af1]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:05:54 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-cdbd30a3-aca4-42ff-ba26-70d3c770a249 tempest-GroupsV314Test-667406949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d0f18e84-2801-4a28-af75-2919488621d9 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:05:55 devstack sudo[91525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d0f18e84-2801-4a28-af75-2919488621d9 Jul 10 10:05:55 devstack sudo[91525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:05:56 devstack sudo[91525]: pam_unix(sudo:session): session closed for user root Jul 10 10:05:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-cdbd30a3-aca4-42ff-ba26-70d3c770a249 tempest-GroupsV314Test-667406949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d0f18e84-2801-4a28-af75-2919488621d9" returned: 0 in 1.360s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:05:56 devstack cinder-volume[87234]: DEBUG cinder.image.image_utils [None req-cdbd30a3-aca4-42ff-ba26-70d3c770a249 tempest-GroupsV314Test-667406949 None] Image conversion details: src /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d0f18e84-2801-4a28-af75-2919488621d9, size 1024.00 MB, duration 7.48 sec, destination /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b187e0cf-2a43-4809-a1e6-c7ec756b18b5 {{(pid=87234) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 10:05:56 devstack cinder-volume[87234]: INFO cinder.image.image_utils [None req-cdbd30a3-aca4-42ff-ba26-70d3c770a249 tempest-GroupsV314Test-667406949 None] Converted 1024.00 MB image at 136.98 MB/s Jul 10 10:05:56 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-cdbd30a3-aca4-42ff-ba26-70d3c770a249 tempest-GroupsV314Test-667406949 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b187e0cf-2a43-4809-a1e6-c7ec756b18b5 is being set with open permissions: ugo+rw: NotImplementedError Jul 10 10:05:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-cdbd30a3-aca4-42ff-ba26-70d3c770a249 tempest-GroupsV314Test-667406949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b187e0cf-2a43-4809-a1e6-c7ec756b18b5 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:05:56 devstack sudo[91531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b187e0cf-2a43-4809-a1e6-c7ec756b18b5 Jul 10 10:05:56 devstack sudo[91531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:05:57 devstack sudo[91531]: pam_unix(sudo:session): session closed for user root Jul 10 10:05:57 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-cdbd30a3-aca4-42ff-ba26-70d3c770a249 tempest-GroupsV314Test-667406949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b187e0cf-2a43-4809-a1e6-c7ec756b18b5" returned: 0 in 1.262s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:05:57 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-cdbd30a3-aca4-42ff-ba26-70d3c770a249 tempest-GroupsV314Test-667406949 None] Lock "cinder-quobyte-b187e0cf-2a43-4809-a1e6-c7ec756b18b5" released by "_copy_volume_from_snapshot" :: held 12.296s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:05:57 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-cdbd30a3-aca4-42ff-ba26-70d3c770a249 tempest-GroupsV314Test-667406949 None] Acquiring lock "cinder-quobyte-52141ede-62c2-4769-8da5-7b385cb87388" by "_delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:05:57 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-cdbd30a3-aca4-42ff-ba26-70d3c770a249 tempest-GroupsV314Test-667406949 None] Lock "cinder-quobyte-52141ede-62c2-4769-8da5-7b385cb87388" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:05:57 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-cdbd30a3-aca4-42ff-ba26-70d3c770a249 tempest-GroupsV314Test-667406949 None] Deleting offline snapshot 52141ede-62c2-4769-8da5-7b385cb87388 of volume d0f18e84-2801-4a28-af75-2919488621d9 {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 10:05:57 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-cdbd30a3-aca4-42ff-ba26-70d3c770a249 tempest-GroupsV314Test-667406949 None] snapshot_file for this snap is: volume-d0f18e84-2801-4a28-af75-2919488621d9.52141ede-62c2-4769-8da5-7b385cb87388 {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 10:05:57 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3857f75-6b00-4fdb-a131-42f2fa031833]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:05:57 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-cdbd30a3-aca4-42ff-ba26-70d3c770a249 tempest-GroupsV314Test-667406949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d0f18e84-2801-4a28-af75-2919488621d9.52141ede-62c2-4769-8da5-7b385cb87388 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:05:57 devstack sudo[91544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d0f18e84-2801-4a28-af75-2919488621d9.52141ede-62c2-4769-8da5-7b385cb87388 Jul 10 10:05:57 devstack sudo[91544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:05:58 devstack sudo[91544]: pam_unix(sudo:session): session closed for user root Jul 10 10:05:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-cdbd30a3-aca4-42ff-ba26-70d3c770a249 tempest-GroupsV314Test-667406949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d0f18e84-2801-4a28-af75-2919488621d9.52141ede-62c2-4769-8da5-7b385cb87388" returned: 0 in 1.233s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:05:58 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-cdbd30a3-aca4-42ff-ba26-70d3c770a249 tempest-GroupsV314Test-667406949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0f18e84-2801-4a28-af75-2919488621d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 10:05:58 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf17f249-2145-4384-9bd0-28c76c5132af]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:05:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-cdbd30a3-aca4-42ff-ba26-70d3c770a249 tempest-GroupsV314Test-667406949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d0f18e84-2801-4a28-af75-2919488621d9 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:05:59 devstack sudo[91551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d0f18e84-2801-4a28-af75-2919488621d9 Jul 10 10:05:59 devstack sudo[91551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:05:59 devstack sudo[91551]: pam_unix(sudo:session): session closed for user root Jul 10 10:05:59 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-cdbd30a3-aca4-42ff-ba26-70d3c770a249 tempest-GroupsV314Test-667406949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d0f18e84-2801-4a28-af75-2919488621d9" returned: 0 in 1.062s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:05:59 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-cdbd30a3-aca4-42ff-ba26-70d3c770a249 tempest-GroupsV314Test-667406949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d0f18e84-2801-4a28-af75-2919488621d9.52141ede-62c2-4769-8da5-7b385cb87388 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:05:59 devstack sudo[91556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d0f18e84-2801-4a28-af75-2919488621d9.52141ede-62c2-4769-8da5-7b385cb87388 Jul 10 10:05:59 devstack sudo[91556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:06:00 devstack sudo[91556]: pam_unix(sudo:session): session closed for user root Jul 10 10:06:00 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-cdbd30a3-aca4-42ff-ba26-70d3c770a249 tempest-GroupsV314Test-667406949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d0f18e84-2801-4a28-af75-2919488621d9.52141ede-62c2-4769-8da5-7b385cb87388" returned: 0 in 0.955s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:06:00 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-cdbd30a3-aca4-42ff-ba26-70d3c770a249 tempest-GroupsV314Test-667406949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d0f18e84-2801-4a28-af75-2919488621d9.52141ede-62c2-4769-8da5-7b385cb87388 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:06:00 devstack sudo[91571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d0f18e84-2801-4a28-af75-2919488621d9.52141ede-62c2-4769-8da5-7b385cb87388 Jul 10 10:06:00 devstack sudo[91571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:06:01 devstack sudo[91571]: pam_unix(sudo:session): session closed for user root Jul 10 10:06:01 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-cdbd30a3-aca4-42ff-ba26-70d3c770a249 tempest-GroupsV314Test-667406949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d0f18e84-2801-4a28-af75-2919488621d9.52141ede-62c2-4769-8da5-7b385cb87388" returned: 0 in 0.821s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:06:01 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-cdbd30a3-aca4-42ff-ba26-70d3c770a249 tempest-GroupsV314Test-667406949 None] Lock "cinder-quobyte-52141ede-62c2-4769-8da5-7b385cb87388" released by "_delete_snapshot" :: held 4.247s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:06:01 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-cdbd30a3-aca4-42ff-ba26-70d3c770a249 tempest-GroupsV314Test-667406949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 22.885s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:06:01 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-cdbd30a3-aca4-42ff-ba26-70d3c770a249 tempest-GroupsV314Test-667406949 None] Create group from source-group-0b3cddfc-18b0-4359-b39a-3d49beb2e90b completed successfully. Jul 10 10:06:02 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-4512d064-3e52-4793-8ed3-d5b32f1c9fdc tempest-GroupsV314Test-667406949 None] Acquiring lock "cinder-quobyte-b187e0cf-2a43-4809-a1e6-c7ec756b18b5" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:06:02 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-4512d064-3e52-4793-8ed3-d5b32f1c9fdc tempest-GroupsV314Test-667406949 None] Lock "cinder-quobyte-b187e0cf-2a43-4809-a1e6-c7ec756b18b5" acquired by "delete_volume" :: waited 0.027s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:06:02 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbaf1407-b507-4122-a449-31708740989d]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:06:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4512d064-3e52-4793-8ed3-d5b32f1c9fdc tempest-GroupsV314Test-667406949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b187e0cf-2a43-4809-a1e6-c7ec756b18b5 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:06:02 devstack sudo[91574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b187e0cf-2a43-4809-a1e6-c7ec756b18b5 Jul 10 10:06:02 devstack sudo[91574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:06:03 devstack sudo[91574]: pam_unix(sudo:session): session closed for user root Jul 10 10:06:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4512d064-3e52-4793-8ed3-d5b32f1c9fdc tempest-GroupsV314Test-667406949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b187e0cf-2a43-4809-a1e6-c7ec756b18b5" returned: 0 in 0.887s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:06:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4512d064-3e52-4793-8ed3-d5b32f1c9fdc tempest-GroupsV314Test-667406949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b187e0cf-2a43-4809-a1e6-c7ec756b18b5 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:06:03 devstack sudo[91579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b187e0cf-2a43-4809-a1e6-c7ec756b18b5 Jul 10 10:06:03 devstack sudo[91579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:06:04 devstack sudo[91579]: pam_unix(sudo:session): session closed for user root Jul 10 10:06:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4512d064-3e52-4793-8ed3-d5b32f1c9fdc tempest-GroupsV314Test-667406949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b187e0cf-2a43-4809-a1e6-c7ec756b18b5" returned: 0 in 0.684s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:06:04 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-4512d064-3e52-4793-8ed3-d5b32f1c9fdc tempest-GroupsV314Test-667406949 None] Lock "cinder-quobyte-b187e0cf-2a43-4809-a1e6-c7ec756b18b5" released by "delete_volume" :: held 1.637s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:06:04 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-4512d064-3e52-4793-8ed3-d5b32f1c9fdc tempest-GroupsV314Test-667406949 None] Created reservations ['8bf5e81f-1c96-4d2e-a5c4-43f060bf2fe4'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:06:04 devstack cinder-volume[87234]: WARNING cinder.quota [None req-4512d064-3e52-4793-8ed3-d5b32f1c9fdc tempest-GroupsV314Test-667406949 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1108359392 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1108359392, it is now deprecated. Please use the default quota class for default quota. Jul 10 10:06:04 devstack cinder-volume[87234]: WARNING cinder.quota [None req-4512d064-3e52-4793-8ed3-d5b32f1c9fdc tempest-GroupsV314Test-667406949 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1108359392 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1108359392, it is now deprecated. Please use the default quota class for default quota. Jul 10 10:06:04 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-4512d064-3e52-4793-8ed3-d5b32f1c9fdc tempest-GroupsV314Test-667406949 None] Created reservations ['bb86680e-e986-4287-8626-caf0dbcb8a47', '8aa1f58d-82be-4af3-8a12-cbf6be22e749', 'a9397127-964a-4d37-bae7-f606dc21ea52', 'decde1bf-0241-4d96-a140-ddc94834d408'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:06:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-4512d064-3e52-4793-8ed3-d5b32f1c9fdc tempest-GroupsV314Test-667406949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:06:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-4512d064-3e52-4793-8ed3-d5b32f1c9fdc tempest-GroupsV314Test-667406949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:06:04 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-4512d064-3e52-4793-8ed3-d5b32f1c9fdc tempest-GroupsV314Test-667406949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:06:04 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-4512d064-3e52-4793-8ed3-d5b32f1c9fdc tempest-GroupsV314Test-667406949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:06:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-4512d064-3e52-4793-8ed3-d5b32f1c9fdc tempest-GroupsV314Test-667406949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:06:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4512d064-3e52-4793-8ed3-d5b32f1c9fdc tempest-GroupsV314Test-667406949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:06:04 devstack sudo[91582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:06:04 devstack sudo[91582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:06:05 devstack sudo[91582]: pam_unix(sudo:session): session closed for user root Jul 10 10:06:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4512d064-3e52-4793-8ed3-d5b32f1c9fdc tempest-GroupsV314Test-667406949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.756s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:06:05 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-4512d064-3e52-4793-8ed3-d5b32f1c9fdc tempest-GroupsV314Test-667406949 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:06:05 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-4512d064-3e52-4793-8ed3-d5b32f1c9fdc tempest-GroupsV314Test-667406949 None] Delete group completed successfully. Jul 10 10:06:05 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-25b12231-cbaa-416b-bf30-419dbc65e95b tempest-GroupsV314Test-667406949 None] Acquiring lock "cinder-quobyte-d0f18e84-2801-4a28-af75-2919488621d9" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:06:05 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-25b12231-cbaa-416b-bf30-419dbc65e95b tempest-GroupsV314Test-667406949 None] Lock "cinder-quobyte-d0f18e84-2801-4a28-af75-2919488621d9" acquired by "delete_volume" :: waited 0.024s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:06:05 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[26981505-93df-4771-9a0e-9eb3b07ee131]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:06:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-25b12231-cbaa-416b-bf30-419dbc65e95b tempest-GroupsV314Test-667406949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d0f18e84-2801-4a28-af75-2919488621d9 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:06:05 devstack sudo[91586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d0f18e84-2801-4a28-af75-2919488621d9 Jul 10 10:06:05 devstack sudo[91586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:06:06 devstack sudo[91586]: pam_unix(sudo:session): session closed for user root Jul 10 10:06:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-25b12231-cbaa-416b-bf30-419dbc65e95b tempest-GroupsV314Test-667406949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d0f18e84-2801-4a28-af75-2919488621d9" returned: 0 in 1.065s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:06:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-25b12231-cbaa-416b-bf30-419dbc65e95b tempest-GroupsV314Test-667406949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d0f18e84-2801-4a28-af75-2919488621d9 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:06:06 devstack sudo[91592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d0f18e84-2801-4a28-af75-2919488621d9 Jul 10 10:06:06 devstack sudo[91592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:06:07 devstack sudo[91592]: pam_unix(sudo:session): session closed for user root Jul 10 10:06:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-25b12231-cbaa-416b-bf30-419dbc65e95b tempest-GroupsV314Test-667406949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d0f18e84-2801-4a28-af75-2919488621d9" returned: 0 in 1.008s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:06:07 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-25b12231-cbaa-416b-bf30-419dbc65e95b tempest-GroupsV314Test-667406949 None] Lock "cinder-quobyte-d0f18e84-2801-4a28-af75-2919488621d9" released by "delete_volume" :: held 2.169s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:06:07 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-25b12231-cbaa-416b-bf30-419dbc65e95b tempest-GroupsV314Test-667406949 None] Created reservations ['a4867f56-df2d-44ce-96a2-b734214be48a'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:06:07 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-25b12231-cbaa-416b-bf30-419dbc65e95b tempest-GroupsV314Test-667406949 None] Created reservations ['9a5819cb-173c-474d-95c1-e39dbd3a665d', 'f8c430e2-3d78-4956-97e8-290969585bfe', '128e071e-ea40-4718-875d-68ebb1bddd7f', '75c58135-57c4-4f2f-b2f3-feb09925a3b1'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:06:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-25b12231-cbaa-416b-bf30-419dbc65e95b tempest-GroupsV314Test-667406949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:06:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-25b12231-cbaa-416b-bf30-419dbc65e95b tempest-GroupsV314Test-667406949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:06:07 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-25b12231-cbaa-416b-bf30-419dbc65e95b tempest-GroupsV314Test-667406949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:06:07 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-25b12231-cbaa-416b-bf30-419dbc65e95b tempest-GroupsV314Test-667406949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:06:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-25b12231-cbaa-416b-bf30-419dbc65e95b tempest-GroupsV314Test-667406949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:06:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-25b12231-cbaa-416b-bf30-419dbc65e95b tempest-GroupsV314Test-667406949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:06:07 devstack sudo[91629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:06:07 devstack sudo[91629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:06:08 devstack sudo[91629]: pam_unix(sudo:session): session closed for user root Jul 10 10:06:08 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-25b12231-cbaa-416b-bf30-419dbc65e95b tempest-GroupsV314Test-667406949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.779s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:06:08 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-25b12231-cbaa-416b-bf30-419dbc65e95b tempest-GroupsV314Test-667406949 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:06:08 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-25b12231-cbaa-416b-bf30-419dbc65e95b tempest-GroupsV314Test-667406949 None] Delete group completed successfully. Jul 10 10:06:17 devstack cinder-volume[87234]: DEBUG dbcounter [-] [87234] Writing DB stats cinder:SELECT=21,cinder:UPDATE=25,cinder:INSERT=6 {{(pid=87234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 10:06:17 devstack cinder-volume[87234]: DEBUG dbcounter [-] [87234] Writing DB stats cinder:UPDATE=24,cinder:SELECT=16,cinder:INSERT=4 {{(pid=87234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 10:06:24 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-e64b368d-d220-42c5-b90f-df0f58448573 tempest-AttachVolumeShelveTestJSON-932158510 None] Acquiring lock "cinder-1714a1ce-74a3-4919-a1b4-7fe0a683230f-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:06:24 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-e64b368d-d220-42c5-b90f-df0f58448573 tempest-AttachVolumeShelveTestJSON-932158510 None] Lock "cinder-1714a1ce-74a3-4919-a1b4-7fe0a683230f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:06:24 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-e64b368d-d220-42c5-b90f-df0f58448573 tempest-AttachVolumeShelveTestJSON-932158510 None] Acquiring lock "cinder-quobyte-1714a1ce-74a3-4919-a1b4-7fe0a683230f" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:06:24 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-e64b368d-d220-42c5-b90f-df0f58448573 tempest-AttachVolumeShelveTestJSON-932158510 None] Lock "cinder-quobyte-1714a1ce-74a3-4919-a1b4-7fe0a683230f" acquired by "delete_volume" :: waited 0.024s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:06:24 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[a47f7f3e-ca72-450c-81b7-9b65f1d9faf9]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:06:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e64b368d-d220-42c5-b90f-df0f58448573 tempest-AttachVolumeShelveTestJSON-932158510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-1714a1ce-74a3-4919-a1b4-7fe0a683230f {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:06:25 devstack sudo[91715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-1714a1ce-74a3-4919-a1b4-7fe0a683230f Jul 10 10:06:25 devstack sudo[91715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:06:25 devstack sudo[91715]: pam_unix(sudo:session): session closed for user root Jul 10 10:06:25 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e64b368d-d220-42c5-b90f-df0f58448573 tempest-AttachVolumeShelveTestJSON-932158510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-1714a1ce-74a3-4919-a1b4-7fe0a683230f" returned: 0 in 0.986s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:06:25 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e64b368d-d220-42c5-b90f-df0f58448573 tempest-AttachVolumeShelveTestJSON-932158510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-1714a1ce-74a3-4919-a1b4-7fe0a683230f {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:06:25 devstack sudo[91720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-1714a1ce-74a3-4919-a1b4-7fe0a683230f Jul 10 10:06:25 devstack sudo[91720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:06:26 devstack sudo[91720]: pam_unix(sudo:session): session closed for user root Jul 10 10:06:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e64b368d-d220-42c5-b90f-df0f58448573 tempest-AttachVolumeShelveTestJSON-932158510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-1714a1ce-74a3-4919-a1b4-7fe0a683230f" returned: 0 in 0.861s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:06:26 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-e64b368d-d220-42c5-b90f-df0f58448573 tempest-AttachVolumeShelveTestJSON-932158510 None] Lock "cinder-quobyte-1714a1ce-74a3-4919-a1b4-7fe0a683230f" released by "delete_volume" :: held 1.919s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:06:26 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-e64b368d-d220-42c5-b90f-df0f58448573 tempest-AttachVolumeShelveTestJSON-932158510 None] Created reservations ['c9cb69a1-0c5c-40ea-a748-faa6f3b3e578', '435858f2-85b2-4ae5-a76f-56f16cb95e97', '37bb0207-1501-4d4d-809a-e64ded1cecd6', '28e47816-87f2-4d6b-bb5d-384a8e155a55'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:06:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-e64b368d-d220-42c5-b90f-df0f58448573 tempest-AttachVolumeShelveTestJSON-932158510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:06:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-e64b368d-d220-42c5-b90f-df0f58448573 tempest-AttachVolumeShelveTestJSON-932158510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:06:26 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-e64b368d-d220-42c5-b90f-df0f58448573 tempest-AttachVolumeShelveTestJSON-932158510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:06:26 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-e64b368d-d220-42c5-b90f-df0f58448573 tempest-AttachVolumeShelveTestJSON-932158510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:06:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-e64b368d-d220-42c5-b90f-df0f58448573 tempest-AttachVolumeShelveTestJSON-932158510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:06:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e64b368d-d220-42c5-b90f-df0f58448573 tempest-AttachVolumeShelveTestJSON-932158510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:06:27 devstack sudo[91727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:06:27 devstack sudo[91727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:06:28 devstack sudo[91727]: pam_unix(sudo:session): session closed for user root Jul 10 10:06:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e64b368d-d220-42c5-b90f-df0f58448573 tempest-AttachVolumeShelveTestJSON-932158510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 1.074s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:06:28 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-e64b368d-d220-42c5-b90f-df0f58448573 tempest-AttachVolumeShelveTestJSON-932158510 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:06:28 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-e64b368d-d220-42c5-b90f-df0f58448573 tempest-AttachVolumeShelveTestJSON-932158510 None] Deleted volume successfully. Jul 10 10:06:28 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-e64b368d-d220-42c5-b90f-df0f58448573 tempest-AttachVolumeShelveTestJSON-932158510 None] Lock "cinder-1714a1ce-74a3-4919-a1b4-7fe0a683230f-delete_volume" released by "delete_volume" :: held 3.286s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:06:36 devstack cinder-volume[87234]: DEBUG dbcounter [-] [87234] Writing DB stats cinder:UPDATE=11,cinder:SELECT=3,cinder:INSERT=3 {{(pid=87234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 10:06:38 devstack cinder-volume[87234]: DEBUG dbcounter [-] [87234] Writing DB stats cinder:SELECT=7,cinder:INSERT=1,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=87234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 10:06:38 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-555000e2-18d7-466a-b580-dca3f0cf05ee tempest-VolumeQuotasAdminTestJSON-262467459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:06:38 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-555000e2-18d7-466a-b580-dca3f0cf05ee tempest-VolumeQuotasAdminTestJSON-262467459 None] Flow 'volume_create_manager' (ba782f58-06f5-48e9-a4ba-b11ee0621f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:06:38 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-555000e2-18d7-466a-b580-dca3f0cf05ee tempest-VolumeQuotasAdminTestJSON-262467459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0764f77f-262b-4a07-9835-1568f8de195a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:06:38 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-555000e2-18d7-466a-b580-dca3f0cf05ee tempest-VolumeQuotasAdminTestJSON-262467459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0764f77f-262b-4a07-9835-1568f8de195a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:06:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-320586136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cbe3435-3f31-456b-88b5-63eb9ad4da46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45f35fcc760548c0915b21498a55152f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:06:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:06:39Z,use_quota=True,user_id='8dbef74288b54bc4b58311aae92ae024',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:06:38 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-555000e2-18d7-466a-b580-dca3f0cf05ee tempest-VolumeQuotasAdminTestJSON-262467459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3b9a439-1c39-4e2a-b2b5-776f69b0657c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:06:38 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-555000e2-18d7-466a-b580-dca3f0cf05ee tempest-VolumeQuotasAdminTestJSON-262467459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3b9a439-1c39-4e2a-b2b5-776f69b0657c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:06:38 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-555000e2-18d7-466a-b580-dca3f0cf05ee tempest-VolumeQuotasAdminTestJSON-262467459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94822e56-5ed3-4ed2-8a8b-b9986158ebbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:06:38 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-555000e2-18d7-466a-b580-dca3f0cf05ee tempest-VolumeQuotasAdminTestJSON-262467459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94822e56-5ed3-4ed2-8a8b-b9986158ebbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cbe3435-3f31-456b-88b5-63eb9ad4da46', 'volume_name': 'volume-2cbe3435-3f31-456b-88b5-63eb9ad4da46', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:06:38 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-555000e2-18d7-466a-b580-dca3f0cf05ee tempest-VolumeQuotasAdminTestJSON-262467459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60df14d7-9eb1-47b1-92fa-70458e86be89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:06:38 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-555000e2-18d7-466a-b580-dca3f0cf05ee tempest-VolumeQuotasAdminTestJSON-262467459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60df14d7-9eb1-47b1-92fa-70458e86be89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:06:38 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-555000e2-18d7-466a-b580-dca3f0cf05ee tempest-VolumeQuotasAdminTestJSON-262467459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3f95ba6-5a1f-43bd-bc77-154628b0706b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:06:38 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-555000e2-18d7-466a-b580-dca3f0cf05ee tempest-VolumeQuotasAdminTestJSON-262467459 None] Volume 2cbe3435-3f31-456b-88b5-63eb9ad4da46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cbe3435-3f31-456b-88b5-63eb9ad4da46', 'volume_size': 1} Jul 10 10:06:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-555000e2-18d7-466a-b580-dca3f0cf05ee tempest-VolumeQuotasAdminTestJSON-262467459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:06:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-555000e2-18d7-466a-b580-dca3f0cf05ee tempest-VolumeQuotasAdminTestJSON-262467459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:06:38 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-555000e2-18d7-466a-b580-dca3f0cf05ee tempest-VolumeQuotasAdminTestJSON-262467459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:06:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-320586136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cbe3435-3f31-456b-88b5-63eb9ad4da46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45f35fcc760548c0915b21498a55152f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:06:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:06:39Z,use_quota=True,user_id='8dbef74288b54bc4b58311aae92ae024',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:06:38 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-555000e2-18d7-466a-b580-dca3f0cf05ee tempest-VolumeQuotasAdminTestJSON-262467459 None] Creating volume 2cbe3435-3f31-456b-88b5-63eb9ad4da46 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:06:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-555000e2-18d7-466a-b580-dca3f0cf05ee tempest-VolumeQuotasAdminTestJSON-262467459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:06:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-555000e2-18d7-466a-b580-dca3f0cf05ee tempest-VolumeQuotasAdminTestJSON-262467459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:06:38 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-555000e2-18d7-466a-b580-dca3f0cf05ee tempest-VolumeQuotasAdminTestJSON-262467459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:06:38 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-555000e2-18d7-466a-b580-dca3f0cf05ee tempest-VolumeQuotasAdminTestJSON-262467459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:06:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-555000e2-18d7-466a-b580-dca3f0cf05ee tempest-VolumeQuotasAdminTestJSON-262467459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:06:38 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-555000e2-18d7-466a-b580-dca3f0cf05ee tempest-VolumeQuotasAdminTestJSON-262467459 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:06:38 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-555000e2-18d7-466a-b580-dca3f0cf05ee tempest-VolumeQuotasAdminTestJSON-262467459 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:06:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-555000e2-18d7-466a-b580-dca3f0cf05ee tempest-VolumeQuotasAdminTestJSON-262467459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2cbe3435-3f31-456b-88b5-63eb9ad4da46 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:06:38 devstack sudo[91847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2cbe3435-3f31-456b-88b5-63eb9ad4da46 1073741824 Jul 10 10:06:38 devstack sudo[91847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:06:40 devstack sudo[91847]: pam_unix(sudo:session): session closed for user root Jul 10 10:06:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-555000e2-18d7-466a-b580-dca3f0cf05ee tempest-VolumeQuotasAdminTestJSON-262467459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2cbe3435-3f31-456b-88b5-63eb9ad4da46 1073741824" returned: 0 in 1.780s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:06:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-555000e2-18d7-466a-b580-dca3f0cf05ee tempest-VolumeQuotasAdminTestJSON-262467459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2cbe3435-3f31-456b-88b5-63eb9ad4da46 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:06:40 devstack sudo[91855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2cbe3435-3f31-456b-88b5-63eb9ad4da46 Jul 10 10:06:40 devstack sudo[91855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:06:42 devstack cinder-volume[87234]: DEBUG oslo_service.periodic_task [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 10:06:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:06:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:06:42 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:06:42 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:06:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:06:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:06:42 devstack sudo[91855]: pam_unix(sudo:session): session closed for user root Jul 10 10:06:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-555000e2-18d7-466a-b580-dca3f0cf05ee tempest-VolumeQuotasAdminTestJSON-262467459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2cbe3435-3f31-456b-88b5-63eb9ad4da46" returned: 0 in 1.430s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:06:42 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-555000e2-18d7-466a-b580-dca3f0cf05ee tempest-VolumeQuotasAdminTestJSON-262467459 None] <== create_volume: return (3396ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:06:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-555000e2-18d7-466a-b580-dca3f0cf05ee tempest-VolumeQuotasAdminTestJSON-262467459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.401s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:06:42 devstack sudo[91858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:06:42 devstack sudo[91858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:06:42 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-555000e2-18d7-466a-b580-dca3f0cf05ee tempest-VolumeQuotasAdminTestJSON-262467459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3f95ba6-5a1f-43bd-bc77-154628b0706b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cbe3435-3f31-456b-88b5-63eb9ad4da46', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:06:42 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-555000e2-18d7-466a-b580-dca3f0cf05ee tempest-VolumeQuotasAdminTestJSON-262467459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b95e03d-1045-430a-92d6-39461f6baf07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:06:42 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-555000e2-18d7-466a-b580-dca3f0cf05ee tempest-VolumeQuotasAdminTestJSON-262467459 None] Volume volume-2cbe3435-3f31-456b-88b5-63eb9ad4da46 (2cbe3435-3f31-456b-88b5-63eb9ad4da46): created successfully Jul 10 10:06:42 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-555000e2-18d7-466a-b580-dca3f0cf05ee tempest-VolumeQuotasAdminTestJSON-262467459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b95e03d-1045-430a-92d6-39461f6baf07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:06:42 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-555000e2-18d7-466a-b580-dca3f0cf05ee tempest-VolumeQuotasAdminTestJSON-262467459 None] Flow 'volume_create_manager' (ba782f58-06f5-48e9-a4ba-b11ee0621f07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:06:42 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-555000e2-18d7-466a-b580-dca3f0cf05ee tempest-VolumeQuotasAdminTestJSON-262467459 None] Created volume successfully. Jul 10 10:06:43 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-312743ff-a2e6-4cb6-a9cf-987df9d21df5 tempest-VolumeQuotasAdminTestJSON-262467459 None] Acquiring lock "cinder-2cbe3435-3f31-456b-88b5-63eb9ad4da46-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:06:43 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-312743ff-a2e6-4cb6-a9cf-987df9d21df5 tempest-VolumeQuotasAdminTestJSON-262467459 None] Lock "cinder-2cbe3435-3f31-456b-88b5-63eb9ad4da46-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:06:43 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-312743ff-a2e6-4cb6-a9cf-987df9d21df5 tempest-VolumeQuotasAdminTestJSON-262467459 None] Acquiring lock "cinder-quobyte-2cbe3435-3f31-456b-88b5-63eb9ad4da46" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:06:43 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-312743ff-a2e6-4cb6-a9cf-987df9d21df5 tempest-VolumeQuotasAdminTestJSON-262467459 None] Lock "cinder-quobyte-2cbe3435-3f31-456b-88b5-63eb9ad4da46" acquired by "delete_volume" :: waited 0.051s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:06:43 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[5abb34b6-35eb-480b-a7e7-4114a272966b]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:06:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-312743ff-a2e6-4cb6-a9cf-987df9d21df5 tempest-VolumeQuotasAdminTestJSON-262467459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2cbe3435-3f31-456b-88b5-63eb9ad4da46 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:06:43 devstack sudo[91858]: pam_unix(sudo:session): session closed for user root Jul 10 10:06:43 devstack sudo[91888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2cbe3435-3f31-456b-88b5-63eb9ad4da46 Jul 10 10:06:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 1.526s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:06:43 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:06:43 devstack sudo[91888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:06:43 devstack cinder-volume[87234]: DEBUG oslo_service.periodic_task [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Running periodic task VolumeManager._thread_info {{(pid=87234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 10:06:43 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] thread count: 8 {{(pid=87234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 10:06:43 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] thread info: [<_MainThread(MainThread, started 131600773742720)>, , , , , , , ] {{(pid=87234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 10:06:44 devstack sudo[91888]: pam_unix(sudo:session): session closed for user root Jul 10 10:06:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-312743ff-a2e6-4cb6-a9cf-987df9d21df5 tempest-VolumeQuotasAdminTestJSON-262467459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2cbe3435-3f31-456b-88b5-63eb9ad4da46" returned: 0 in 1.144s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:06:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-312743ff-a2e6-4cb6-a9cf-987df9d21df5 tempest-VolumeQuotasAdminTestJSON-262467459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2cbe3435-3f31-456b-88b5-63eb9ad4da46 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:06:44 devstack sudo[91895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2cbe3435-3f31-456b-88b5-63eb9ad4da46 Jul 10 10:06:44 devstack sudo[91895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:06:46 devstack sudo[91895]: pam_unix(sudo:session): session closed for user root Jul 10 10:06:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-312743ff-a2e6-4cb6-a9cf-987df9d21df5 tempest-VolumeQuotasAdminTestJSON-262467459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2cbe3435-3f31-456b-88b5-63eb9ad4da46" returned: 0 in 1.387s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:06:46 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-312743ff-a2e6-4cb6-a9cf-987df9d21df5 tempest-VolumeQuotasAdminTestJSON-262467459 None] Lock "cinder-quobyte-2cbe3435-3f31-456b-88b5-63eb9ad4da46" released by "delete_volume" :: held 2.601s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:06:46 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-312743ff-a2e6-4cb6-a9cf-987df9d21df5 tempest-VolumeQuotasAdminTestJSON-262467459 None] Created reservations ['debda7c0-df71-4aa9-94d1-c66360accb25', '3318a3ce-d328-4475-9310-9b3c0687ebf3', 'cb641ca8-9e7d-4c7e-bc04-644f7e1899b4', '6b8005a4-cb51-4c70-9971-219b19abece5'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:06:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-312743ff-a2e6-4cb6-a9cf-987df9d21df5 tempest-VolumeQuotasAdminTestJSON-262467459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:06:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-312743ff-a2e6-4cb6-a9cf-987df9d21df5 tempest-VolumeQuotasAdminTestJSON-262467459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:06:46 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-312743ff-a2e6-4cb6-a9cf-987df9d21df5 tempest-VolumeQuotasAdminTestJSON-262467459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:06:46 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-312743ff-a2e6-4cb6-a9cf-987df9d21df5 tempest-VolumeQuotasAdminTestJSON-262467459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:06:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-312743ff-a2e6-4cb6-a9cf-987df9d21df5 tempest-VolumeQuotasAdminTestJSON-262467459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:06:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-312743ff-a2e6-4cb6-a9cf-987df9d21df5 tempest-VolumeQuotasAdminTestJSON-262467459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:06:46 devstack sudo[91900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:06:46 devstack sudo[91900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:06:47 devstack sudo[91900]: pam_unix(sudo:session): session closed for user root Jul 10 10:06:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-312743ff-a2e6-4cb6-a9cf-987df9d21df5 tempest-VolumeQuotasAdminTestJSON-262467459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 1.729s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:06:47 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-312743ff-a2e6-4cb6-a9cf-987df9d21df5 tempest-VolumeQuotasAdminTestJSON-262467459 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:06:47 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-312743ff-a2e6-4cb6-a9cf-987df9d21df5 tempest-VolumeQuotasAdminTestJSON-262467459 None] Deleted volume successfully. Jul 10 10:06:47 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef046dfa-8161-4f6e-b1a2-881b3d9fa9dd tempest-VolumeQuotasAdminTestJSON-262467459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:06:48 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ef046dfa-8161-4f6e-b1a2-881b3d9fa9dd tempest-VolumeQuotasAdminTestJSON-262467459 None] Flow 'volume_create_manager' (2fef999b-c761-4734-a520-8a55846af788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:06:48 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ef046dfa-8161-4f6e-b1a2-881b3d9fa9dd tempest-VolumeQuotasAdminTestJSON-262467459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db72e179-92c9-4b59-a405-7149400e04b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:06:48 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ef046dfa-8161-4f6e-b1a2-881b3d9fa9dd tempest-VolumeQuotasAdminTestJSON-262467459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db72e179-92c9-4b59-a405-7149400e04b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:06:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1405479374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8efeb5a0-cb6c-4ff7-88e1-86ede54bbb8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45f35fcc760548c0915b21498a55152f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:06:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:06:48Z,use_quota=True,user_id='8dbef74288b54bc4b58311aae92ae024',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:06:48 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ef046dfa-8161-4f6e-b1a2-881b3d9fa9dd tempest-VolumeQuotasAdminTestJSON-262467459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (897888be-b996-41f9-b093-faae7a62b2fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:06:48 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ef046dfa-8161-4f6e-b1a2-881b3d9fa9dd tempest-VolumeQuotasAdminTestJSON-262467459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (897888be-b996-41f9-b093-faae7a62b2fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:06:48 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ef046dfa-8161-4f6e-b1a2-881b3d9fa9dd tempest-VolumeQuotasAdminTestJSON-262467459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cdd41eb-6987-457a-90b3-167e06316e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:06:48 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ef046dfa-8161-4f6e-b1a2-881b3d9fa9dd tempest-VolumeQuotasAdminTestJSON-262467459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cdd41eb-6987-457a-90b3-167e06316e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8efeb5a0-cb6c-4ff7-88e1-86ede54bbb8f', 'volume_name': 'volume-8efeb5a0-cb6c-4ff7-88e1-86ede54bbb8f', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:06:48 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ef046dfa-8161-4f6e-b1a2-881b3d9fa9dd tempest-VolumeQuotasAdminTestJSON-262467459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0102b2cd-1193-4ab2-95db-75a50ca6c3ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:06:48 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ef046dfa-8161-4f6e-b1a2-881b3d9fa9dd tempest-VolumeQuotasAdminTestJSON-262467459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0102b2cd-1193-4ab2-95db-75a50ca6c3ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:06:48 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ef046dfa-8161-4f6e-b1a2-881b3d9fa9dd tempest-VolumeQuotasAdminTestJSON-262467459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d287d98b-69d6-429c-8d22-0110a6e0156f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:06:48 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-ef046dfa-8161-4f6e-b1a2-881b3d9fa9dd tempest-VolumeQuotasAdminTestJSON-262467459 None] Volume 8efeb5a0-cb6c-4ff7-88e1-86ede54bbb8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8efeb5a0-cb6c-4ff7-88e1-86ede54bbb8f', 'volume_size': 1} Jul 10 10:06:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-ef046dfa-8161-4f6e-b1a2-881b3d9fa9dd tempest-VolumeQuotasAdminTestJSON-262467459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:06:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-ef046dfa-8161-4f6e-b1a2-881b3d9fa9dd tempest-VolumeQuotasAdminTestJSON-262467459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:06:48 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-ef046dfa-8161-4f6e-b1a2-881b3d9fa9dd tempest-VolumeQuotasAdminTestJSON-262467459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:06:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1405479374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8efeb5a0-cb6c-4ff7-88e1-86ede54bbb8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45f35fcc760548c0915b21498a55152f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:06:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:06:48Z,use_quota=True,user_id='8dbef74288b54bc4b58311aae92ae024',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:06:48 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-ef046dfa-8161-4f6e-b1a2-881b3d9fa9dd tempest-VolumeQuotasAdminTestJSON-262467459 None] Creating volume 8efeb5a0-cb6c-4ff7-88e1-86ede54bbb8f {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:06:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-ef046dfa-8161-4f6e-b1a2-881b3d9fa9dd tempest-VolumeQuotasAdminTestJSON-262467459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:06:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-ef046dfa-8161-4f6e-b1a2-881b3d9fa9dd tempest-VolumeQuotasAdminTestJSON-262467459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:06:48 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-ef046dfa-8161-4f6e-b1a2-881b3d9fa9dd tempest-VolumeQuotasAdminTestJSON-262467459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:06:48 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-ef046dfa-8161-4f6e-b1a2-881b3d9fa9dd tempest-VolumeQuotasAdminTestJSON-262467459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:06:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-ef046dfa-8161-4f6e-b1a2-881b3d9fa9dd tempest-VolumeQuotasAdminTestJSON-262467459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:06:48 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-ef046dfa-8161-4f6e-b1a2-881b3d9fa9dd tempest-VolumeQuotasAdminTestJSON-262467459 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:06:48 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-ef046dfa-8161-4f6e-b1a2-881b3d9fa9dd tempest-VolumeQuotasAdminTestJSON-262467459 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:06:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ef046dfa-8161-4f6e-b1a2-881b3d9fa9dd tempest-VolumeQuotasAdminTestJSON-262467459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8efeb5a0-cb6c-4ff7-88e1-86ede54bbb8f 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:06:48 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-312743ff-a2e6-4cb6-a9cf-987df9d21df5 tempest-VolumeQuotasAdminTestJSON-262467459 None] Lock "cinder-2cbe3435-3f31-456b-88b5-63eb9ad4da46-delete_volume" released by "delete_volume" :: held 4.926s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:06:48 devstack sudo[91904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8efeb5a0-cb6c-4ff7-88e1-86ede54bbb8f 1073741824 Jul 10 10:06:48 devstack sudo[91904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:06:49 devstack sudo[91904]: pam_unix(sudo:session): session closed for user root Jul 10 10:06:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ef046dfa-8161-4f6e-b1a2-881b3d9fa9dd tempest-VolumeQuotasAdminTestJSON-262467459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8efeb5a0-cb6c-4ff7-88e1-86ede54bbb8f 1073741824" returned: 0 in 1.608s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:06:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ef046dfa-8161-4f6e-b1a2-881b3d9fa9dd tempest-VolumeQuotasAdminTestJSON-262467459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8efeb5a0-cb6c-4ff7-88e1-86ede54bbb8f {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:06:49 devstack sudo[91910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8efeb5a0-cb6c-4ff7-88e1-86ede54bbb8f Jul 10 10:06:49 devstack sudo[91910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:06:50 devstack sudo[91910]: pam_unix(sudo:session): session closed for user root Jul 10 10:06:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ef046dfa-8161-4f6e-b1a2-881b3d9fa9dd tempest-VolumeQuotasAdminTestJSON-262467459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8efeb5a0-cb6c-4ff7-88e1-86ede54bbb8f" returned: 0 in 1.026s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:06:50 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-ef046dfa-8161-4f6e-b1a2-881b3d9fa9dd tempest-VolumeQuotasAdminTestJSON-262467459 None] <== create_volume: return (2747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:06:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-ef046dfa-8161-4f6e-b1a2-881b3d9fa9dd tempest-VolumeQuotasAdminTestJSON-262467459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.753s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:06:50 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ef046dfa-8161-4f6e-b1a2-881b3d9fa9dd tempest-VolumeQuotasAdminTestJSON-262467459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d287d98b-69d6-429c-8d22-0110a6e0156f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8efeb5a0-cb6c-4ff7-88e1-86ede54bbb8f', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:06:50 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ef046dfa-8161-4f6e-b1a2-881b3d9fa9dd tempest-VolumeQuotasAdminTestJSON-262467459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1118aea-e2de-4693-9f2c-1845b7e05987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:06:50 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-ef046dfa-8161-4f6e-b1a2-881b3d9fa9dd tempest-VolumeQuotasAdminTestJSON-262467459 None] Volume volume-8efeb5a0-cb6c-4ff7-88e1-86ede54bbb8f (8efeb5a0-cb6c-4ff7-88e1-86ede54bbb8f): created successfully Jul 10 10:06:50 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ef046dfa-8161-4f6e-b1a2-881b3d9fa9dd tempest-VolumeQuotasAdminTestJSON-262467459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1118aea-e2de-4693-9f2c-1845b7e05987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:06:50 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ef046dfa-8161-4f6e-b1a2-881b3d9fa9dd tempest-VolumeQuotasAdminTestJSON-262467459 None] Flow 'volume_create_manager' (2fef999b-c761-4734-a520-8a55846af788) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:06:50 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-ef046dfa-8161-4f6e-b1a2-881b3d9fa9dd tempest-VolumeQuotasAdminTestJSON-262467459 None] Created volume successfully. Jul 10 10:06:52 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-8781b3e8-767f-4c23-97c9-f0bd369f782a tempest-VolumeQuotasAdminTestJSON-1893134818 None] Transfer volume completed successfully. Jul 10 10:06:53 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f46bf00a-122e-4ca4-a466-c1877c5f4949 tempest-VolumeQuotasAdminTestJSON-55401679 None] Acquiring lock "cinder-8efeb5a0-cb6c-4ff7-88e1-86ede54bbb8f-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:06:53 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f46bf00a-122e-4ca4-a466-c1877c5f4949 tempest-VolumeQuotasAdminTestJSON-55401679 None] Lock "cinder-8efeb5a0-cb6c-4ff7-88e1-86ede54bbb8f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:06:53 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f46bf00a-122e-4ca4-a466-c1877c5f4949 tempest-VolumeQuotasAdminTestJSON-55401679 None] Acquiring lock "cinder-quobyte-8efeb5a0-cb6c-4ff7-88e1-86ede54bbb8f" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:06:53 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f46bf00a-122e-4ca4-a466-c1877c5f4949 tempest-VolumeQuotasAdminTestJSON-55401679 None] Lock "cinder-quobyte-8efeb5a0-cb6c-4ff7-88e1-86ede54bbb8f" acquired by "delete_volume" :: waited 0.018s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:06:53 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef2f1430-070f-470e-8c7f-941204810c53]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:06:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f46bf00a-122e-4ca4-a466-c1877c5f4949 tempest-VolumeQuotasAdminTestJSON-55401679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8efeb5a0-cb6c-4ff7-88e1-86ede54bbb8f {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:06:53 devstack sudo[91945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8efeb5a0-cb6c-4ff7-88e1-86ede54bbb8f Jul 10 10:06:53 devstack sudo[91945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:06:54 devstack sudo[91945]: pam_unix(sudo:session): session closed for user root Jul 10 10:06:54 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f46bf00a-122e-4ca4-a466-c1877c5f4949 tempest-VolumeQuotasAdminTestJSON-55401679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8efeb5a0-cb6c-4ff7-88e1-86ede54bbb8f" returned: 0 in 0.793s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:06:54 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f46bf00a-122e-4ca4-a466-c1877c5f4949 tempest-VolumeQuotasAdminTestJSON-55401679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8efeb5a0-cb6c-4ff7-88e1-86ede54bbb8f {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:06:54 devstack sudo[91952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8efeb5a0-cb6c-4ff7-88e1-86ede54bbb8f Jul 10 10:06:54 devstack sudo[91952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:06:55 devstack sudo[91952]: pam_unix(sudo:session): session closed for user root Jul 10 10:06:55 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f46bf00a-122e-4ca4-a466-c1877c5f4949 tempest-VolumeQuotasAdminTestJSON-55401679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8efeb5a0-cb6c-4ff7-88e1-86ede54bbb8f" returned: 0 in 0.724s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:06:55 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f46bf00a-122e-4ca4-a466-c1877c5f4949 tempest-VolumeQuotasAdminTestJSON-55401679 None] Lock "cinder-quobyte-8efeb5a0-cb6c-4ff7-88e1-86ede54bbb8f" released by "delete_volume" :: held 1.571s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:06:55 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-f46bf00a-122e-4ca4-a466-c1877c5f4949 tempest-VolumeQuotasAdminTestJSON-55401679 None] Created reservations ['f43766fc-cc2c-4e75-ab67-47fe020ca4e8', '07b9eb96-d5b7-4532-b928-b64bc6c3b1d5', '296f0cad-b999-4f56-93e8-609a767e915a', '816ab212-50c4-4994-8c23-35a4c3ca16c5'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:06:55 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f46bf00a-122e-4ca4-a466-c1877c5f4949 tempest-VolumeQuotasAdminTestJSON-55401679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:06:55 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f46bf00a-122e-4ca4-a466-c1877c5f4949 tempest-VolumeQuotasAdminTestJSON-55401679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:06:55 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f46bf00a-122e-4ca4-a466-c1877c5f4949 tempest-VolumeQuotasAdminTestJSON-55401679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:06:55 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f46bf00a-122e-4ca4-a466-c1877c5f4949 tempest-VolumeQuotasAdminTestJSON-55401679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:06:55 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f46bf00a-122e-4ca4-a466-c1877c5f4949 tempest-VolumeQuotasAdminTestJSON-55401679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:06:55 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f46bf00a-122e-4ca4-a466-c1877c5f4949 tempest-VolumeQuotasAdminTestJSON-55401679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:06:55 devstack sudo[91955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:06:55 devstack sudo[91955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:06:56 devstack sudo[91955]: pam_unix(sudo:session): session closed for user root Jul 10 10:06:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f46bf00a-122e-4ca4-a466-c1877c5f4949 tempest-VolumeQuotasAdminTestJSON-55401679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.986s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:06:56 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-f46bf00a-122e-4ca4-a466-c1877c5f4949 tempest-VolumeQuotasAdminTestJSON-55401679 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:06:56 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-f46bf00a-122e-4ca4-a466-c1877c5f4949 tempest-VolumeQuotasAdminTestJSON-55401679 None] Deleted volume successfully. Jul 10 10:06:56 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f46bf00a-122e-4ca4-a466-c1877c5f4949 tempest-VolumeQuotasAdminTestJSON-55401679 None] Lock "cinder-8efeb5a0-cb6c-4ff7-88e1-86ede54bbb8f-delete_volume" released by "delete_volume" :: held 2.799s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:07:04 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-dff3ffc3-a4e8-4f64-a74c-611d62c9f664 tempest-ServerRescueNegativeTestJSON-1141696391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:07:04 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-dff3ffc3-a4e8-4f64-a74c-611d62c9f664 tempest-ServerRescueNegativeTestJSON-1141696391 None] Flow 'volume_create_manager' (1f252d5d-1edb-4dfc-b70c-c7400feb2b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:07:04 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-dff3ffc3-a4e8-4f64-a74c-611d62c9f664 tempest-ServerRescueNegativeTestJSON-1141696391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (509a1cd8-a637-434a-a06b-722a381240e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:07:04 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-dff3ffc3-a4e8-4f64-a74c-611d62c9f664 tempest-ServerRescueNegativeTestJSON-1141696391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (509a1cd8-a637-434a-a06b-722a381240e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:07:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-978516293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f1f3b1c-4fd4-4848-a297-ffd31f7a2880,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19896c3c225e4420b8a42ebc83f35ed0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:07:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:07:04Z,use_quota=True,user_id='02fbc4f0e3814e2f99cb72ec714b41a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:07:04 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-dff3ffc3-a4e8-4f64-a74c-611d62c9f664 tempest-ServerRescueNegativeTestJSON-1141696391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b2b3b73-e7a1-4289-9d68-aa058f097f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:07:04 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-dff3ffc3-a4e8-4f64-a74c-611d62c9f664 tempest-ServerRescueNegativeTestJSON-1141696391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b2b3b73-e7a1-4289-9d68-aa058f097f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:07:04 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-dff3ffc3-a4e8-4f64-a74c-611d62c9f664 tempest-ServerRescueNegativeTestJSON-1141696391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b579ed4e-136d-43a6-97e0-d7d0bebf0b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:07:04 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-dff3ffc3-a4e8-4f64-a74c-611d62c9f664 tempest-ServerRescueNegativeTestJSON-1141696391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b579ed4e-136d-43a6-97e0-d7d0bebf0b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f1f3b1c-4fd4-4848-a297-ffd31f7a2880', 'volume_name': 'volume-7f1f3b1c-4fd4-4848-a297-ffd31f7a2880', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:07:04 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-dff3ffc3-a4e8-4f64-a74c-611d62c9f664 tempest-ServerRescueNegativeTestJSON-1141696391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (350dcb90-2257-4b68-a6b6-7c77cd1a7b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:07:04 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-dff3ffc3-a4e8-4f64-a74c-611d62c9f664 tempest-ServerRescueNegativeTestJSON-1141696391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (350dcb90-2257-4b68-a6b6-7c77cd1a7b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:07:04 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-dff3ffc3-a4e8-4f64-a74c-611d62c9f664 tempest-ServerRescueNegativeTestJSON-1141696391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f25da308-fd75-4af0-b8c4-40d71494ca6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:07:04 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-dff3ffc3-a4e8-4f64-a74c-611d62c9f664 tempest-ServerRescueNegativeTestJSON-1141696391 None] Volume 7f1f3b1c-4fd4-4848-a297-ffd31f7a2880: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f1f3b1c-4fd4-4848-a297-ffd31f7a2880', 'volume_size': 1} Jul 10 10:07:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-dff3ffc3-a4e8-4f64-a74c-611d62c9f664 tempest-ServerRescueNegativeTestJSON-1141696391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:07:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-dff3ffc3-a4e8-4f64-a74c-611d62c9f664 tempest-ServerRescueNegativeTestJSON-1141696391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:07:04 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-dff3ffc3-a4e8-4f64-a74c-611d62c9f664 tempest-ServerRescueNegativeTestJSON-1141696391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:07:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-978516293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f1f3b1c-4fd4-4848-a297-ffd31f7a2880,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19896c3c225e4420b8a42ebc83f35ed0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:07:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:07:04Z,use_quota=True,user_id='02fbc4f0e3814e2f99cb72ec714b41a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:07:04 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-dff3ffc3-a4e8-4f64-a74c-611d62c9f664 tempest-ServerRescueNegativeTestJSON-1141696391 None] Creating volume 7f1f3b1c-4fd4-4848-a297-ffd31f7a2880 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:07:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-dff3ffc3-a4e8-4f64-a74c-611d62c9f664 tempest-ServerRescueNegativeTestJSON-1141696391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:07:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-dff3ffc3-a4e8-4f64-a74c-611d62c9f664 tempest-ServerRescueNegativeTestJSON-1141696391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:07:04 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-dff3ffc3-a4e8-4f64-a74c-611d62c9f664 tempest-ServerRescueNegativeTestJSON-1141696391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:07:04 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-dff3ffc3-a4e8-4f64-a74c-611d62c9f664 tempest-ServerRescueNegativeTestJSON-1141696391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:07:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-dff3ffc3-a4e8-4f64-a74c-611d62c9f664 tempest-ServerRescueNegativeTestJSON-1141696391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:07:04 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-dff3ffc3-a4e8-4f64-a74c-611d62c9f664 tempest-ServerRescueNegativeTestJSON-1141696391 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:07:04 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-dff3ffc3-a4e8-4f64-a74c-611d62c9f664 tempest-ServerRescueNegativeTestJSON-1141696391 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:07:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-dff3ffc3-a4e8-4f64-a74c-611d62c9f664 tempest-ServerRescueNegativeTestJSON-1141696391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7f1f3b1c-4fd4-4848-a297-ffd31f7a2880 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:07:04 devstack sudo[92001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7f1f3b1c-4fd4-4848-a297-ffd31f7a2880 1073741824 Jul 10 10:07:04 devstack sudo[92001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:07:05 devstack sudo[92001]: pam_unix(sudo:session): session closed for user root Jul 10 10:07:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-dff3ffc3-a4e8-4f64-a74c-611d62c9f664 tempest-ServerRescueNegativeTestJSON-1141696391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7f1f3b1c-4fd4-4848-a297-ffd31f7a2880 1073741824" returned: 0 in 1.297s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:07:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-dff3ffc3-a4e8-4f64-a74c-611d62c9f664 tempest-ServerRescueNegativeTestJSON-1141696391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7f1f3b1c-4fd4-4848-a297-ffd31f7a2880 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:07:05 devstack sudo[92010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7f1f3b1c-4fd4-4848-a297-ffd31f7a2880 Jul 10 10:07:05 devstack sudo[92010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:07:06 devstack sudo[92010]: pam_unix(sudo:session): session closed for user root Jul 10 10:07:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-dff3ffc3-a4e8-4f64-a74c-611d62c9f664 tempest-ServerRescueNegativeTestJSON-1141696391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7f1f3b1c-4fd4-4848-a297-ffd31f7a2880" returned: 0 in 0.832s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:07:06 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-dff3ffc3-a4e8-4f64-a74c-611d62c9f664 tempest-ServerRescueNegativeTestJSON-1141696391 None] <== create_volume: return (2203ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:07:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-dff3ffc3-a4e8-4f64-a74c-611d62c9f664 tempest-ServerRescueNegativeTestJSON-1141696391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.205s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:07:06 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-dff3ffc3-a4e8-4f64-a74c-611d62c9f664 tempest-ServerRescueNegativeTestJSON-1141696391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f25da308-fd75-4af0-b8c4-40d71494ca6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f1f3b1c-4fd4-4848-a297-ffd31f7a2880', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:07:06 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-dff3ffc3-a4e8-4f64-a74c-611d62c9f664 tempest-ServerRescueNegativeTestJSON-1141696391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6b7f1a4-2beb-413c-8bd7-d672e19df336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:07:06 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-dff3ffc3-a4e8-4f64-a74c-611d62c9f664 tempest-ServerRescueNegativeTestJSON-1141696391 None] Volume volume-7f1f3b1c-4fd4-4848-a297-ffd31f7a2880 (7f1f3b1c-4fd4-4848-a297-ffd31f7a2880): created successfully Jul 10 10:07:06 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-dff3ffc3-a4e8-4f64-a74c-611d62c9f664 tempest-ServerRescueNegativeTestJSON-1141696391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6b7f1a4-2beb-413c-8bd7-d672e19df336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:07:06 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-dff3ffc3-a4e8-4f64-a74c-611d62c9f664 tempest-ServerRescueNegativeTestJSON-1141696391 None] Flow 'volume_create_manager' (1f252d5d-1edb-4dfc-b70c-c7400feb2b50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:07:06 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-dff3ffc3-a4e8-4f64-a74c-611d62c9f664 tempest-ServerRescueNegativeTestJSON-1141696391 None] Created volume successfully. Jul 10 10:07:10 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5dc9fdb-fb48-401a-a791-49e0d227d57c tempest-VolumeRetypeWithoutMigrationTest-579401005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:07:10 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f5dc9fdb-fb48-401a-a791-49e0d227d57c tempest-VolumeRetypeWithoutMigrationTest-579401005 None] Flow 'volume_create_manager' (55dd926e-c77f-46f3-9f05-09312c9b2106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:07:10 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f5dc9fdb-fb48-401a-a791-49e0d227d57c tempest-VolumeRetypeWithoutMigrationTest-579401005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e162e356-c260-4497-b928-3514e62e6716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:07:10 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f5dc9fdb-fb48-401a-a791-49e0d227d57c tempest-VolumeRetypeWithoutMigrationTest-579401005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e162e356-c260-4497-b928-3514e62e6716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:07:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-785159532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64cf6984-9516-4016-a44b-4661b4861f29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a180cb8fcaf4f65bfcc8822fdc84a81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:07:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:07:10Z,use_quota=True,user_id='e37ce5cae8c04bdb9767beec8a478694',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a46fc94-5e78-4f49-8e2a-96bc24795139),volume_type_id=4a46fc94-5e78-4f49-8e2a-96bc24795139)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:07:10 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f5dc9fdb-fb48-401a-a791-49e0d227d57c tempest-VolumeRetypeWithoutMigrationTest-579401005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (515d2be6-09c7-49d8-94eb-57b9ec428719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:07:10 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f5dc9fdb-fb48-401a-a791-49e0d227d57c tempest-VolumeRetypeWithoutMigrationTest-579401005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (515d2be6-09c7-49d8-94eb-57b9ec428719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:07:10 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f5dc9fdb-fb48-401a-a791-49e0d227d57c tempest-VolumeRetypeWithoutMigrationTest-579401005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d3f0a7e-cd17-4efa-a1c5-41aa11814945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:07:10 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f5dc9fdb-fb48-401a-a791-49e0d227d57c tempest-VolumeRetypeWithoutMigrationTest-579401005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d3f0a7e-cd17-4efa-a1c5-41aa11814945) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64cf6984-9516-4016-a44b-4661b4861f29', 'volume_name': 'volume-64cf6984-9516-4016-a44b-4661b4861f29', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:07:10 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f5dc9fdb-fb48-401a-a791-49e0d227d57c tempest-VolumeRetypeWithoutMigrationTest-579401005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0af0b5f3-9375-4599-b548-b64b138eecb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:07:10 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f5dc9fdb-fb48-401a-a791-49e0d227d57c tempest-VolumeRetypeWithoutMigrationTest-579401005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0af0b5f3-9375-4599-b548-b64b138eecb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:07:10 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f5dc9fdb-fb48-401a-a791-49e0d227d57c tempest-VolumeRetypeWithoutMigrationTest-579401005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (697110c5-be36-4cc0-9a9e-a46703278151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:07:10 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-f5dc9fdb-fb48-401a-a791-49e0d227d57c tempest-VolumeRetypeWithoutMigrationTest-579401005 None] Volume 64cf6984-9516-4016-a44b-4661b4861f29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64cf6984-9516-4016-a44b-4661b4861f29', 'volume_size': 1} Jul 10 10:07:10 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f5dc9fdb-fb48-401a-a791-49e0d227d57c tempest-VolumeRetypeWithoutMigrationTest-579401005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:07:10 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f5dc9fdb-fb48-401a-a791-49e0d227d57c tempest-VolumeRetypeWithoutMigrationTest-579401005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:07:10 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f5dc9fdb-fb48-401a-a791-49e0d227d57c tempest-VolumeRetypeWithoutMigrationTest-579401005 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:07:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-785159532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64cf6984-9516-4016-a44b-4661b4861f29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a180cb8fcaf4f65bfcc8822fdc84a81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:07:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:07:10Z,use_quota=True,user_id='e37ce5cae8c04bdb9767beec8a478694',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a46fc94-5e78-4f49-8e2a-96bc24795139),volume_type_id=4a46fc94-5e78-4f49-8e2a-96bc24795139)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:07:10 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-f5dc9fdb-fb48-401a-a791-49e0d227d57c tempest-VolumeRetypeWithoutMigrationTest-579401005 None] Creating volume 64cf6984-9516-4016-a44b-4661b4861f29 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:07:10 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f5dc9fdb-fb48-401a-a791-49e0d227d57c tempest-VolumeRetypeWithoutMigrationTest-579401005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:07:10 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f5dc9fdb-fb48-401a-a791-49e0d227d57c tempest-VolumeRetypeWithoutMigrationTest-579401005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:07:10 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f5dc9fdb-fb48-401a-a791-49e0d227d57c tempest-VolumeRetypeWithoutMigrationTest-579401005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:07:10 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f5dc9fdb-fb48-401a-a791-49e0d227d57c tempest-VolumeRetypeWithoutMigrationTest-579401005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:07:10 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f5dc9fdb-fb48-401a-a791-49e0d227d57c tempest-VolumeRetypeWithoutMigrationTest-579401005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:07:10 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f5dc9fdb-fb48-401a-a791-49e0d227d57c tempest-VolumeRetypeWithoutMigrationTest-579401005 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:07:10 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-f5dc9fdb-fb48-401a-a791-49e0d227d57c tempest-VolumeRetypeWithoutMigrationTest-579401005 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:07:10 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f5dc9fdb-fb48-401a-a791-49e0d227d57c tempest-VolumeRetypeWithoutMigrationTest-579401005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-64cf6984-9516-4016-a44b-4661b4861f29 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:07:10 devstack sudo[92115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-64cf6984-9516-4016-a44b-4661b4861f29 1073741824 Jul 10 10:07:10 devstack sudo[92115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:07:11 devstack sudo[92115]: pam_unix(sudo:session): session closed for user root Jul 10 10:07:11 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f5dc9fdb-fb48-401a-a791-49e0d227d57c tempest-VolumeRetypeWithoutMigrationTest-579401005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-64cf6984-9516-4016-a44b-4661b4861f29 1073741824" returned: 0 in 1.116s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:07:11 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f5dc9fdb-fb48-401a-a791-49e0d227d57c tempest-VolumeRetypeWithoutMigrationTest-579401005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-64cf6984-9516-4016-a44b-4661b4861f29 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:07:11 devstack sudo[92151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-64cf6984-9516-4016-a44b-4661b4861f29 Jul 10 10:07:11 devstack sudo[92151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:07:12 devstack sudo[92151]: pam_unix(sudo:session): session closed for user root Jul 10 10:07:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f5dc9fdb-fb48-401a-a791-49e0d227d57c tempest-VolumeRetypeWithoutMigrationTest-579401005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-64cf6984-9516-4016-a44b-4661b4861f29" returned: 0 in 0.727s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:07:12 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f5dc9fdb-fb48-401a-a791-49e0d227d57c tempest-VolumeRetypeWithoutMigrationTest-579401005 None] <== create_volume: return (1893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:07:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f5dc9fdb-fb48-401a-a791-49e0d227d57c tempest-VolumeRetypeWithoutMigrationTest-579401005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.895s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:07:12 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f5dc9fdb-fb48-401a-a791-49e0d227d57c tempest-VolumeRetypeWithoutMigrationTest-579401005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (697110c5-be36-4cc0-9a9e-a46703278151) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64cf6984-9516-4016-a44b-4661b4861f29', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:07:12 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f5dc9fdb-fb48-401a-a791-49e0d227d57c tempest-VolumeRetypeWithoutMigrationTest-579401005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c36b11e-8e8e-40e9-b4f1-987cd7e94320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:07:12 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-f5dc9fdb-fb48-401a-a791-49e0d227d57c tempest-VolumeRetypeWithoutMigrationTest-579401005 None] Volume volume-64cf6984-9516-4016-a44b-4661b4861f29 (64cf6984-9516-4016-a44b-4661b4861f29): created successfully Jul 10 10:07:12 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f5dc9fdb-fb48-401a-a791-49e0d227d57c tempest-VolumeRetypeWithoutMigrationTest-579401005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c36b11e-8e8e-40e9-b4f1-987cd7e94320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:07:12 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f5dc9fdb-fb48-401a-a791-49e0d227d57c tempest-VolumeRetypeWithoutMigrationTest-579401005 None] Flow 'volume_create_manager' (55dd926e-c77f-46f3-9f05-09312c9b2106) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:07:12 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-f5dc9fdb-fb48-401a-a791-49e0d227d57c tempest-VolumeRetypeWithoutMigrationTest-579401005 None] Created volume successfully. Jul 10 10:07:13 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-181a6df1-a956-4c9a-aab5-3f49d276c860 tempest-VolumeRetypeWithoutMigrationTest-579401005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:07:13 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-181a6df1-a956-4c9a-aab5-3f49d276c860 tempest-VolumeRetypeWithoutMigrationTest-579401005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:07:13 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-181a6df1-a956-4c9a-aab5-3f49d276c860 tempest-VolumeRetypeWithoutMigrationTest-579401005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:07:13 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-181a6df1-a956-4c9a-aab5-3f49d276c860 tempest-VolumeRetypeWithoutMigrationTest-579401005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:07:13 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-181a6df1-a956-4c9a-aab5-3f49d276c860 tempest-VolumeRetypeWithoutMigrationTest-579401005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:07:13 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-181a6df1-a956-4c9a-aab5-3f49d276c860 tempest-VolumeRetypeWithoutMigrationTest-579401005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:07:13 devstack sudo[92164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:07:13 devstack sudo[92164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:07:14 devstack sudo[92164]: pam_unix(sudo:session): session closed for user root Jul 10 10:07:14 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-181a6df1-a956-4c9a-aab5-3f49d276c860 tempest-VolumeRetypeWithoutMigrationTest-579401005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 1.163s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:07:14 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-181a6df1-a956-4c9a-aab5-3f49d276c860 tempest-VolumeRetypeWithoutMigrationTest-579401005 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:07:14 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-181a6df1-a956-4c9a-aab5-3f49d276c860 tempest-VolumeRetypeWithoutMigrationTest-579401005 None] Retype volume completed successfully. Jul 10 10:07:15 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-fc3ac17f-cf5a-412c-9d4b-d7fed5270213 tempest-VolumeRetypeWithoutMigrationTest-579401005 None] Acquiring lock "cinder-64cf6984-9516-4016-a44b-4661b4861f29-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:07:15 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-fc3ac17f-cf5a-412c-9d4b-d7fed5270213 tempest-VolumeRetypeWithoutMigrationTest-579401005 None] Lock "cinder-64cf6984-9516-4016-a44b-4661b4861f29-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:07:15 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-fc3ac17f-cf5a-412c-9d4b-d7fed5270213 tempest-VolumeRetypeWithoutMigrationTest-579401005 None] Acquiring lock "cinder-quobyte-64cf6984-9516-4016-a44b-4661b4861f29" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:07:15 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-fc3ac17f-cf5a-412c-9d4b-d7fed5270213 tempest-VolumeRetypeWithoutMigrationTest-579401005 None] Lock "cinder-quobyte-64cf6984-9516-4016-a44b-4661b4861f29" acquired by "delete_volume" :: waited 0.032s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:07:15 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea95b285-379c-437c-8237-63c5a3527dbf]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:07:15 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fc3ac17f-cf5a-412c-9d4b-d7fed5270213 tempest-VolumeRetypeWithoutMigrationTest-579401005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-64cf6984-9516-4016-a44b-4661b4861f29 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:07:15 devstack sudo[92172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-64cf6984-9516-4016-a44b-4661b4861f29 Jul 10 10:07:15 devstack sudo[92172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:07:16 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bd9798a-8e7d-40da-83e0-7f024ae6d08d tempest-VolumesActionsTest-1820532270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:07:16 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9bd9798a-8e7d-40da-83e0-7f024ae6d08d tempest-VolumesActionsTest-1820532270 None] Flow 'volume_create_manager' (437f1262-95e5-4f4a-93aa-67305ce46bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:07:16 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9bd9798a-8e7d-40da-83e0-7f024ae6d08d tempest-VolumesActionsTest-1820532270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7ce5579-c14d-4c72-bc31-86acc0e8e632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:07:16 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9bd9798a-8e7d-40da-83e0-7f024ae6d08d tempest-VolumesActionsTest-1820532270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7ce5579-c14d-4c72-bc31-86acc0e8e632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:07:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-396957655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06917060-0aac-4f46-b335-6590c70a019c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881f973d09a7486899687543f9cb7ed4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:07:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:07:16Z,use_quota=True,user_id='35ac5cc870c949268bc6158db3b1f77a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:07:16 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9bd9798a-8e7d-40da-83e0-7f024ae6d08d tempest-VolumesActionsTest-1820532270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a3efa93-3761-4340-b09e-d810c6f6a6d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:07:16 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9bd9798a-8e7d-40da-83e0-7f024ae6d08d tempest-VolumesActionsTest-1820532270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a3efa93-3761-4340-b09e-d810c6f6a6d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:07:16 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9bd9798a-8e7d-40da-83e0-7f024ae6d08d tempest-VolumesActionsTest-1820532270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d6fa188-0f13-45fe-a2d7-dda8303936e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:07:16 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9bd9798a-8e7d-40da-83e0-7f024ae6d08d tempest-VolumesActionsTest-1820532270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d6fa188-0f13-45fe-a2d7-dda8303936e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06917060-0aac-4f46-b335-6590c70a019c', 'volume_name': 'volume-06917060-0aac-4f46-b335-6590c70a019c', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:07:16 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9bd9798a-8e7d-40da-83e0-7f024ae6d08d tempest-VolumesActionsTest-1820532270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7218ed37-38e6-4f3e-9048-89427729b673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:07:16 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9bd9798a-8e7d-40da-83e0-7f024ae6d08d tempest-VolumesActionsTest-1820532270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7218ed37-38e6-4f3e-9048-89427729b673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:07:16 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9bd9798a-8e7d-40da-83e0-7f024ae6d08d tempest-VolumesActionsTest-1820532270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10743e24-da16-4484-8af4-9327a7ce6e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:07:16 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-9bd9798a-8e7d-40da-83e0-7f024ae6d08d tempest-VolumesActionsTest-1820532270 None] Volume 06917060-0aac-4f46-b335-6590c70a019c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06917060-0aac-4f46-b335-6590c70a019c', 'volume_size': 1} Jul 10 10:07:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-9bd9798a-8e7d-40da-83e0-7f024ae6d08d tempest-VolumesActionsTest-1820532270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:07:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-9bd9798a-8e7d-40da-83e0-7f024ae6d08d tempest-VolumesActionsTest-1820532270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:07:16 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-9bd9798a-8e7d-40da-83e0-7f024ae6d08d tempest-VolumesActionsTest-1820532270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:07:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-396957655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06917060-0aac-4f46-b335-6590c70a019c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881f973d09a7486899687543f9cb7ed4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:07:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:07:16Z,use_quota=True,user_id='35ac5cc870c949268bc6158db3b1f77a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:07:16 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-9bd9798a-8e7d-40da-83e0-7f024ae6d08d tempest-VolumesActionsTest-1820532270 None] Creating volume 06917060-0aac-4f46-b335-6590c70a019c {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:07:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-9bd9798a-8e7d-40da-83e0-7f024ae6d08d tempest-VolumesActionsTest-1820532270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:07:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-9bd9798a-8e7d-40da-83e0-7f024ae6d08d tempest-VolumesActionsTest-1820532270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:07:16 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-9bd9798a-8e7d-40da-83e0-7f024ae6d08d tempest-VolumesActionsTest-1820532270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:07:16 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-9bd9798a-8e7d-40da-83e0-7f024ae6d08d tempest-VolumesActionsTest-1820532270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:07:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-9bd9798a-8e7d-40da-83e0-7f024ae6d08d tempest-VolumesActionsTest-1820532270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:07:16 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-9bd9798a-8e7d-40da-83e0-7f024ae6d08d tempest-VolumesActionsTest-1820532270 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:07:16 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-9bd9798a-8e7d-40da-83e0-7f024ae6d08d tempest-VolumesActionsTest-1820532270 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:07:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9bd9798a-8e7d-40da-83e0-7f024ae6d08d tempest-VolumesActionsTest-1820532270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-06917060-0aac-4f46-b335-6590c70a019c 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:07:16 devstack sudo[92186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-06917060-0aac-4f46-b335-6590c70a019c 1073741824 Jul 10 10:07:16 devstack sudo[92186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:07:17 devstack sudo[92172]: pam_unix(sudo:session): session closed for user root Jul 10 10:07:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fc3ac17f-cf5a-412c-9d4b-d7fed5270213 tempest-VolumeRetypeWithoutMigrationTest-579401005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-64cf6984-9516-4016-a44b-4661b4861f29" returned: 0 in 1.846s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:07:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fc3ac17f-cf5a-412c-9d4b-d7fed5270213 tempest-VolumeRetypeWithoutMigrationTest-579401005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-64cf6984-9516-4016-a44b-4661b4861f29 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:07:17 devstack sudo[92198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-64cf6984-9516-4016-a44b-4661b4861f29 Jul 10 10:07:17 devstack sudo[92198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:07:18 devstack sudo[92186]: pam_unix(sudo:session): session closed for user root Jul 10 10:07:18 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9bd9798a-8e7d-40da-83e0-7f024ae6d08d tempest-VolumesActionsTest-1820532270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-06917060-0aac-4f46-b335-6590c70a019c 1073741824" returned: 0 in 1.751s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:07:18 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9bd9798a-8e7d-40da-83e0-7f024ae6d08d tempest-VolumesActionsTest-1820532270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-06917060-0aac-4f46-b335-6590c70a019c {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:07:18 devstack sudo[92227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-06917060-0aac-4f46-b335-6590c70a019c Jul 10 10:07:18 devstack sudo[92227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:07:18 devstack sudo[92198]: pam_unix(sudo:session): session closed for user root Jul 10 10:07:18 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fc3ac17f-cf5a-412c-9d4b-d7fed5270213 tempest-VolumeRetypeWithoutMigrationTest-579401005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-64cf6984-9516-4016-a44b-4661b4861f29" returned: 0 in 1.384s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:07:18 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-fc3ac17f-cf5a-412c-9d4b-d7fed5270213 tempest-VolumeRetypeWithoutMigrationTest-579401005 None] Lock "cinder-quobyte-64cf6984-9516-4016-a44b-4661b4861f29" released by "delete_volume" :: held 3.360s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:07:18 devstack cinder-volume[87234]: WARNING cinder.quota [None req-fc3ac17f-cf5a-412c-9d4b-d7fed5270213 tempest-VolumeRetypeWithoutMigrationTest-579401005 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 10 10:07:18 devstack cinder-volume[87234]: WARNING cinder.quota [None req-fc3ac17f-cf5a-412c-9d4b-d7fed5270213 tempest-VolumeRetypeWithoutMigrationTest-579401005 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 10 10:07:18 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-fc3ac17f-cf5a-412c-9d4b-d7fed5270213 tempest-VolumeRetypeWithoutMigrationTest-579401005 None] Created reservations ['78d72d14-0453-4b9c-b4be-b3c56f176496', '02bdc670-714a-4288-852a-bc1e358e9ef4', 'ede3f39a-5c4c-4003-a06d-b1926a88119f', '6a5a848f-2ddd-4d78-b0d9-65e96c9942e2'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:07:18 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-fc3ac17f-cf5a-412c-9d4b-d7fed5270213 tempest-VolumeRetypeWithoutMigrationTest-579401005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:07:18 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-fc3ac17f-cf5a-412c-9d4b-d7fed5270213 tempest-VolumeRetypeWithoutMigrationTest-579401005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:07:18 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-fc3ac17f-cf5a-412c-9d4b-d7fed5270213 tempest-VolumeRetypeWithoutMigrationTest-579401005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:07:18 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-fc3ac17f-cf5a-412c-9d4b-d7fed5270213 tempest-VolumeRetypeWithoutMigrationTest-579401005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:07:18 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-fc3ac17f-cf5a-412c-9d4b-d7fed5270213 tempest-VolumeRetypeWithoutMigrationTest-579401005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:07:18 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fc3ac17f-cf5a-412c-9d4b-d7fed5270213 tempest-VolumeRetypeWithoutMigrationTest-579401005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:07:18 devstack sudo[92231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:07:18 devstack sudo[92231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:07:19 devstack sudo[92227]: pam_unix(sudo:session): session closed for user root Jul 10 10:07:19 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9bd9798a-8e7d-40da-83e0-7f024ae6d08d tempest-VolumesActionsTest-1820532270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-06917060-0aac-4f46-b335-6590c70a019c" returned: 0 in 1.180s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:07:19 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-9bd9798a-8e7d-40da-83e0-7f024ae6d08d tempest-VolumesActionsTest-1820532270 None] <== create_volume: return (3058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:07:19 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-9bd9798a-8e7d-40da-83e0-7f024ae6d08d tempest-VolumesActionsTest-1820532270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.061s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:07:19 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9bd9798a-8e7d-40da-83e0-7f024ae6d08d tempest-VolumesActionsTest-1820532270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10743e24-da16-4484-8af4-9327a7ce6e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06917060-0aac-4f46-b335-6590c70a019c', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:07:19 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9bd9798a-8e7d-40da-83e0-7f024ae6d08d tempest-VolumesActionsTest-1820532270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0664938c-c708-4ee0-bbfb-54b091e0cb1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:07:19 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-9bd9798a-8e7d-40da-83e0-7f024ae6d08d tempest-VolumesActionsTest-1820532270 None] Volume volume-06917060-0aac-4f46-b335-6590c70a019c (06917060-0aac-4f46-b335-6590c70a019c): created successfully Jul 10 10:07:19 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9bd9798a-8e7d-40da-83e0-7f024ae6d08d tempest-VolumesActionsTest-1820532270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0664938c-c708-4ee0-bbfb-54b091e0cb1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:07:19 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9bd9798a-8e7d-40da-83e0-7f024ae6d08d tempest-VolumesActionsTest-1820532270 None] Flow 'volume_create_manager' (437f1262-95e5-4f4a-93aa-67305ce46bfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:07:19 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-9bd9798a-8e7d-40da-83e0-7f024ae6d08d tempest-VolumesActionsTest-1820532270 None] Created volume successfully. Jul 10 10:07:19 devstack sudo[92231]: pam_unix(sudo:session): session closed for user root Jul 10 10:07:19 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fc3ac17f-cf5a-412c-9d4b-d7fed5270213 tempest-VolumeRetypeWithoutMigrationTest-579401005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.852s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:07:19 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-fc3ac17f-cf5a-412c-9d4b-d7fed5270213 tempest-VolumeRetypeWithoutMigrationTest-579401005 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:07:19 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-fc3ac17f-cf5a-412c-9d4b-d7fed5270213 tempest-VolumeRetypeWithoutMigrationTest-579401005 None] Deleted volume successfully. Jul 10 10:07:19 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-fc3ac17f-cf5a-412c-9d4b-d7fed5270213 tempest-VolumeRetypeWithoutMigrationTest-579401005 None] Lock "cinder-64cf6984-9516-4016-a44b-4661b4861f29-delete_volume" released by "delete_volume" :: held 4.645s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:07:20 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-3e88d3ed-b223-4991-8060-313f60566b6e tempest-VolumesActionsTest-1820532270 None] Acquiring lock "cinder-06917060-0aac-4f46-b335-6590c70a019c" by "attach_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:07:20 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-3e88d3ed-b223-4991-8060-313f60566b6e tempest-VolumesActionsTest-1820532270 None] Lock "cinder-06917060-0aac-4f46-b335-6590c70a019c" acquired by "attach_volume" :: waited 0.040s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:07:20 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-3e88d3ed-b223-4991-8060-313f60566b6e tempest-VolumesActionsTest-1820532270 None] Attaching volume 06917060-0aac-4f46-b335-6590c70a019c to instance e866f3ea-6e69-4f76-b15f-dc20b0d1ec0f at mountpoint /dev/vdb on host None. Jul 10 10:07:20 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-3e88d3ed-b223-4991-8060-313f60566b6e tempest-VolumesActionsTest-1820532270 None] Attach volume completed successfully. Jul 10 10:07:20 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-3e88d3ed-b223-4991-8060-313f60566b6e tempest-VolumesActionsTest-1820532270 None] Lock "cinder-06917060-0aac-4f46-b335-6590c70a019c" released by "attach_volume" :: held 0.279s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:07:22 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-3f99ade4-41b0-4b1d-b652-bb5d91e52e69 tempest-VolumesActionsTest-462141617 None] Terminate volume connection completed successfully. Jul 10 10:07:23 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-3f99ade4-41b0-4b1d-b652-bb5d91e52e69 tempest-VolumesActionsTest-462141617 None] Acquiring lock "cinder-06917060-0aac-4f46-b335-6590c70a019c-detach_volume" by "detach_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:07:23 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-3f99ade4-41b0-4b1d-b652-bb5d91e52e69 tempest-VolumesActionsTest-462141617 None] Lock "cinder-06917060-0aac-4f46-b335-6590c70a019c-detach_volume" acquired by "detach_volume" :: waited 0.052s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:07:23 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-3f99ade4-41b0-4b1d-b652-bb5d91e52e69 tempest-VolumesActionsTest-462141617 None] Detaching volume 06917060-0aac-4f46-b335-6590c70a019c from instance e866f3ea-6e69-4f76-b15f-dc20b0d1ec0f. Jul 10 10:07:23 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-3f99ade4-41b0-4b1d-b652-bb5d91e52e69 tempest-VolumesActionsTest-462141617 None] Detach volume completed successfully. Jul 10 10:07:23 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-3f99ade4-41b0-4b1d-b652-bb5d91e52e69 tempest-VolumesActionsTest-462141617 None] Lock "cinder-06917060-0aac-4f46-b335-6590c70a019c-detach_volume" released by "detach_volume" :: held 0.255s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:07:24 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-29a9ba2e-3993-49c5-b8d9-e40f91cccc85 tempest-VolumesActionsTest-1820532270 None] Acquiring lock "cinder-06917060-0aac-4f46-b335-6590c70a019c-detach_volume" by "detach_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:07:24 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-29a9ba2e-3993-49c5-b8d9-e40f91cccc85 tempest-VolumesActionsTest-1820532270 None] Lock "cinder-06917060-0aac-4f46-b335-6590c70a019c-detach_volume" acquired by "detach_volume" :: waited 0.047s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:07:24 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-29a9ba2e-3993-49c5-b8d9-e40f91cccc85 tempest-VolumesActionsTest-1820532270 None] Volume detach called, but volume not attached. Jul 10 10:07:24 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-29a9ba2e-3993-49c5-b8d9-e40f91cccc85 tempest-VolumesActionsTest-1820532270 None] Lock "cinder-06917060-0aac-4f46-b335-6590c70a019c-detach_volume" released by "detach_volume" :: held 0.044s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:07:25 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-6f0898db-b25f-4ae9-a9d5-66a358c317ef tempest-VolumesActionsTest-1820532270 None] Acquiring lock "cinder-06917060-0aac-4f46-b335-6590c70a019c-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:07:25 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-6f0898db-b25f-4ae9-a9d5-66a358c317ef tempest-VolumesActionsTest-1820532270 None] Lock "cinder-06917060-0aac-4f46-b335-6590c70a019c-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:07:25 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-6f0898db-b25f-4ae9-a9d5-66a358c317ef tempest-VolumesActionsTest-1820532270 None] Acquiring lock "cinder-quobyte-06917060-0aac-4f46-b335-6590c70a019c" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:07:25 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-6f0898db-b25f-4ae9-a9d5-66a358c317ef tempest-VolumesActionsTest-1820532270 None] Lock "cinder-quobyte-06917060-0aac-4f46-b335-6590c70a019c" acquired by "delete_volume" :: waited 0.043s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:07:25 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b575171-ee2a-4834-aea3-a9fb9b178724]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:07:25 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-6f0898db-b25f-4ae9-a9d5-66a358c317ef tempest-VolumesActionsTest-1820532270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-06917060-0aac-4f46-b335-6590c70a019c {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:07:25 devstack sudo[92308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-06917060-0aac-4f46-b335-6590c70a019c Jul 10 10:07:25 devstack sudo[92308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:07:26 devstack sudo[92308]: pam_unix(sudo:session): session closed for user root Jul 10 10:07:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-6f0898db-b25f-4ae9-a9d5-66a358c317ef tempest-VolumesActionsTest-1820532270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-06917060-0aac-4f46-b335-6590c70a019c" returned: 0 in 1.428s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:07:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-6f0898db-b25f-4ae9-a9d5-66a358c317ef tempest-VolumesActionsTest-1820532270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-06917060-0aac-4f46-b335-6590c70a019c {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:07:26 devstack sudo[92362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-06917060-0aac-4f46-b335-6590c70a019c Jul 10 10:07:26 devstack sudo[92362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:07:27 devstack sudo[92362]: pam_unix(sudo:session): session closed for user root Jul 10 10:07:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-6f0898db-b25f-4ae9-a9d5-66a358c317ef tempest-VolumesActionsTest-1820532270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-06917060-0aac-4f46-b335-6590c70a019c" returned: 0 in 0.889s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:07:27 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-6f0898db-b25f-4ae9-a9d5-66a358c317ef tempest-VolumesActionsTest-1820532270 None] Lock "cinder-quobyte-06917060-0aac-4f46-b335-6590c70a019c" released by "delete_volume" :: held 2.391s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:07:27 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-6f0898db-b25f-4ae9-a9d5-66a358c317ef tempest-VolumesActionsTest-1820532270 None] Created reservations ['0836e42a-aee9-48c4-a77a-19d37ab69399', '833415d4-c90e-4cec-8281-93ba6e8c16ba', '6a232ef7-030f-4bb0-a69c-24238293c082', 'f0fe0cad-3753-4de1-a306-f78c5ca9ac3e'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:07:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-6f0898db-b25f-4ae9-a9d5-66a358c317ef tempest-VolumesActionsTest-1820532270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:07:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-6f0898db-b25f-4ae9-a9d5-66a358c317ef tempest-VolumesActionsTest-1820532270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:07:27 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-6f0898db-b25f-4ae9-a9d5-66a358c317ef tempest-VolumesActionsTest-1820532270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:07:27 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-6f0898db-b25f-4ae9-a9d5-66a358c317ef tempest-VolumesActionsTest-1820532270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:07:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-6f0898db-b25f-4ae9-a9d5-66a358c317ef tempest-VolumesActionsTest-1820532270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:07:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-6f0898db-b25f-4ae9-a9d5-66a358c317ef tempest-VolumesActionsTest-1820532270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:07:27 devstack sudo[92365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:07:27 devstack sudo[92365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:07:29 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-307c1452-5aa7-4ca4-bbe1-08cba0e6f3af tempest-ServerRescueNegativeTestJSON-1141696391 None] Acquiring lock "cinder-7f1f3b1c-4fd4-4848-a297-ffd31f7a2880-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:07:29 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-307c1452-5aa7-4ca4-bbe1-08cba0e6f3af tempest-ServerRescueNegativeTestJSON-1141696391 None] Lock "cinder-7f1f3b1c-4fd4-4848-a297-ffd31f7a2880-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:07:29 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-307c1452-5aa7-4ca4-bbe1-08cba0e6f3af tempest-ServerRescueNegativeTestJSON-1141696391 None] Acquiring lock "cinder-quobyte-7f1f3b1c-4fd4-4848-a297-ffd31f7a2880" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:07:29 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-307c1452-5aa7-4ca4-bbe1-08cba0e6f3af tempest-ServerRescueNegativeTestJSON-1141696391 None] Lock "cinder-quobyte-7f1f3b1c-4fd4-4848-a297-ffd31f7a2880" acquired by "delete_volume" :: waited 0.048s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:07:29 devstack sudo[92365]: pam_unix(sudo:session): session closed for user root Jul 10 10:07:29 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-6f0898db-b25f-4ae9-a9d5-66a358c317ef tempest-VolumesActionsTest-1820532270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 1.682s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:07:29 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-6f0898db-b25f-4ae9-a9d5-66a358c317ef tempest-VolumesActionsTest-1820532270 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:07:29 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-6f0898db-b25f-4ae9-a9d5-66a358c317ef tempest-VolumesActionsTest-1820532270 None] Deleted volume successfully. Jul 10 10:07:29 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[beedf2c5-fada-499a-9c81-7ff62474573e]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:07:29 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-307c1452-5aa7-4ca4-bbe1-08cba0e6f3af tempest-ServerRescueNegativeTestJSON-1141696391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7f1f3b1c-4fd4-4848-a297-ffd31f7a2880 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:07:29 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-6f0898db-b25f-4ae9-a9d5-66a358c317ef tempest-VolumesActionsTest-1820532270 None] Lock "cinder-06917060-0aac-4f46-b335-6590c70a019c-delete_volume" released by "delete_volume" :: held 4.470s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:07:29 devstack sudo[92376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7f1f3b1c-4fd4-4848-a297-ffd31f7a2880 Jul 10 10:07:29 devstack sudo[92376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:07:31 devstack sudo[92376]: pam_unix(sudo:session): session closed for user root Jul 10 10:07:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-307c1452-5aa7-4ca4-bbe1-08cba0e6f3af tempest-ServerRescueNegativeTestJSON-1141696391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7f1f3b1c-4fd4-4848-a297-ffd31f7a2880" returned: 0 in 1.823s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:07:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-307c1452-5aa7-4ca4-bbe1-08cba0e6f3af tempest-ServerRescueNegativeTestJSON-1141696391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7f1f3b1c-4fd4-4848-a297-ffd31f7a2880 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:07:31 devstack sudo[92404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7f1f3b1c-4fd4-4848-a297-ffd31f7a2880 Jul 10 10:07:31 devstack sudo[92404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:07:33 devstack sudo[92404]: pam_unix(sudo:session): session closed for user root Jul 10 10:07:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-307c1452-5aa7-4ca4-bbe1-08cba0e6f3af tempest-ServerRescueNegativeTestJSON-1141696391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7f1f3b1c-4fd4-4848-a297-ffd31f7a2880" returned: 0 in 1.540s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:07:33 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-307c1452-5aa7-4ca4-bbe1-08cba0e6f3af tempest-ServerRescueNegativeTestJSON-1141696391 None] Lock "cinder-quobyte-7f1f3b1c-4fd4-4848-a297-ffd31f7a2880" released by "delete_volume" :: held 3.516s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:07:33 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-307c1452-5aa7-4ca4-bbe1-08cba0e6f3af tempest-ServerRescueNegativeTestJSON-1141696391 None] Created reservations ['91532fa9-4198-4937-93df-9cb28ff8aaaa', 'a2926f76-53b2-4e4e-996d-21353bbfa64e', 'f94dc796-0d57-4b09-8498-b32343332614', 'af2d3ad1-755d-4e45-8d15-b8a805445e7d'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:07:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-307c1452-5aa7-4ca4-bbe1-08cba0e6f3af tempest-ServerRescueNegativeTestJSON-1141696391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:07:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-307c1452-5aa7-4ca4-bbe1-08cba0e6f3af tempest-ServerRescueNegativeTestJSON-1141696391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:07:33 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-307c1452-5aa7-4ca4-bbe1-08cba0e6f3af tempest-ServerRescueNegativeTestJSON-1141696391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:07:33 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-307c1452-5aa7-4ca4-bbe1-08cba0e6f3af tempest-ServerRescueNegativeTestJSON-1141696391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:07:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-307c1452-5aa7-4ca4-bbe1-08cba0e6f3af tempest-ServerRescueNegativeTestJSON-1141696391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:07:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-307c1452-5aa7-4ca4-bbe1-08cba0e6f3af tempest-ServerRescueNegativeTestJSON-1141696391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:07:33 devstack sudo[92411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:07:33 devstack sudo[92411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:07:34 devstack sudo[92411]: pam_unix(sudo:session): session closed for user root Jul 10 10:07:34 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-307c1452-5aa7-4ca4-bbe1-08cba0e6f3af tempest-ServerRescueNegativeTestJSON-1141696391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 1.505s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:07:34 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-307c1452-5aa7-4ca4-bbe1-08cba0e6f3af tempest-ServerRescueNegativeTestJSON-1141696391 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:07:34 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-307c1452-5aa7-4ca4-bbe1-08cba0e6f3af tempest-ServerRescueNegativeTestJSON-1141696391 None] Deleted volume successfully. Jul 10 10:07:34 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-307c1452-5aa7-4ca4-bbe1-08cba0e6f3af tempest-ServerRescueNegativeTestJSON-1141696391 None] Lock "cinder-7f1f3b1c-4fd4-4848-a297-ffd31f7a2880-delete_volume" released by "delete_volume" :: held 5.577s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:07:39 devstack cinder-volume[87234]: DEBUG dbcounter [-] [87234] Writing DB stats cinder:UPDATE=64,cinder:DELETE=7,cinder:SELECT=42,cinder:INSERT=15 {{(pid=87234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 10:07:39 devstack cinder-volume[87234]: DEBUG dbcounter [-] [87234] Writing DB stats cinder:SELECT=59,cinder:UPDATE=63,cinder:INSERT=12,cinder:DELETE=3 {{(pid=87234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 10:07:39 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1a1f4ec-691f-4af9-93f6-f6a55fd888d1 tempest-VolumesActionsTest-1820532270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:07:39 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a1a1f4ec-691f-4af9-93f6-f6a55fd888d1 tempest-VolumesActionsTest-1820532270 None] Flow 'volume_create_manager' (27240d70-6fd9-465d-a2ac-e5c0aa8fdf82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:07:39 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a1a1f4ec-691f-4af9-93f6-f6a55fd888d1 tempest-VolumesActionsTest-1820532270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e575dfc-bf2b-4815-a63f-1cb471595f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:07:39 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a1a1f4ec-691f-4af9-93f6-f6a55fd888d1 tempest-VolumesActionsTest-1820532270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e575dfc-bf2b-4815-a63f-1cb471595f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:07:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-10311228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53d2223b-e3e0-44f8-969b-c29337bd913d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881f973d09a7486899687543f9cb7ed4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:07:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:07:39Z,use_quota=True,user_id='35ac5cc870c949268bc6158db3b1f77a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:07:39 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a1a1f4ec-691f-4af9-93f6-f6a55fd888d1 tempest-VolumesActionsTest-1820532270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82f47c32-06dc-4316-a67d-19b908fb0cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:07:39 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a1a1f4ec-691f-4af9-93f6-f6a55fd888d1 tempest-VolumesActionsTest-1820532270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82f47c32-06dc-4316-a67d-19b908fb0cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:07:39 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a1a1f4ec-691f-4af9-93f6-f6a55fd888d1 tempest-VolumesActionsTest-1820532270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4d7185d-0821-4e9e-88dc-80b88ac04984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:07:39 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a1a1f4ec-691f-4af9-93f6-f6a55fd888d1 tempest-VolumesActionsTest-1820532270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4d7185d-0821-4e9e-88dc-80b88ac04984) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53d2223b-e3e0-44f8-969b-c29337bd913d', 'volume_name': 'volume-53d2223b-e3e0-44f8-969b-c29337bd913d', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:07:39 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a1a1f4ec-691f-4af9-93f6-f6a55fd888d1 tempest-VolumesActionsTest-1820532270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d28f46f6-9a32-4dd3-9640-8f1a12c0b140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:07:39 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a1a1f4ec-691f-4af9-93f6-f6a55fd888d1 tempest-VolumesActionsTest-1820532270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d28f46f6-9a32-4dd3-9640-8f1a12c0b140) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:07:39 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a1a1f4ec-691f-4af9-93f6-f6a55fd888d1 tempest-VolumesActionsTest-1820532270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cb4206e-c95a-498e-94f5-7dc4b1a66633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:07:39 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-a1a1f4ec-691f-4af9-93f6-f6a55fd888d1 tempest-VolumesActionsTest-1820532270 None] Volume 53d2223b-e3e0-44f8-969b-c29337bd913d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53d2223b-e3e0-44f8-969b-c29337bd913d', 'volume_size': 1} Jul 10 10:07:39 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-a1a1f4ec-691f-4af9-93f6-f6a55fd888d1 tempest-VolumesActionsTest-1820532270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:07:39 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-a1a1f4ec-691f-4af9-93f6-f6a55fd888d1 tempest-VolumesActionsTest-1820532270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:07:39 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-a1a1f4ec-691f-4af9-93f6-f6a55fd888d1 tempest-VolumesActionsTest-1820532270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:07:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-10311228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53d2223b-e3e0-44f8-969b-c29337bd913d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881f973d09a7486899687543f9cb7ed4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:07:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:07:39Z,use_quota=True,user_id='35ac5cc870c949268bc6158db3b1f77a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:07:39 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-a1a1f4ec-691f-4af9-93f6-f6a55fd888d1 tempest-VolumesActionsTest-1820532270 None] Creating volume 53d2223b-e3e0-44f8-969b-c29337bd913d {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:07:39 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-a1a1f4ec-691f-4af9-93f6-f6a55fd888d1 tempest-VolumesActionsTest-1820532270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:07:39 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-a1a1f4ec-691f-4af9-93f6-f6a55fd888d1 tempest-VolumesActionsTest-1820532270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:07:39 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-a1a1f4ec-691f-4af9-93f6-f6a55fd888d1 tempest-VolumesActionsTest-1820532270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:07:39 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-a1a1f4ec-691f-4af9-93f6-f6a55fd888d1 tempest-VolumesActionsTest-1820532270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:07:39 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-a1a1f4ec-691f-4af9-93f6-f6a55fd888d1 tempest-VolumesActionsTest-1820532270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:07:39 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-a1a1f4ec-691f-4af9-93f6-f6a55fd888d1 tempest-VolumesActionsTest-1820532270 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:07:39 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-a1a1f4ec-691f-4af9-93f6-f6a55fd888d1 tempest-VolumesActionsTest-1820532270 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:07:39 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a1a1f4ec-691f-4af9-93f6-f6a55fd888d1 tempest-VolumesActionsTest-1820532270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-53d2223b-e3e0-44f8-969b-c29337bd913d 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:07:39 devstack sudo[92445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-53d2223b-e3e0-44f8-969b-c29337bd913d 1073741824 Jul 10 10:07:39 devstack sudo[92445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:07:40 devstack sudo[92445]: pam_unix(sudo:session): session closed for user root Jul 10 10:07:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a1a1f4ec-691f-4af9-93f6-f6a55fd888d1 tempest-VolumesActionsTest-1820532270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-53d2223b-e3e0-44f8-969b-c29337bd913d 1073741824" returned: 0 in 1.350s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:07:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a1a1f4ec-691f-4af9-93f6-f6a55fd888d1 tempest-VolumesActionsTest-1820532270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-53d2223b-e3e0-44f8-969b-c29337bd913d {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:07:40 devstack sudo[92475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-53d2223b-e3e0-44f8-969b-c29337bd913d Jul 10 10:07:40 devstack sudo[92475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:07:41 devstack sudo[92475]: pam_unix(sudo:session): session closed for user root Jul 10 10:07:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a1a1f4ec-691f-4af9-93f6-f6a55fd888d1 tempest-VolumesActionsTest-1820532270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-53d2223b-e3e0-44f8-969b-c29337bd913d" returned: 0 in 0.971s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:07:41 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-a1a1f4ec-691f-4af9-93f6-f6a55fd888d1 tempest-VolumesActionsTest-1820532270 None] <== create_volume: return (2439ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:07:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-a1a1f4ec-691f-4af9-93f6-f6a55fd888d1 tempest-VolumesActionsTest-1820532270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.444s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:07:41 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a1a1f4ec-691f-4af9-93f6-f6a55fd888d1 tempest-VolumesActionsTest-1820532270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cb4206e-c95a-498e-94f5-7dc4b1a66633) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53d2223b-e3e0-44f8-969b-c29337bd913d', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:07:41 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a1a1f4ec-691f-4af9-93f6-f6a55fd888d1 tempest-VolumesActionsTest-1820532270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a213d0d-4130-4877-909f-ebb482f8b2d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:07:41 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-a1a1f4ec-691f-4af9-93f6-f6a55fd888d1 tempest-VolumesActionsTest-1820532270 None] Volume volume-53d2223b-e3e0-44f8-969b-c29337bd913d (53d2223b-e3e0-44f8-969b-c29337bd913d): created successfully Jul 10 10:07:41 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a1a1f4ec-691f-4af9-93f6-f6a55fd888d1 tempest-VolumesActionsTest-1820532270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a213d0d-4130-4877-909f-ebb482f8b2d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:07:41 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a1a1f4ec-691f-4af9-93f6-f6a55fd888d1 tempest-VolumesActionsTest-1820532270 None] Flow 'volume_create_manager' (27240d70-6fd9-465d-a2ac-e5c0aa8fdf82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:07:41 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-a1a1f4ec-691f-4af9-93f6-f6a55fd888d1 tempest-VolumesActionsTest-1820532270 None] Created volume successfully. Jul 10 10:07:42 devstack cinder-volume[87234]: DEBUG oslo_service.periodic_task [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 10:07:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:07:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:07:42 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:07:42 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:07:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:07:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:07:42 devstack sudo[92478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:07:42 devstack sudo[92478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:07:42 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-0026de08-401a-4e93-945c-ec0f231e989e tempest-VolumesActionsTest-462141617 None] Acquiring lock "cinder-53d2223b-e3e0-44f8-969b-c29337bd913d-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:07:42 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-0026de08-401a-4e93-945c-ec0f231e989e tempest-VolumesActionsTest-462141617 None] Lock "cinder-53d2223b-e3e0-44f8-969b-c29337bd913d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:07:42 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-0026de08-401a-4e93-945c-ec0f231e989e tempest-VolumesActionsTest-462141617 None] Acquiring lock "cinder-quobyte-53d2223b-e3e0-44f8-969b-c29337bd913d" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:07:42 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-0026de08-401a-4e93-945c-ec0f231e989e tempest-VolumesActionsTest-462141617 None] Lock "cinder-quobyte-53d2223b-e3e0-44f8-969b-c29337bd913d" acquired by "delete_volume" :: waited 0.024s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:07:43 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c81b3e0-4fe8-45d5-a640-f7ecc7d18c9f]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:07:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0026de08-401a-4e93-945c-ec0f231e989e tempest-VolumesActionsTest-462141617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-53d2223b-e3e0-44f8-969b-c29337bd913d {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:07:43 devstack sudo[92478]: pam_unix(sudo:session): session closed for user root Jul 10 10:07:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 1.033s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:07:43 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:07:43 devstack cinder-volume[87234]: DEBUG oslo_service.periodic_task [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Running periodic task VolumeManager._thread_info {{(pid=87234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 10:07:43 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] thread count: 8 {{(pid=87234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 10:07:43 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] thread info: [<_MainThread(MainThread, started 131600773742720)>, , , , , , , ] {{(pid=87234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 10:07:43 devstack sudo[92484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-53d2223b-e3e0-44f8-969b-c29337bd913d Jul 10 10:07:43 devstack sudo[92484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:07:43 devstack sudo[92484]: pam_unix(sudo:session): session closed for user root Jul 10 10:07:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0026de08-401a-4e93-945c-ec0f231e989e tempest-VolumesActionsTest-462141617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-53d2223b-e3e0-44f8-969b-c29337bd913d" returned: 0 in 0.955s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:07:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0026de08-401a-4e93-945c-ec0f231e989e tempest-VolumesActionsTest-462141617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-53d2223b-e3e0-44f8-969b-c29337bd913d {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:07:44 devstack sudo[92494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-53d2223b-e3e0-44f8-969b-c29337bd913d Jul 10 10:07:44 devstack sudo[92494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:07:44 devstack sudo[92494]: pam_unix(sudo:session): session closed for user root Jul 10 10:07:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0026de08-401a-4e93-945c-ec0f231e989e tempest-VolumesActionsTest-462141617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-53d2223b-e3e0-44f8-969b-c29337bd913d" returned: 0 in 0.779s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:07:44 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-0026de08-401a-4e93-945c-ec0f231e989e tempest-VolumesActionsTest-462141617 None] Lock "cinder-quobyte-53d2223b-e3e0-44f8-969b-c29337bd913d" released by "delete_volume" :: held 1.804s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:07:44 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-0026de08-401a-4e93-945c-ec0f231e989e tempest-VolumesActionsTest-462141617 None] Created reservations ['3a4d488a-8263-4c61-8415-5ff63425b52e', '9e93b707-d538-4496-a7b7-280799f0005d', 'afef6665-d588-43db-a0e8-57341f74fe9d', '16a8c371-a69b-4b1c-9811-78acb06b3738'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:07:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-0026de08-401a-4e93-945c-ec0f231e989e tempest-VolumesActionsTest-462141617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:07:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-0026de08-401a-4e93-945c-ec0f231e989e tempest-VolumesActionsTest-462141617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:07:44 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-0026de08-401a-4e93-945c-ec0f231e989e tempest-VolumesActionsTest-462141617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:07:44 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-0026de08-401a-4e93-945c-ec0f231e989e tempest-VolumesActionsTest-462141617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:07:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-0026de08-401a-4e93-945c-ec0f231e989e tempest-VolumesActionsTest-462141617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:07:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0026de08-401a-4e93-945c-ec0f231e989e tempest-VolumesActionsTest-462141617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:07:44 devstack sudo[92511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:07:44 devstack sudo[92511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:07:45 devstack sudo[92511]: pam_unix(sudo:session): session closed for user root Jul 10 10:07:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0026de08-401a-4e93-945c-ec0f231e989e tempest-VolumesActionsTest-462141617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 1.025s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:07:45 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-0026de08-401a-4e93-945c-ec0f231e989e tempest-VolumesActionsTest-462141617 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:07:45 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-0026de08-401a-4e93-945c-ec0f231e989e tempest-VolumesActionsTest-462141617 None] Deleted volume successfully. Jul 10 10:07:45 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-0026de08-401a-4e93-945c-ec0f231e989e tempest-VolumesActionsTest-462141617 None] Lock "cinder-53d2223b-e3e0-44f8-969b-c29337bd913d-delete_volume" released by "delete_volume" :: held 3.147s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:07:46 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b722639-4b24-455c-b276-7a8d6f2c0fd5 tempest-VolumesActionsTest-1820532270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:07:46 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5b722639-4b24-455c-b276-7a8d6f2c0fd5 tempest-VolumesActionsTest-1820532270 None] Flow 'volume_create_manager' (6bceee52-4958-4161-abae-d0bdab4a68a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:07:46 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5b722639-4b24-455c-b276-7a8d6f2c0fd5 tempest-VolumesActionsTest-1820532270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5302220a-37a7-45fd-b541-e4edc97f3a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:07:46 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5b722639-4b24-455c-b276-7a8d6f2c0fd5 tempest-VolumesActionsTest-1820532270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5302220a-37a7-45fd-b541-e4edc97f3a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:07:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1150479760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=083628dc-8bad-47dc-9889-850711d52fd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881f973d09a7486899687543f9cb7ed4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:07:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:07:46Z,use_quota=True,user_id='35ac5cc870c949268bc6158db3b1f77a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:07:46 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5b722639-4b24-455c-b276-7a8d6f2c0fd5 tempest-VolumesActionsTest-1820532270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfac1aff-8249-4831-8b25-ac09cc914bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:07:46 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5b722639-4b24-455c-b276-7a8d6f2c0fd5 tempest-VolumesActionsTest-1820532270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfac1aff-8249-4831-8b25-ac09cc914bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:07:46 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5b722639-4b24-455c-b276-7a8d6f2c0fd5 tempest-VolumesActionsTest-1820532270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b6cebc5-1b4a-4ee9-8a15-2960f3f249fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:07:46 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5b722639-4b24-455c-b276-7a8d6f2c0fd5 tempest-VolumesActionsTest-1820532270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b6cebc5-1b4a-4ee9-8a15-2960f3f249fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '083628dc-8bad-47dc-9889-850711d52fd2', 'volume_name': 'volume-083628dc-8bad-47dc-9889-850711d52fd2', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:07:46 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5b722639-4b24-455c-b276-7a8d6f2c0fd5 tempest-VolumesActionsTest-1820532270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce63248c-3048-46c9-b923-68ad6ae23d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:07:46 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5b722639-4b24-455c-b276-7a8d6f2c0fd5 tempest-VolumesActionsTest-1820532270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce63248c-3048-46c9-b923-68ad6ae23d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:07:46 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5b722639-4b24-455c-b276-7a8d6f2c0fd5 tempest-VolumesActionsTest-1820532270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f677faa-f643-48b6-b02b-913254adedc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:07:46 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-5b722639-4b24-455c-b276-7a8d6f2c0fd5 tempest-VolumesActionsTest-1820532270 None] Volume 083628dc-8bad-47dc-9889-850711d52fd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-083628dc-8bad-47dc-9889-850711d52fd2', 'volume_size': 1} Jul 10 10:07:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-5b722639-4b24-455c-b276-7a8d6f2c0fd5 tempest-VolumesActionsTest-1820532270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:07:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-5b722639-4b24-455c-b276-7a8d6f2c0fd5 tempest-VolumesActionsTest-1820532270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:07:46 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-5b722639-4b24-455c-b276-7a8d6f2c0fd5 tempest-VolumesActionsTest-1820532270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:07:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1150479760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=083628dc-8bad-47dc-9889-850711d52fd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881f973d09a7486899687543f9cb7ed4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:07:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:07:46Z,use_quota=True,user_id='35ac5cc870c949268bc6158db3b1f77a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:07:46 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-5b722639-4b24-455c-b276-7a8d6f2c0fd5 tempest-VolumesActionsTest-1820532270 None] Creating volume 083628dc-8bad-47dc-9889-850711d52fd2 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:07:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-5b722639-4b24-455c-b276-7a8d6f2c0fd5 tempest-VolumesActionsTest-1820532270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:07:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-5b722639-4b24-455c-b276-7a8d6f2c0fd5 tempest-VolumesActionsTest-1820532270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:07:46 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-5b722639-4b24-455c-b276-7a8d6f2c0fd5 tempest-VolumesActionsTest-1820532270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:07:46 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-5b722639-4b24-455c-b276-7a8d6f2c0fd5 tempest-VolumesActionsTest-1820532270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:07:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-5b722639-4b24-455c-b276-7a8d6f2c0fd5 tempest-VolumesActionsTest-1820532270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:07:46 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-5b722639-4b24-455c-b276-7a8d6f2c0fd5 tempest-VolumesActionsTest-1820532270 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:07:46 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-5b722639-4b24-455c-b276-7a8d6f2c0fd5 tempest-VolumesActionsTest-1820532270 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:07:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5b722639-4b24-455c-b276-7a8d6f2c0fd5 tempest-VolumesActionsTest-1820532270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-083628dc-8bad-47dc-9889-850711d52fd2 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:07:46 devstack sudo[92518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-083628dc-8bad-47dc-9889-850711d52fd2 1073741824 Jul 10 10:07:46 devstack sudo[92518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:07:47 devstack sudo[92518]: pam_unix(sudo:session): session closed for user root Jul 10 10:07:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5b722639-4b24-455c-b276-7a8d6f2c0fd5 tempest-VolumesActionsTest-1820532270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-083628dc-8bad-47dc-9889-850711d52fd2 1073741824" returned: 0 in 0.949s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:07:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5b722639-4b24-455c-b276-7a8d6f2c0fd5 tempest-VolumesActionsTest-1820532270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-083628dc-8bad-47dc-9889-850711d52fd2 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:07:47 devstack sudo[92525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-083628dc-8bad-47dc-9889-850711d52fd2 Jul 10 10:07:47 devstack sudo[92525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:07:47 devstack sudo[92525]: pam_unix(sudo:session): session closed for user root Jul 10 10:07:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5b722639-4b24-455c-b276-7a8d6f2c0fd5 tempest-VolumesActionsTest-1820532270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-083628dc-8bad-47dc-9889-850711d52fd2" returned: 0 in 0.685s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:07:47 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-5b722639-4b24-455c-b276-7a8d6f2c0fd5 tempest-VolumesActionsTest-1820532270 None] <== create_volume: return (1691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:07:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-5b722639-4b24-455c-b276-7a8d6f2c0fd5 tempest-VolumesActionsTest-1820532270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.693s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:07:47 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5b722639-4b24-455c-b276-7a8d6f2c0fd5 tempest-VolumesActionsTest-1820532270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f677faa-f643-48b6-b02b-913254adedc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-083628dc-8bad-47dc-9889-850711d52fd2', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:07:47 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5b722639-4b24-455c-b276-7a8d6f2c0fd5 tempest-VolumesActionsTest-1820532270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0c7fb94-958c-4267-8266-402fe24da535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:07:47 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-5b722639-4b24-455c-b276-7a8d6f2c0fd5 tempest-VolumesActionsTest-1820532270 None] Volume volume-083628dc-8bad-47dc-9889-850711d52fd2 (083628dc-8bad-47dc-9889-850711d52fd2): created successfully Jul 10 10:07:47 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5b722639-4b24-455c-b276-7a8d6f2c0fd5 tempest-VolumesActionsTest-1820532270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0c7fb94-958c-4267-8266-402fe24da535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:07:47 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5b722639-4b24-455c-b276-7a8d6f2c0fd5 tempest-VolumesActionsTest-1820532270 None] Flow 'volume_create_manager' (6bceee52-4958-4161-abae-d0bdab4a68a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:07:47 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-5b722639-4b24-455c-b276-7a8d6f2c0fd5 tempest-VolumesActionsTest-1820532270 None] Created volume successfully. Jul 10 10:07:48 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-1843c1b4-1149-432b-ac6e-7e8e79bda362 tempest-VolumesActionsTest-462141617 None] Acquiring lock "cinder-083628dc-8bad-47dc-9889-850711d52fd2-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:07:48 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-1843c1b4-1149-432b-ac6e-7e8e79bda362 tempest-VolumesActionsTest-462141617 None] Lock "cinder-083628dc-8bad-47dc-9889-850711d52fd2-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:07:48 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-1843c1b4-1149-432b-ac6e-7e8e79bda362 tempest-VolumesActionsTest-462141617 None] Acquiring lock "cinder-quobyte-083628dc-8bad-47dc-9889-850711d52fd2" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:07:48 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-1843c1b4-1149-432b-ac6e-7e8e79bda362 tempest-VolumesActionsTest-462141617 None] Lock "cinder-quobyte-083628dc-8bad-47dc-9889-850711d52fd2" acquired by "delete_volume" :: waited 0.018s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:07:48 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0920903-36e4-4b66-b79a-535202ac373e]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:07:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1843c1b4-1149-432b-ac6e-7e8e79bda362 tempest-VolumesActionsTest-462141617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-083628dc-8bad-47dc-9889-850711d52fd2 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:07:48 devstack sudo[92528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-083628dc-8bad-47dc-9889-850711d52fd2 Jul 10 10:07:48 devstack sudo[92528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:07:49 devstack sudo[92528]: pam_unix(sudo:session): session closed for user root Jul 10 10:07:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1843c1b4-1149-432b-ac6e-7e8e79bda362 tempest-VolumesActionsTest-462141617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-083628dc-8bad-47dc-9889-850711d52fd2" returned: 0 in 0.850s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:07:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1843c1b4-1149-432b-ac6e-7e8e79bda362 tempest-VolumesActionsTest-462141617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-083628dc-8bad-47dc-9889-850711d52fd2 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:07:49 devstack sudo[92534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-083628dc-8bad-47dc-9889-850711d52fd2 Jul 10 10:07:49 devstack sudo[92534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:07:50 devstack sudo[92534]: pam_unix(sudo:session): session closed for user root Jul 10 10:07:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1843c1b4-1149-432b-ac6e-7e8e79bda362 tempest-VolumesActionsTest-462141617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-083628dc-8bad-47dc-9889-850711d52fd2" returned: 0 in 0.818s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:07:50 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-1843c1b4-1149-432b-ac6e-7e8e79bda362 tempest-VolumesActionsTest-462141617 None] Lock "cinder-quobyte-083628dc-8bad-47dc-9889-850711d52fd2" released by "delete_volume" :: held 1.739s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:07:50 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-1843c1b4-1149-432b-ac6e-7e8e79bda362 tempest-VolumesActionsTest-462141617 None] Created reservations ['590fe396-1d8e-4a89-87e2-7f30921e0b58', '7c0e3c8c-62e7-4b9e-97cb-3ef4ecfa26a3', '2c7b485d-036a-465d-9041-6c382fb76d86', 'a8b2ceed-25a7-4bb2-a2dc-5d40e291f93d'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:07:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-1843c1b4-1149-432b-ac6e-7e8e79bda362 tempest-VolumesActionsTest-462141617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:07:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-1843c1b4-1149-432b-ac6e-7e8e79bda362 tempest-VolumesActionsTest-462141617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:07:50 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-1843c1b4-1149-432b-ac6e-7e8e79bda362 tempest-VolumesActionsTest-462141617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:07:50 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-1843c1b4-1149-432b-ac6e-7e8e79bda362 tempest-VolumesActionsTest-462141617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:07:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-1843c1b4-1149-432b-ac6e-7e8e79bda362 tempest-VolumesActionsTest-462141617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:07:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1843c1b4-1149-432b-ac6e-7e8e79bda362 tempest-VolumesActionsTest-462141617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:07:50 devstack sudo[92538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:07:50 devstack sudo[92538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:07:51 devstack sudo[92538]: pam_unix(sudo:session): session closed for user root Jul 10 10:07:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1843c1b4-1149-432b-ac6e-7e8e79bda362 tempest-VolumesActionsTest-462141617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 1.229s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:07:51 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-1843c1b4-1149-432b-ac6e-7e8e79bda362 tempest-VolumesActionsTest-462141617 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:07:51 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-1843c1b4-1149-432b-ac6e-7e8e79bda362 tempest-VolumesActionsTest-462141617 None] Deleted volume successfully. Jul 10 10:07:51 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-1843c1b4-1149-432b-ac6e-7e8e79bda362 tempest-VolumesActionsTest-462141617 None] Lock "cinder-083628dc-8bad-47dc-9889-850711d52fd2-delete_volume" released by "delete_volume" :: held 3.267s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:07:51 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b25c58f-5ec1-4e9a-87ff-59f204222b11 tempest-VolumesActionsTest-1820532270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:07:51 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-2b25c58f-5ec1-4e9a-87ff-59f204222b11 tempest-VolumesActionsTest-1820532270 None] Flow 'volume_create_manager' (3204e79c-805d-462b-8184-306ea7b3e6bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:07:51 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-2b25c58f-5ec1-4e9a-87ff-59f204222b11 tempest-VolumesActionsTest-1820532270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29038e89-b03b-40a6-a278-5ee9a201d9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:07:51 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-2b25c58f-5ec1-4e9a-87ff-59f204222b11 tempest-VolumesActionsTest-1820532270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29038e89-b03b-40a6-a278-5ee9a201d9f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:07:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2059385941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2efc199-51d3-43fd-8d0d-197f2b8a16be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881f973d09a7486899687543f9cb7ed4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:07:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:07:52Z,use_quota=True,user_id='35ac5cc870c949268bc6158db3b1f77a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:07:51 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-2b25c58f-5ec1-4e9a-87ff-59f204222b11 tempest-VolumesActionsTest-1820532270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97eae981-0f7f-40fa-89b8-54d4610a96b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:07:51 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-2b25c58f-5ec1-4e9a-87ff-59f204222b11 tempest-VolumesActionsTest-1820532270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97eae981-0f7f-40fa-89b8-54d4610a96b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:07:51 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-2b25c58f-5ec1-4e9a-87ff-59f204222b11 tempest-VolumesActionsTest-1820532270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (437e999a-8ea6-45e2-81d5-a18f96ad5a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:07:51 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-2b25c58f-5ec1-4e9a-87ff-59f204222b11 tempest-VolumesActionsTest-1820532270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (437e999a-8ea6-45e2-81d5-a18f96ad5a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2efc199-51d3-43fd-8d0d-197f2b8a16be', 'volume_name': 'volume-e2efc199-51d3-43fd-8d0d-197f2b8a16be', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:07:51 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-2b25c58f-5ec1-4e9a-87ff-59f204222b11 tempest-VolumesActionsTest-1820532270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee1da6e2-d5e4-487c-93f4-ec9d03409373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:07:51 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-2b25c58f-5ec1-4e9a-87ff-59f204222b11 tempest-VolumesActionsTest-1820532270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee1da6e2-d5e4-487c-93f4-ec9d03409373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:07:51 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-2b25c58f-5ec1-4e9a-87ff-59f204222b11 tempest-VolumesActionsTest-1820532270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fec9f4d-b456-4ef6-9b18-2319d08468e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:07:51 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-2b25c58f-5ec1-4e9a-87ff-59f204222b11 tempest-VolumesActionsTest-1820532270 None] Volume e2efc199-51d3-43fd-8d0d-197f2b8a16be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2efc199-51d3-43fd-8d0d-197f2b8a16be', 'volume_size': 1} Jul 10 10:07:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-2b25c58f-5ec1-4e9a-87ff-59f204222b11 tempest-VolumesActionsTest-1820532270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:07:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-2b25c58f-5ec1-4e9a-87ff-59f204222b11 tempest-VolumesActionsTest-1820532270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:07:51 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-2b25c58f-5ec1-4e9a-87ff-59f204222b11 tempest-VolumesActionsTest-1820532270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:07:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2059385941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2efc199-51d3-43fd-8d0d-197f2b8a16be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881f973d09a7486899687543f9cb7ed4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:07:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:07:52Z,use_quota=True,user_id='35ac5cc870c949268bc6158db3b1f77a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:07:51 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-2b25c58f-5ec1-4e9a-87ff-59f204222b11 tempest-VolumesActionsTest-1820532270 None] Creating volume e2efc199-51d3-43fd-8d0d-197f2b8a16be {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:07:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-2b25c58f-5ec1-4e9a-87ff-59f204222b11 tempest-VolumesActionsTest-1820532270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:07:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-2b25c58f-5ec1-4e9a-87ff-59f204222b11 tempest-VolumesActionsTest-1820532270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:07:51 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-2b25c58f-5ec1-4e9a-87ff-59f204222b11 tempest-VolumesActionsTest-1820532270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:07:51 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-2b25c58f-5ec1-4e9a-87ff-59f204222b11 tempest-VolumesActionsTest-1820532270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:07:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-2b25c58f-5ec1-4e9a-87ff-59f204222b11 tempest-VolumesActionsTest-1820532270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:07:51 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-2b25c58f-5ec1-4e9a-87ff-59f204222b11 tempest-VolumesActionsTest-1820532270 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:07:51 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-2b25c58f-5ec1-4e9a-87ff-59f204222b11 tempest-VolumesActionsTest-1820532270 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:07:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-2b25c58f-5ec1-4e9a-87ff-59f204222b11 tempest-VolumesActionsTest-1820532270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e2efc199-51d3-43fd-8d0d-197f2b8a16be 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:07:51 devstack sudo[92557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e2efc199-51d3-43fd-8d0d-197f2b8a16be 1073741824 Jul 10 10:07:51 devstack sudo[92557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:07:52 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-91f2dde6-4f71-446d-956a-edd69312d104 tempest-AttachVolumeTestJSON-202001593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:07:52 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-91f2dde6-4f71-446d-956a-edd69312d104 tempest-AttachVolumeTestJSON-202001593 None] Flow 'volume_create_manager' (e4210408-e33b-444a-ab03-37d7933705fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:07:52 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-91f2dde6-4f71-446d-956a-edd69312d104 tempest-AttachVolumeTestJSON-202001593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f53385d5-7d3d-4868-ad64-9234c35d76a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:07:52 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-91f2dde6-4f71-446d-956a-edd69312d104 tempest-AttachVolumeTestJSON-202001593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f53385d5-7d3d-4868-ad64-9234c35d76a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:07:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-972066552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbafb75e-f1c3-48a2-91fb-8eb5a84c6df9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d966001b9e149a5abffd793edefdb23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:07:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:07:52Z,use_quota=True,user_id='1f1147266c9a478b8054352a9f42bd97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:07:52 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-91f2dde6-4f71-446d-956a-edd69312d104 tempest-AttachVolumeTestJSON-202001593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0edfadbc-720f-4b9d-984c-a5fb303bb05b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:07:52 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-91f2dde6-4f71-446d-956a-edd69312d104 tempest-AttachVolumeTestJSON-202001593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0edfadbc-720f-4b9d-984c-a5fb303bb05b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:07:52 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-91f2dde6-4f71-446d-956a-edd69312d104 tempest-AttachVolumeTestJSON-202001593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd92bc34-5c76-4d03-a097-0b383db7e238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:07:52 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-91f2dde6-4f71-446d-956a-edd69312d104 tempest-AttachVolumeTestJSON-202001593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd92bc34-5c76-4d03-a097-0b383db7e238) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbafb75e-f1c3-48a2-91fb-8eb5a84c6df9', 'volume_name': 'volume-fbafb75e-f1c3-48a2-91fb-8eb5a84c6df9', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:07:52 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-91f2dde6-4f71-446d-956a-edd69312d104 tempest-AttachVolumeTestJSON-202001593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8795af8-ec86-4dc7-a1be-7e66840cd82b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:07:52 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-91f2dde6-4f71-446d-956a-edd69312d104 tempest-AttachVolumeTestJSON-202001593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8795af8-ec86-4dc7-a1be-7e66840cd82b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:07:52 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-91f2dde6-4f71-446d-956a-edd69312d104 tempest-AttachVolumeTestJSON-202001593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6ea88d9-fd50-41a4-930b-1605b2fec002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:07:52 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-91f2dde6-4f71-446d-956a-edd69312d104 tempest-AttachVolumeTestJSON-202001593 None] Volume fbafb75e-f1c3-48a2-91fb-8eb5a84c6df9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbafb75e-f1c3-48a2-91fb-8eb5a84c6df9', 'volume_size': 1} Jul 10 10:07:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-91f2dde6-4f71-446d-956a-edd69312d104 tempest-AttachVolumeTestJSON-202001593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:07:53 devstack sudo[92557]: pam_unix(sudo:session): session closed for user root Jul 10 10:07:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-2b25c58f-5ec1-4e9a-87ff-59f204222b11 tempest-VolumesActionsTest-1820532270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e2efc199-51d3-43fd-8d0d-197f2b8a16be 1073741824" returned: 0 in 1.252s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:07:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-2b25c58f-5ec1-4e9a-87ff-59f204222b11 tempest-VolumesActionsTest-1820532270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e2efc199-51d3-43fd-8d0d-197f2b8a16be {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:07:53 devstack sudo[92563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e2efc199-51d3-43fd-8d0d-197f2b8a16be Jul 10 10:07:53 devstack sudo[92563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:07:54 devstack sudo[92563]: pam_unix(sudo:session): session closed for user root Jul 10 10:07:54 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-2b25c58f-5ec1-4e9a-87ff-59f204222b11 tempest-VolumesActionsTest-1820532270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e2efc199-51d3-43fd-8d0d-197f2b8a16be" returned: 0 in 0.814s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:07:54 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-2b25c58f-5ec1-4e9a-87ff-59f204222b11 tempest-VolumesActionsTest-1820532270 None] <== create_volume: return (2130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:07:54 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-2b25c58f-5ec1-4e9a-87ff-59f204222b11 tempest-VolumesActionsTest-1820532270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.133s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:07:54 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-91f2dde6-4f71-446d-956a-edd69312d104 tempest-AttachVolumeTestJSON-202001593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.455s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:07:54 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-91f2dde6-4f71-446d-956a-edd69312d104 tempest-AttachVolumeTestJSON-202001593 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:07:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-972066552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbafb75e-f1c3-48a2-91fb-8eb5a84c6df9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d966001b9e149a5abffd793edefdb23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:07:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:07:52Z,use_quota=True,user_id='1f1147266c9a478b8054352a9f42bd97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:07:54 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-91f2dde6-4f71-446d-956a-edd69312d104 tempest-AttachVolumeTestJSON-202001593 None] Creating volume fbafb75e-f1c3-48a2-91fb-8eb5a84c6df9 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:07:54 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-91f2dde6-4f71-446d-956a-edd69312d104 tempest-AttachVolumeTestJSON-202001593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:07:54 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-91f2dde6-4f71-446d-956a-edd69312d104 tempest-AttachVolumeTestJSON-202001593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:07:54 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-91f2dde6-4f71-446d-956a-edd69312d104 tempest-AttachVolumeTestJSON-202001593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:07:54 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-91f2dde6-4f71-446d-956a-edd69312d104 tempest-AttachVolumeTestJSON-202001593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:07:54 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-91f2dde6-4f71-446d-956a-edd69312d104 tempest-AttachVolumeTestJSON-202001593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:07:54 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-91f2dde6-4f71-446d-956a-edd69312d104 tempest-AttachVolumeTestJSON-202001593 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:07:54 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-91f2dde6-4f71-446d-956a-edd69312d104 tempest-AttachVolumeTestJSON-202001593 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:07:54 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-91f2dde6-4f71-446d-956a-edd69312d104 tempest-AttachVolumeTestJSON-202001593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-fbafb75e-f1c3-48a2-91fb-8eb5a84c6df9 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:07:54 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-2b25c58f-5ec1-4e9a-87ff-59f204222b11 tempest-VolumesActionsTest-1820532270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fec9f4d-b456-4ef6-9b18-2319d08468e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2efc199-51d3-43fd-8d0d-197f2b8a16be', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:07:54 devstack sudo[92566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-fbafb75e-f1c3-48a2-91fb-8eb5a84c6df9 1073741824 Jul 10 10:07:54 devstack sudo[92566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:07:54 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-2b25c58f-5ec1-4e9a-87ff-59f204222b11 tempest-VolumesActionsTest-1820532270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68357911-be54-432f-8e96-6895c3c7b8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:07:54 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-2b25c58f-5ec1-4e9a-87ff-59f204222b11 tempest-VolumesActionsTest-1820532270 None] Volume volume-e2efc199-51d3-43fd-8d0d-197f2b8a16be (e2efc199-51d3-43fd-8d0d-197f2b8a16be): created successfully Jul 10 10:07:54 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-2b25c58f-5ec1-4e9a-87ff-59f204222b11 tempest-VolumesActionsTest-1820532270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68357911-be54-432f-8e96-6895c3c7b8ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:07:54 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-2b25c58f-5ec1-4e9a-87ff-59f204222b11 tempest-VolumesActionsTest-1820532270 None] Flow 'volume_create_manager' (3204e79c-805d-462b-8184-306ea7b3e6bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:07:54 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-2b25c58f-5ec1-4e9a-87ff-59f204222b11 tempest-VolumesActionsTest-1820532270 None] Created volume successfully. Jul 10 10:07:54 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-87f46164-bac6-4e99-86b4-85a24ef4fffb tempest-VolumesActionsTest-462141617 None] Acquiring lock "cinder-e2efc199-51d3-43fd-8d0d-197f2b8a16be-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:07:54 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-87f46164-bac6-4e99-86b4-85a24ef4fffb tempest-VolumesActionsTest-462141617 None] Lock "cinder-e2efc199-51d3-43fd-8d0d-197f2b8a16be-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:07:54 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-87f46164-bac6-4e99-86b4-85a24ef4fffb tempest-VolumesActionsTest-462141617 None] Acquiring lock "cinder-quobyte-e2efc199-51d3-43fd-8d0d-197f2b8a16be" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:07:54 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-87f46164-bac6-4e99-86b4-85a24ef4fffb tempest-VolumesActionsTest-462141617 None] Lock "cinder-quobyte-e2efc199-51d3-43fd-8d0d-197f2b8a16be" acquired by "delete_volume" :: waited 0.015s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:07:54 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9409f4-2182-42e7-91b8-685db7d0d40a]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:07:54 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-87f46164-bac6-4e99-86b4-85a24ef4fffb tempest-VolumesActionsTest-462141617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e2efc199-51d3-43fd-8d0d-197f2b8a16be {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:07:54 devstack sudo[92569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e2efc199-51d3-43fd-8d0d-197f2b8a16be Jul 10 10:07:54 devstack sudo[92569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:07:55 devstack sudo[92566]: pam_unix(sudo:session): session closed for user root Jul 10 10:07:55 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-91f2dde6-4f71-446d-956a-edd69312d104 tempest-AttachVolumeTestJSON-202001593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-fbafb75e-f1c3-48a2-91fb-8eb5a84c6df9 1073741824" returned: 0 in 1.259s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:07:55 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-91f2dde6-4f71-446d-956a-edd69312d104 tempest-AttachVolumeTestJSON-202001593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-fbafb75e-f1c3-48a2-91fb-8eb5a84c6df9 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:07:55 devstack sudo[92575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-fbafb75e-f1c3-48a2-91fb-8eb5a84c6df9 Jul 10 10:07:55 devstack sudo[92575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:07:55 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff714993-751a-4b96-a3ab-1b47c1614afb tempest-SnapshotMetadataTestJSON-1633806383 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:07:55 devstack sudo[92569]: pam_unix(sudo:session): session closed for user root Jul 10 10:07:55 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ff714993-751a-4b96-a3ab-1b47c1614afb tempest-SnapshotMetadataTestJSON-1633806383 None] Flow 'volume_create_manager' (c07a0e29-ce64-403a-b7f9-67f6cb22c48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:07:55 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ff714993-751a-4b96-a3ab-1b47c1614afb tempest-SnapshotMetadataTestJSON-1633806383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ba61cbc-3496-4b3c-9573-a29ac7d3ac3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:07:55 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-87f46164-bac6-4e99-86b4-85a24ef4fffb tempest-VolumesActionsTest-462141617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e2efc199-51d3-43fd-8d0d-197f2b8a16be" returned: 0 in 0.981s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:07:55 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-87f46164-bac6-4e99-86b4-85a24ef4fffb tempest-VolumesActionsTest-462141617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e2efc199-51d3-43fd-8d0d-197f2b8a16be {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:07:55 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ff714993-751a-4b96-a3ab-1b47c1614afb tempest-SnapshotMetadataTestJSON-1633806383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ba61cbc-3496-4b3c-9573-a29ac7d3ac3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:07:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1664048165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=470db1aa-517e-4ecd-8ad1-de6b6be389c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5adae8a1983743bf83fb2647c95f4814',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:07:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:07:56Z,use_quota=True,user_id='b9a04c07768c4d388eac808425c6248a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:07:55 devstack sudo[92580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e2efc199-51d3-43fd-8d0d-197f2b8a16be Jul 10 10:07:55 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ff714993-751a-4b96-a3ab-1b47c1614afb tempest-SnapshotMetadataTestJSON-1633806383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18aabef9-7e55-4845-b290-6175a4f03f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:07:55 devstack sudo[92580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:07:55 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ff714993-751a-4b96-a3ab-1b47c1614afb tempest-SnapshotMetadataTestJSON-1633806383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18aabef9-7e55-4845-b290-6175a4f03f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:07:55 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ff714993-751a-4b96-a3ab-1b47c1614afb tempest-SnapshotMetadataTestJSON-1633806383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ac764fe-df5a-4507-8d21-0e017f3b8ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:07:55 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ff714993-751a-4b96-a3ab-1b47c1614afb tempest-SnapshotMetadataTestJSON-1633806383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ac764fe-df5a-4507-8d21-0e017f3b8ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '470db1aa-517e-4ecd-8ad1-de6b6be389c3', 'volume_name': 'volume-470db1aa-517e-4ecd-8ad1-de6b6be389c3', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:07:55 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ff714993-751a-4b96-a3ab-1b47c1614afb tempest-SnapshotMetadataTestJSON-1633806383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ed06533-65a5-4c48-843c-856541cc1915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:07:55 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ff714993-751a-4b96-a3ab-1b47c1614afb tempest-SnapshotMetadataTestJSON-1633806383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ed06533-65a5-4c48-843c-856541cc1915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:07:55 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ff714993-751a-4b96-a3ab-1b47c1614afb tempest-SnapshotMetadataTestJSON-1633806383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10ebbc41-87a0-49de-9e86-cdd39d7d3379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:07:55 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-ff714993-751a-4b96-a3ab-1b47c1614afb tempest-SnapshotMetadataTestJSON-1633806383 None] Volume 470db1aa-517e-4ecd-8ad1-de6b6be389c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-470db1aa-517e-4ecd-8ad1-de6b6be389c3', 'volume_size': 1} Jul 10 10:07:55 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-ff714993-751a-4b96-a3ab-1b47c1614afb tempest-SnapshotMetadataTestJSON-1633806383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:07:56 devstack sudo[92575]: pam_unix(sudo:session): session closed for user root Jul 10 10:07:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-91f2dde6-4f71-446d-956a-edd69312d104 tempest-AttachVolumeTestJSON-202001593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-fbafb75e-f1c3-48a2-91fb-8eb5a84c6df9" returned: 0 in 0.776s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:07:56 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-91f2dde6-4f71-446d-956a-edd69312d104 tempest-AttachVolumeTestJSON-202001593 None] <== create_volume: return (2096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:07:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-91f2dde6-4f71-446d-956a-edd69312d104 tempest-AttachVolumeTestJSON-202001593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.099s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:07:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-ff714993-751a-4b96-a3ab-1b47c1614afb tempest-SnapshotMetadataTestJSON-1633806383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.432s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:07:56 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-ff714993-751a-4b96-a3ab-1b47c1614afb tempest-SnapshotMetadataTestJSON-1633806383 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:07:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1664048165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=470db1aa-517e-4ecd-8ad1-de6b6be389c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5adae8a1983743bf83fb2647c95f4814',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:07:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:07:56Z,use_quota=True,user_id='b9a04c07768c4d388eac808425c6248a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:07:56 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-ff714993-751a-4b96-a3ab-1b47c1614afb tempest-SnapshotMetadataTestJSON-1633806383 None] Creating volume 470db1aa-517e-4ecd-8ad1-de6b6be389c3 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:07:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-ff714993-751a-4b96-a3ab-1b47c1614afb tempest-SnapshotMetadataTestJSON-1633806383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:07:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-ff714993-751a-4b96-a3ab-1b47c1614afb tempest-SnapshotMetadataTestJSON-1633806383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:07:56 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-ff714993-751a-4b96-a3ab-1b47c1614afb tempest-SnapshotMetadataTestJSON-1633806383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:07:56 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-ff714993-751a-4b96-a3ab-1b47c1614afb tempest-SnapshotMetadataTestJSON-1633806383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:07:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-ff714993-751a-4b96-a3ab-1b47c1614afb tempest-SnapshotMetadataTestJSON-1633806383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:07:56 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-ff714993-751a-4b96-a3ab-1b47c1614afb tempest-SnapshotMetadataTestJSON-1633806383 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:07:56 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-ff714993-751a-4b96-a3ab-1b47c1614afb tempest-SnapshotMetadataTestJSON-1633806383 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:07:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ff714993-751a-4b96-a3ab-1b47c1614afb tempest-SnapshotMetadataTestJSON-1633806383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-470db1aa-517e-4ecd-8ad1-de6b6be389c3 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:07:56 devstack sudo[92583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-470db1aa-517e-4ecd-8ad1-de6b6be389c3 1073741824 Jul 10 10:07:56 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-91f2dde6-4f71-446d-956a-edd69312d104 tempest-AttachVolumeTestJSON-202001593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6ea88d9-fd50-41a4-930b-1605b2fec002) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbafb75e-f1c3-48a2-91fb-8eb5a84c6df9', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:07:56 devstack sudo[92583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:07:56 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-91f2dde6-4f71-446d-956a-edd69312d104 tempest-AttachVolumeTestJSON-202001593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14846a17-761d-462a-ba2b-311452ba3fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:07:56 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-91f2dde6-4f71-446d-956a-edd69312d104 tempest-AttachVolumeTestJSON-202001593 None] Volume volume-fbafb75e-f1c3-48a2-91fb-8eb5a84c6df9 (fbafb75e-f1c3-48a2-91fb-8eb5a84c6df9): created successfully Jul 10 10:07:56 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-91f2dde6-4f71-446d-956a-edd69312d104 tempest-AttachVolumeTestJSON-202001593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14846a17-761d-462a-ba2b-311452ba3fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:07:56 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-91f2dde6-4f71-446d-956a-edd69312d104 tempest-AttachVolumeTestJSON-202001593 None] Flow 'volume_create_manager' (e4210408-e33b-444a-ab03-37d7933705fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:07:56 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-91f2dde6-4f71-446d-956a-edd69312d104 tempest-AttachVolumeTestJSON-202001593 None] Created volume successfully. Jul 10 10:07:56 devstack sudo[92580]: pam_unix(sudo:session): session closed for user root Jul 10 10:07:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-87f46164-bac6-4e99-86b4-85a24ef4fffb tempest-VolumesActionsTest-462141617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e2efc199-51d3-43fd-8d0d-197f2b8a16be" returned: 0 in 0.737s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:07:56 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-87f46164-bac6-4e99-86b4-85a24ef4fffb tempest-VolumesActionsTest-462141617 None] Lock "cinder-quobyte-e2efc199-51d3-43fd-8d0d-197f2b8a16be" released by "delete_volume" :: held 1.790s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:07:56 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-87f46164-bac6-4e99-86b4-85a24ef4fffb tempest-VolumesActionsTest-462141617 None] Created reservations ['9098d9e2-fe09-4386-bf09-6d9fe03878c1', '66f55fd0-3009-4252-9986-88f2aa194e73', 'e4256dea-9f99-4c74-93ad-dc14ea2c63ff', '73bad137-7dc2-4cf4-96c7-77dcbc4e56aa'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:07:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-87f46164-bac6-4e99-86b4-85a24ef4fffb tempest-VolumesActionsTest-462141617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:07:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-87f46164-bac6-4e99-86b4-85a24ef4fffb tempest-VolumesActionsTest-462141617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:07:56 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-87f46164-bac6-4e99-86b4-85a24ef4fffb tempest-VolumesActionsTest-462141617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:07:56 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-87f46164-bac6-4e99-86b4-85a24ef4fffb tempest-VolumesActionsTest-462141617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:07:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-87f46164-bac6-4e99-86b4-85a24ef4fffb tempest-VolumesActionsTest-462141617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:07:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-87f46164-bac6-4e99-86b4-85a24ef4fffb tempest-VolumesActionsTest-462141617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:07:56 devstack sudo[92587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:07:56 devstack sudo[92587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:07:57 devstack sudo[92583]: pam_unix(sudo:session): session closed for user root Jul 10 10:07:57 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ff714993-751a-4b96-a3ab-1b47c1614afb tempest-SnapshotMetadataTestJSON-1633806383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-470db1aa-517e-4ecd-8ad1-de6b6be389c3 1073741824" returned: 0 in 1.085s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:07:57 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ff714993-751a-4b96-a3ab-1b47c1614afb tempest-SnapshotMetadataTestJSON-1633806383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-470db1aa-517e-4ecd-8ad1-de6b6be389c3 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:07:57 devstack sudo[92598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-470db1aa-517e-4ecd-8ad1-de6b6be389c3 Jul 10 10:07:57 devstack sudo[92598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:07:57 devstack sudo[92587]: pam_unix(sudo:session): session closed for user root Jul 10 10:07:57 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-87f46164-bac6-4e99-86b4-85a24ef4fffb tempest-VolumesActionsTest-462141617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.827s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:07:57 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-87f46164-bac6-4e99-86b4-85a24ef4fffb tempest-VolumesActionsTest-462141617 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:07:57 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-87f46164-bac6-4e99-86b4-85a24ef4fffb tempest-VolumesActionsTest-462141617 None] Deleted volume successfully. Jul 10 10:07:57 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-87f46164-bac6-4e99-86b4-85a24ef4fffb tempest-VolumesActionsTest-462141617 None] Lock "cinder-e2efc199-51d3-43fd-8d0d-197f2b8a16be-delete_volume" released by "delete_volume" :: held 2.859s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:07:57 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-28baf434-749f-474e-bb15-056f6327e968 tempest-VolumesActionsTest-1820532270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:07:57 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-28baf434-749f-474e-bb15-056f6327e968 tempest-VolumesActionsTest-1820532270 None] Flow 'volume_create_manager' (d5c4918c-66bc-497d-a4dc-1a800bbbe487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:07:57 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-28baf434-749f-474e-bb15-056f6327e968 tempest-VolumesActionsTest-1820532270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88bb906c-024a-4442-a95a-4760fe2061e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:07:57 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-28baf434-749f-474e-bb15-056f6327e968 tempest-VolumesActionsTest-1820532270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88bb906c-024a-4442-a95a-4760fe2061e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:07:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1092381451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5fc6b66-2d86-4324-8651-bd77193b7650,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881f973d09a7486899687543f9cb7ed4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:07:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:07:57Z,use_quota=True,user_id='35ac5cc870c949268bc6158db3b1f77a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:07:57 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-28baf434-749f-474e-bb15-056f6327e968 tempest-VolumesActionsTest-1820532270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa6f2af8-24b2-40da-8ab1-b7f1bae351eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:07:57 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-28baf434-749f-474e-bb15-056f6327e968 tempest-VolumesActionsTest-1820532270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa6f2af8-24b2-40da-8ab1-b7f1bae351eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:07:57 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-28baf434-749f-474e-bb15-056f6327e968 tempest-VolumesActionsTest-1820532270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd2a1557-8d50-4f29-9e9e-04b9713e5a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:07:57 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-28baf434-749f-474e-bb15-056f6327e968 tempest-VolumesActionsTest-1820532270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd2a1557-8d50-4f29-9e9e-04b9713e5a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5fc6b66-2d86-4324-8651-bd77193b7650', 'volume_name': 'volume-c5fc6b66-2d86-4324-8651-bd77193b7650', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:07:57 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-28baf434-749f-474e-bb15-056f6327e968 tempest-VolumesActionsTest-1820532270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6749d4ff-18ca-4fe6-9b2b-0d4227b887db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:07:57 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-28baf434-749f-474e-bb15-056f6327e968 tempest-VolumesActionsTest-1820532270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6749d4ff-18ca-4fe6-9b2b-0d4227b887db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:07:57 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-28baf434-749f-474e-bb15-056f6327e968 tempest-VolumesActionsTest-1820532270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c06759c0-7fdb-43a2-aa1f-348f5907801c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:07:57 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-28baf434-749f-474e-bb15-056f6327e968 tempest-VolumesActionsTest-1820532270 None] Volume c5fc6b66-2d86-4324-8651-bd77193b7650: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5fc6b66-2d86-4324-8651-bd77193b7650', 'volume_size': 1} Jul 10 10:07:57 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-28baf434-749f-474e-bb15-056f6327e968 tempest-VolumesActionsTest-1820532270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:07:58 devstack sudo[92598]: pam_unix(sudo:session): session closed for user root Jul 10 10:07:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ff714993-751a-4b96-a3ab-1b47c1614afb tempest-SnapshotMetadataTestJSON-1633806383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-470db1aa-517e-4ecd-8ad1-de6b6be389c3" returned: 0 in 0.699s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:07:58 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-ff714993-751a-4b96-a3ab-1b47c1614afb tempest-SnapshotMetadataTestJSON-1633806383 None] <== create_volume: return (1852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:07:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-ff714993-751a-4b96-a3ab-1b47c1614afb tempest-SnapshotMetadataTestJSON-1633806383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.857s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:07:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-28baf434-749f-474e-bb15-056f6327e968 tempest-VolumesActionsTest-1820532270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.484s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:07:58 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-28baf434-749f-474e-bb15-056f6327e968 tempest-VolumesActionsTest-1820532270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:07:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1092381451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5fc6b66-2d86-4324-8651-bd77193b7650,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881f973d09a7486899687543f9cb7ed4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:07:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:07:57Z,use_quota=True,user_id='35ac5cc870c949268bc6158db3b1f77a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:07:58 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-28baf434-749f-474e-bb15-056f6327e968 tempest-VolumesActionsTest-1820532270 None] Creating volume c5fc6b66-2d86-4324-8651-bd77193b7650 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:07:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-28baf434-749f-474e-bb15-056f6327e968 tempest-VolumesActionsTest-1820532270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:07:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-28baf434-749f-474e-bb15-056f6327e968 tempest-VolumesActionsTest-1820532270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:07:58 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-28baf434-749f-474e-bb15-056f6327e968 tempest-VolumesActionsTest-1820532270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:07:58 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-28baf434-749f-474e-bb15-056f6327e968 tempest-VolumesActionsTest-1820532270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:07:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-28baf434-749f-474e-bb15-056f6327e968 tempest-VolumesActionsTest-1820532270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:07:58 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-28baf434-749f-474e-bb15-056f6327e968 tempest-VolumesActionsTest-1820532270 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:07:58 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-28baf434-749f-474e-bb15-056f6327e968 tempest-VolumesActionsTest-1820532270 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:07:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-28baf434-749f-474e-bb15-056f6327e968 tempest-VolumesActionsTest-1820532270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c5fc6b66-2d86-4324-8651-bd77193b7650 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:07:58 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ff714993-751a-4b96-a3ab-1b47c1614afb tempest-SnapshotMetadataTestJSON-1633806383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10ebbc41-87a0-49de-9e86-cdd39d7d3379) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-470db1aa-517e-4ecd-8ad1-de6b6be389c3', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:07:58 devstack sudo[92601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c5fc6b66-2d86-4324-8651-bd77193b7650 1073741824 Jul 10 10:07:58 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ff714993-751a-4b96-a3ab-1b47c1614afb tempest-SnapshotMetadataTestJSON-1633806383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5536805-a477-4aff-93dd-6b43fe05eaa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:07:58 devstack sudo[92601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:07:58 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-ff714993-751a-4b96-a3ab-1b47c1614afb tempest-SnapshotMetadataTestJSON-1633806383 None] Volume volume-470db1aa-517e-4ecd-8ad1-de6b6be389c3 (470db1aa-517e-4ecd-8ad1-de6b6be389c3): created successfully Jul 10 10:07:58 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ff714993-751a-4b96-a3ab-1b47c1614afb tempest-SnapshotMetadataTestJSON-1633806383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5536805-a477-4aff-93dd-6b43fe05eaa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:07:58 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ff714993-751a-4b96-a3ab-1b47c1614afb tempest-SnapshotMetadataTestJSON-1633806383 None] Flow 'volume_create_manager' (c07a0e29-ce64-403a-b7f9-67f6cb22c48d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:07:58 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-ff714993-751a-4b96-a3ab-1b47c1614afb tempest-SnapshotMetadataTestJSON-1633806383 None] Created volume successfully. Jul 10 10:07:58 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-7e614e01-00ed-452c-92a8-ffd5acbfc125 tempest-GroupSnapshotsV319Test-587758063 None] Group tempest-GroupSnapshotsV319Test-Group-1992070152: creating Jul 10 10:07:58 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-7e614e01-00ed-452c-92a8-ffd5acbfc125 tempest-GroupSnapshotsV319Test-587758063 None] Group tempest-GroupSnapshotsV319Test-Group-1992070152: created successfully Jul 10 10:07:58 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-7e614e01-00ed-452c-92a8-ffd5acbfc125 tempest-GroupSnapshotsV319Test-587758063 None] Create group completed successfully. Jul 10 10:07:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-60945b82-c9d8-4dbd-8868-929e717813d2 tempest-SnapshotMetadataTestJSON-1633806383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:07:58 devstack sudo[92601]: pam_unix(sudo:session): session closed for user root Jul 10 10:07:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-28baf434-749f-474e-bb15-056f6327e968 tempest-VolumesActionsTest-1820532270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c5fc6b66-2d86-4324-8651-bd77193b7650 1073741824" returned: 0 in 0.942s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:07:59 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-28baf434-749f-474e-bb15-056f6327e968 tempest-VolumesActionsTest-1820532270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c5fc6b66-2d86-4324-8651-bd77193b7650 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:07:59 devstack sudo[92607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c5fc6b66-2d86-4324-8651-bd77193b7650 Jul 10 10:07:59 devstack sudo[92607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:07:59 devstack sudo[92607]: pam_unix(sudo:session): session closed for user root Jul 10 10:07:59 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-28baf434-749f-474e-bb15-056f6327e968 tempest-VolumesActionsTest-1820532270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c5fc6b66-2d86-4324-8651-bd77193b7650" returned: 0 in 0.665s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:07:59 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-28baf434-749f-474e-bb15-056f6327e968 tempest-VolumesActionsTest-1820532270 None] <== create_volume: return (1649ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:07:59 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-28baf434-749f-474e-bb15-056f6327e968 tempest-VolumesActionsTest-1820532270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.652s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:07:59 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-60945b82-c9d8-4dbd-8868-929e717813d2 tempest-SnapshotMetadataTestJSON-1633806383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.770s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:07:59 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-28baf434-749f-474e-bb15-056f6327e968 tempest-VolumesActionsTest-1820532270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c06759c0-7fdb-43a2-aa1f-348f5907801c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5fc6b66-2d86-4324-8651-bd77193b7650', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:07:59 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-28baf434-749f-474e-bb15-056f6327e968 tempest-VolumesActionsTest-1820532270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bac3276f-76b1-4ea8-87bf-e3aa93c24a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:07:59 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-60945b82-c9d8-4dbd-8868-929e717813d2 tempest-SnapshotMetadataTestJSON-1633806383 None] Creating offline snapshot e66dce5b-ef06-4fd8-b312-65730642d2b2 of volume 470db1aa-517e-4ecd-8ad1-de6b6be389c3 {{(pid=87234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 10:07:59 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-28baf434-749f-474e-bb15-056f6327e968 tempest-VolumesActionsTest-1820532270 None] Volume volume-c5fc6b66-2d86-4324-8651-bd77193b7650 (c5fc6b66-2d86-4324-8651-bd77193b7650): created successfully Jul 10 10:07:59 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-28baf434-749f-474e-bb15-056f6327e968 tempest-VolumesActionsTest-1820532270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bac3276f-76b1-4ea8-87bf-e3aa93c24a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:07:59 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-28baf434-749f-474e-bb15-056f6327e968 tempest-VolumesActionsTest-1820532270 None] Flow 'volume_create_manager' (d5c4918c-66bc-497d-a4dc-1a800bbbe487) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:07:59 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[22922400-c17a-4dfd-b465-4a45d8468cdf]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:07:59 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-60945b82-c9d8-4dbd-8868-929e717813d2 tempest-SnapshotMetadataTestJSON-1633806383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-470db1aa-517e-4ecd-8ad1-de6b6be389c3 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:07:59 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-28baf434-749f-474e-bb15-056f6327e968 tempest-VolumesActionsTest-1820532270 None] Created volume successfully. Jul 10 10:07:59 devstack sudo[92618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-470db1aa-517e-4ecd-8ad1-de6b6be389c3 Jul 10 10:07:59 devstack sudo[92618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:07:59 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-31a1634e-cf2f-4088-9a52-07c4cbab6b31 req-74dbc3c7-949a-4440-85a2-6dac57489a40 tempest-AttachVolumeTestJSON-202001593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:08:00 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-c29d8186-b78c-4787-9788-0b5797447172 tempest-GroupSnapshotsV319Test-587758063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:08:00 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c29d8186-b78c-4787-9788-0b5797447172 tempest-GroupSnapshotsV319Test-587758063 None] Flow 'volume_create_manager' (cb77165c-6098-4401-8eba-2e47afe2b437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:08:00 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c29d8186-b78c-4787-9788-0b5797447172 tempest-GroupSnapshotsV319Test-587758063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc885cb4-5d59-4314-a0ca-b65361c39378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:08:00 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c29d8186-b78c-4787-9788-0b5797447172 tempest-GroupSnapshotsV319Test-587758063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc885cb4-5d59-4314-a0ca-b65361c39378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:08:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2038271583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=64623974-4783-4529-95ed-ae4c51c55282,host='devstack@QuobyteHD#QuobyteHD',id=f2e9d807-b3b9-4adb-8656-827e87e0a616,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17966637fbfd4a0d84947526f63ce56c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:08:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:08:00Z,use_quota=True,user_id='74f123f3bbbf4e93a0dba900ac577ade',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(96f62359-ef51-424e-8936-c3ab61e0d0b9),volume_type_id=96f62359-ef51-424e-8936-c3ab61e0d0b9)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:08:00 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c29d8186-b78c-4787-9788-0b5797447172 tempest-GroupSnapshotsV319Test-587758063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (794b2d48-7fe7-4150-b222-d886a4c1218d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:08:00 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c29d8186-b78c-4787-9788-0b5797447172 tempest-GroupSnapshotsV319Test-587758063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (794b2d48-7fe7-4150-b222-d886a4c1218d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:08:00 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c29d8186-b78c-4787-9788-0b5797447172 tempest-GroupSnapshotsV319Test-587758063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06a26d6b-1917-4811-9555-f8147c9edc8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:08:00 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c29d8186-b78c-4787-9788-0b5797447172 tempest-GroupSnapshotsV319Test-587758063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06a26d6b-1917-4811-9555-f8147c9edc8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2e9d807-b3b9-4adb-8656-827e87e0a616', 'volume_name': 'volume-f2e9d807-b3b9-4adb-8656-827e87e0a616', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:08:00 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c29d8186-b78c-4787-9788-0b5797447172 tempest-GroupSnapshotsV319Test-587758063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0f0e1de-8055-4b8a-aee3-3a7c4f517c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:08:00 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c29d8186-b78c-4787-9788-0b5797447172 tempest-GroupSnapshotsV319Test-587758063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0f0e1de-8055-4b8a-aee3-3a7c4f517c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:08:00 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c29d8186-b78c-4787-9788-0b5797447172 tempest-GroupSnapshotsV319Test-587758063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a644c9e-efde-4fc9-b28a-67e6b15c64fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:08:00 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-c29d8186-b78c-4787-9788-0b5797447172 tempest-GroupSnapshotsV319Test-587758063 None] Volume f2e9d807-b3b9-4adb-8656-827e87e0a616: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2e9d807-b3b9-4adb-8656-827e87e0a616', 'volume_size': 1} Jul 10 10:08:00 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-c29d8186-b78c-4787-9788-0b5797447172 tempest-GroupSnapshotsV319Test-587758063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:08:00 devstack sudo[92618]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:00 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-60945b82-c9d8-4dbd-8868-929e717813d2 tempest-SnapshotMetadataTestJSON-1633806383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-470db1aa-517e-4ecd-8ad1-de6b6be389c3" returned: 0 in 0.832s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:00 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-60945b82-c9d8-4dbd-8868-929e717813d2 tempest-SnapshotMetadataTestJSON-1633806383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-470db1aa-517e-4ecd-8ad1-de6b6be389c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-470db1aa-517e-4ecd-8ad1-de6b6be389c3.e66dce5b-ef06-4fd8-b312-65730642d2b2 1G {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:00 devstack sudo[92624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-470db1aa-517e-4ecd-8ad1-de6b6be389c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-470db1aa-517e-4ecd-8ad1-de6b6be389c3.e66dce5b-ef06-4fd8-b312-65730642d2b2 1G Jul 10 10:08:00 devstack sudo[92624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:00 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-ff910b4e-a24f-437f-91ce-39a70299b7f2 tempest-VolumesActionsTest-462141617 None] Acquiring lock "cinder-c5fc6b66-2d86-4324-8651-bd77193b7650-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:08:00 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-ff910b4e-a24f-437f-91ce-39a70299b7f2 tempest-VolumesActionsTest-462141617 None] Lock "cinder-c5fc6b66-2d86-4324-8651-bd77193b7650-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:08:00 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-ff910b4e-a24f-437f-91ce-39a70299b7f2 tempest-VolumesActionsTest-462141617 None] Acquiring lock "cinder-quobyte-c5fc6b66-2d86-4324-8651-bd77193b7650" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:08:00 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-ff910b4e-a24f-437f-91ce-39a70299b7f2 tempest-VolumesActionsTest-462141617 None] Lock "cinder-quobyte-c5fc6b66-2d86-4324-8651-bd77193b7650" acquired by "delete_volume" :: waited 0.019s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:08:00 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea99034-b40f-4be8-8e2b-fed98a5b747c]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:08:00 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ff910b4e-a24f-437f-91ce-39a70299b7f2 tempest-VolumesActionsTest-462141617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c5fc6b66-2d86-4324-8651-bd77193b7650 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:00 devstack sudo[92626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c5fc6b66-2d86-4324-8651-bd77193b7650 Jul 10 10:08:00 devstack sudo[92626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:01 devstack sudo[92624]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:01 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-60945b82-c9d8-4dbd-8868-929e717813d2 tempest-SnapshotMetadataTestJSON-1633806383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-470db1aa-517e-4ecd-8ad1-de6b6be389c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-470db1aa-517e-4ecd-8ad1-de6b6be389c3.e66dce5b-ef06-4fd8-b312-65730642d2b2 1G" returned: 0 in 0.843s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:01 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-60945b82-c9d8-4dbd-8868-929e717813d2 tempest-SnapshotMetadataTestJSON-1633806383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-470db1aa-517e-4ecd-8ad1-de6b6be389c3 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-470db1aa-517e-4ecd-8ad1-de6b6be389c3.e66dce5b-ef06-4fd8-b312-65730642d2b2 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:01 devstack sudo[92631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-470db1aa-517e-4ecd-8ad1-de6b6be389c3 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-470db1aa-517e-4ecd-8ad1-de6b6be389c3.e66dce5b-ef06-4fd8-b312-65730642d2b2 Jul 10 10:08:01 devstack sudo[92631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:01 devstack sudo[92626]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:01 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ff910b4e-a24f-437f-91ce-39a70299b7f2 tempest-VolumesActionsTest-462141617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c5fc6b66-2d86-4324-8651-bd77193b7650" returned: 0 in 0.801s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:01 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ff910b4e-a24f-437f-91ce-39a70299b7f2 tempest-VolumesActionsTest-462141617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c5fc6b66-2d86-4324-8651-bd77193b7650 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:01 devstack sudo[92636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c5fc6b66-2d86-4324-8651-bd77193b7650 Jul 10 10:08:01 devstack sudo[92636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:02 devstack sudo[92631]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-60945b82-c9d8-4dbd-8868-929e717813d2 tempest-SnapshotMetadataTestJSON-1633806383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-470db1aa-517e-4ecd-8ad1-de6b6be389c3 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-470db1aa-517e-4ecd-8ad1-de6b6be389c3.e66dce5b-ef06-4fd8-b312-65730642d2b2" returned: 0 in 0.704s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:02 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-60945b82-c9d8-4dbd-8868-929e717813d2 tempest-SnapshotMetadataTestJSON-1633806383 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-470db1aa-517e-4ecd-8ad1-de6b6be389c3.e66dce5b-ef06-4fd8-b312-65730642d2b2 is being set with open permissions: ugo+rw Jul 10 10:08:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-60945b82-c9d8-4dbd-8868-929e717813d2 tempest-SnapshotMetadataTestJSON-1633806383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-470db1aa-517e-4ecd-8ad1-de6b6be389c3.e66dce5b-ef06-4fd8-b312-65730642d2b2 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:02 devstack sudo[92641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-470db1aa-517e-4ecd-8ad1-de6b6be389c3.e66dce5b-ef06-4fd8-b312-65730642d2b2 Jul 10 10:08:02 devstack sudo[92641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:02 devstack sudo[92636]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ff910b4e-a24f-437f-91ce-39a70299b7f2 tempest-VolumesActionsTest-462141617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c5fc6b66-2d86-4324-8651-bd77193b7650" returned: 0 in 0.685s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:02 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-ff910b4e-a24f-437f-91ce-39a70299b7f2 tempest-VolumesActionsTest-462141617 None] Lock "cinder-quobyte-c5fc6b66-2d86-4324-8651-bd77193b7650" released by "delete_volume" :: held 1.536s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:08:02 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-ff910b4e-a24f-437f-91ce-39a70299b7f2 tempest-VolumesActionsTest-462141617 None] Created reservations ['f08429d8-18c9-4d0b-a491-2ee19eba5563', '15212f84-7926-499a-aac5-c8cc1660485c', '8822bc81-497c-48b5-83a4-9fb11745f958', '71124b47-01a3-4410-976a-7b145b2c9940'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:08:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-ff910b4e-a24f-437f-91ce-39a70299b7f2 tempest-VolumesActionsTest-462141617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:08:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-ff910b4e-a24f-437f-91ce-39a70299b7f2 tempest-VolumesActionsTest-462141617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:08:02 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-ff910b4e-a24f-437f-91ce-39a70299b7f2 tempest-VolumesActionsTest-462141617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:08:02 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-ff910b4e-a24f-437f-91ce-39a70299b7f2 tempest-VolumesActionsTest-462141617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:08:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-ff910b4e-a24f-437f-91ce-39a70299b7f2 tempest-VolumesActionsTest-462141617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:08:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ff910b4e-a24f-437f-91ce-39a70299b7f2 tempest-VolumesActionsTest-462141617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:02 devstack sudo[92644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:08:02 devstack sudo[92644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:02 devstack sudo[92641]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-60945b82-c9d8-4dbd-8868-929e717813d2 tempest-SnapshotMetadataTestJSON-1633806383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-470db1aa-517e-4ecd-8ad1-de6b6be389c3.e66dce5b-ef06-4fd8-b312-65730642d2b2" returned: 0 in 0.670s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-60945b82-c9d8-4dbd-8868-929e717813d2 tempest-SnapshotMetadataTestJSON-1633806383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-470db1aa-517e-4ecd-8ad1-de6b6be389c3.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:02 devstack sudo[92647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-470db1aa-517e-4ecd-8ad1-de6b6be389c3.info Jul 10 10:08:02 devstack sudo[92647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:03 devstack sudo[92644]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ff910b4e-a24f-437f-91ce-39a70299b7f2 tempest-VolumesActionsTest-462141617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.697s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:03 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-ff910b4e-a24f-437f-91ce-39a70299b7f2 tempest-VolumesActionsTest-462141617 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:08:03 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-ff910b4e-a24f-437f-91ce-39a70299b7f2 tempest-VolumesActionsTest-462141617 None] Deleted volume successfully. Jul 10 10:08:03 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-ff910b4e-a24f-437f-91ce-39a70299b7f2 tempest-VolumesActionsTest-462141617 None] Lock "cinder-c5fc6b66-2d86-4324-8651-bd77193b7650-delete_volume" released by "delete_volume" :: held 2.476s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:08:03 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-21494694-7df2-48ce-a206-c92f33d7b493 tempest-VolumesActionsTest-1820532270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:08:03 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-21494694-7df2-48ce-a206-c92f33d7b493 tempest-VolumesActionsTest-1820532270 None] Flow 'volume_create_manager' (9de4f988-be56-4ec9-89ca-4e7e0eea5953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:08:03 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-21494694-7df2-48ce-a206-c92f33d7b493 tempest-VolumesActionsTest-1820532270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6f59181-69de-437d-ab90-ad52bd05296a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:08:03 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-21494694-7df2-48ce-a206-c92f33d7b493 tempest-VolumesActionsTest-1820532270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6f59181-69de-437d-ab90-ad52bd05296a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:08:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-272181445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2565c256-d7ce-4f4b-ad58-95a329fb41b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881f973d09a7486899687543f9cb7ed4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:08:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:08:03Z,use_quota=True,user_id='35ac5cc870c949268bc6158db3b1f77a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:08:03 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-21494694-7df2-48ce-a206-c92f33d7b493 tempest-VolumesActionsTest-1820532270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (845f3ee5-d272-4725-9d50-abd1540ad165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:08:03 devstack sudo[92647]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:03 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-21494694-7df2-48ce-a206-c92f33d7b493 tempest-VolumesActionsTest-1820532270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (845f3ee5-d272-4725-9d50-abd1540ad165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:08:03 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-21494694-7df2-48ce-a206-c92f33d7b493 tempest-VolumesActionsTest-1820532270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (532b3160-710e-424f-9d1b-eefe39e0173b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:08:03 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-21494694-7df2-48ce-a206-c92f33d7b493 tempest-VolumesActionsTest-1820532270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (532b3160-710e-424f-9d1b-eefe39e0173b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2565c256-d7ce-4f4b-ad58-95a329fb41b7', 'volume_name': 'volume-2565c256-d7ce-4f4b-ad58-95a329fb41b7', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:08:03 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-21494694-7df2-48ce-a206-c92f33d7b493 tempest-VolumesActionsTest-1820532270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90ae8996-9528-489b-94b8-9527861bc78c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:08:03 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-21494694-7df2-48ce-a206-c92f33d7b493 tempest-VolumesActionsTest-1820532270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90ae8996-9528-489b-94b8-9527861bc78c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:08:03 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-21494694-7df2-48ce-a206-c92f33d7b493 tempest-VolumesActionsTest-1820532270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf0a57b8-d340-4461-901e-7b27f75d9330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:08:03 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-21494694-7df2-48ce-a206-c92f33d7b493 tempest-VolumesActionsTest-1820532270 None] Volume 2565c256-d7ce-4f4b-ad58-95a329fb41b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2565c256-d7ce-4f4b-ad58-95a329fb41b7', 'volume_size': 1} Jul 10 10:08:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-21494694-7df2-48ce-a206-c92f33d7b493 tempest-VolumesActionsTest-1820532270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:08:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-60945b82-c9d8-4dbd-8868-929e717813d2 tempest-SnapshotMetadataTestJSON-1633806383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-470db1aa-517e-4ecd-8ad1-de6b6be389c3.info" returned: 0 in 0.690s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:03 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-60945b82-c9d8-4dbd-8868-929e717813d2 tempest-SnapshotMetadataTestJSON-1633806383 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-470db1aa-517e-4ecd-8ad1-de6b6be389c3.info is being set with open permissions: ugo+rw Jul 10 10:08:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-60945b82-c9d8-4dbd-8868-929e717813d2 tempest-SnapshotMetadataTestJSON-1633806383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-470db1aa-517e-4ecd-8ad1-de6b6be389c3.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:03 devstack sudo[92651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-470db1aa-517e-4ecd-8ad1-de6b6be389c3.info Jul 10 10:08:03 devstack sudo[92651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:04 devstack sudo[92651]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-60945b82-c9d8-4dbd-8868-929e717813d2 tempest-SnapshotMetadataTestJSON-1633806383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-470db1aa-517e-4ecd-8ad1-de6b6be389c3.info" returned: 0 in 0.627s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-60945b82-c9d8-4dbd-8868-929e717813d2 tempest-SnapshotMetadataTestJSON-1633806383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.504s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:08:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-31a1634e-cf2f-4088-9a52-07c4cbab6b31 req-74dbc3c7-949a-4440-85a2-6dac57489a40 tempest-AttachVolumeTestJSON-202001593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.276s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:08:04 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[795ec526-7761-4ae4-9c7f-a6b1a09983c3]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:08:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-31a1634e-cf2f-4088-9a52-07c4cbab6b31 req-74dbc3c7-949a-4440-85a2-6dac57489a40 tempest-AttachVolumeTestJSON-202001593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-fbafb75e-f1c3-48a2-91fb-8eb5a84c6df9 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:04 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-60945b82-c9d8-4dbd-8868-929e717813d2 tempest-SnapshotMetadataTestJSON-1633806383 None] Create snapshot completed successfully Jul 10 10:08:04 devstack sudo[92654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-fbafb75e-f1c3-48a2-91fb-8eb5a84c6df9 Jul 10 10:08:04 devstack sudo[92654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:04 devstack sudo[92654]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-31a1634e-cf2f-4088-9a52-07c4cbab6b31 req-74dbc3c7-949a-4440-85a2-6dac57489a40 tempest-AttachVolumeTestJSON-202001593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-fbafb75e-f1c3-48a2-91fb-8eb5a84c6df9" returned: 0 in 0.756s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-31a1634e-cf2f-4088-9a52-07c4cbab6b31 req-74dbc3c7-949a-4440-85a2-6dac57489a40 tempest-AttachVolumeTestJSON-202001593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.775s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:08:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-c29d8186-b78c-4787-9788-0b5797447172 tempest-GroupSnapshotsV319Test-587758063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.568s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:08:04 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-c29d8186-b78c-4787-9788-0b5797447172 tempest-GroupSnapshotsV319Test-587758063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=64623974-4783-4529-95ed-ae4c51c55282,created_at=2026-07-10T08:08:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2038271583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=64623974-4783-4529-95ed-ae4c51c55282,host='devstack@QuobyteHD#QuobyteHD',id=f2e9d807-b3b9-4adb-8656-827e87e0a616,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17966637fbfd4a0d84947526f63ce56c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:08:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:08:00Z,use_quota=True,user_id='74f123f3bbbf4e93a0dba900ac577ade',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(96f62359-ef51-424e-8936-c3ab61e0d0b9),volume_type_id=96f62359-ef51-424e-8936-c3ab61e0d0b9)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:08:04 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-c29d8186-b78c-4787-9788-0b5797447172 tempest-GroupSnapshotsV319Test-587758063 None] Creating volume f2e9d807-b3b9-4adb-8656-827e87e0a616 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:08:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-c29d8186-b78c-4787-9788-0b5797447172 tempest-GroupSnapshotsV319Test-587758063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:08:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-c29d8186-b78c-4787-9788-0b5797447172 tempest-GroupSnapshotsV319Test-587758063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:08:04 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-c29d8186-b78c-4787-9788-0b5797447172 tempest-GroupSnapshotsV319Test-587758063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:08:04 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-c29d8186-b78c-4787-9788-0b5797447172 tempest-GroupSnapshotsV319Test-587758063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:08:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-c29d8186-b78c-4787-9788-0b5797447172 tempest-GroupSnapshotsV319Test-587758063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:08:04 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-c29d8186-b78c-4787-9788-0b5797447172 tempest-GroupSnapshotsV319Test-587758063 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:08:04 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-c29d8186-b78c-4787-9788-0b5797447172 tempest-GroupSnapshotsV319Test-587758063 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:08:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c29d8186-b78c-4787-9788-0b5797447172 tempest-GroupSnapshotsV319Test-587758063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f2e9d807-b3b9-4adb-8656-827e87e0a616 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:04 devstack sudo[92659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f2e9d807-b3b9-4adb-8656-827e87e0a616 1073741824 Jul 10 10:08:04 devstack sudo[92659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:05 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [req-31a1634e-cf2f-4088-9a52-07c4cbab6b31 req-74dbc3c7-949a-4440-85a2-6dac57489a40 tempest-AttachVolumeTestJSON-202001593 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091', 'name': 'volume-fbafb75e-f1c3-48a2-91fb-8eb5a84c6df9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd9b55b7d-8be1-4954-91bf-623f87ba1460', 'enforce_multipath': True} {{(pid=87234) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 10:08:05 devstack cinder-volume[87234]: INFO cinder.volume.manager [req-31a1634e-cf2f-4088-9a52-07c4cbab6b31 req-74dbc3c7-949a-4440-85a2-6dac57489a40 tempest-AttachVolumeTestJSON-202001593 None] attachment_update completed successfully. Jul 10 10:08:05 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-6ef64730-0e45-4631-8fdc-9e677613f563 tempest-SnapshotMetadataTestJSON-1633806383 None] Acquiring lock "cinder-e66dce5b-ef06-4fd8-b312-65730642d2b2-delete_snapshot" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:08:05 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-6ef64730-0e45-4631-8fdc-9e677613f563 tempest-SnapshotMetadataTestJSON-1633806383 None] Lock "cinder-e66dce5b-ef06-4fd8-b312-65730642d2b2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:08:05 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-6ef64730-0e45-4631-8fdc-9e677613f563 tempest-SnapshotMetadataTestJSON-1633806383 None] Acquiring lock "cinder-quobyte-470db1aa-517e-4ecd-8ad1-de6b6be389c3" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:08:05 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-6ef64730-0e45-4631-8fdc-9e677613f563 tempest-SnapshotMetadataTestJSON-1633806383 None] Lock "cinder-quobyte-470db1aa-517e-4ecd-8ad1-de6b6be389c3" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:08:05 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-6ef64730-0e45-4631-8fdc-9e677613f563 tempest-SnapshotMetadataTestJSON-1633806383 None] Acquiring lock "cinder-quobyte-e66dce5b-ef06-4fd8-b312-65730642d2b2" by "_delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:08:05 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-6ef64730-0e45-4631-8fdc-9e677613f563 tempest-SnapshotMetadataTestJSON-1633806383 None] Lock "cinder-quobyte-e66dce5b-ef06-4fd8-b312-65730642d2b2" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:08:05 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-6ef64730-0e45-4631-8fdc-9e677613f563 tempest-SnapshotMetadataTestJSON-1633806383 None] Deleting offline snapshot e66dce5b-ef06-4fd8-b312-65730642d2b2 of volume 470db1aa-517e-4ecd-8ad1-de6b6be389c3 {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 10:08:05 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-6ef64730-0e45-4631-8fdc-9e677613f563 tempest-SnapshotMetadataTestJSON-1633806383 None] snapshot_file for this snap is: volume-470db1aa-517e-4ecd-8ad1-de6b6be389c3.e66dce5b-ef06-4fd8-b312-65730642d2b2 {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 10:08:05 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7af30bf-7f5c-4d65-9edc-cbc03affdb78]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:08:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-6ef64730-0e45-4631-8fdc-9e677613f563 tempest-SnapshotMetadataTestJSON-1633806383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-470db1aa-517e-4ecd-8ad1-de6b6be389c3.e66dce5b-ef06-4fd8-b312-65730642d2b2 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:05 devstack sudo[92661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-470db1aa-517e-4ecd-8ad1-de6b6be389c3.e66dce5b-ef06-4fd8-b312-65730642d2b2 Jul 10 10:08:05 devstack sudo[92661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:05 devstack sudo[92659]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c29d8186-b78c-4787-9788-0b5797447172 tempest-GroupSnapshotsV319Test-587758063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f2e9d807-b3b9-4adb-8656-827e87e0a616 1073741824" returned: 0 in 0.899s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c29d8186-b78c-4787-9788-0b5797447172 tempest-GroupSnapshotsV319Test-587758063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f2e9d807-b3b9-4adb-8656-827e87e0a616 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:05 devstack sudo[92733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f2e9d807-b3b9-4adb-8656-827e87e0a616 Jul 10 10:08:05 devstack sudo[92733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:06 devstack sudo[92661]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-6ef64730-0e45-4631-8fdc-9e677613f563 tempest-SnapshotMetadataTestJSON-1633806383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-470db1aa-517e-4ecd-8ad1-de6b6be389c3.e66dce5b-ef06-4fd8-b312-65730642d2b2" returned: 0 in 0.919s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:06 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-6ef64730-0e45-4631-8fdc-9e677613f563 tempest-SnapshotMetadataTestJSON-1633806383 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-470db1aa-517e-4ecd-8ad1-de6b6be389c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 10:08:06 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[f42a5c43-215d-4ada-80d4-912fa3740eed]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:08:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-6ef64730-0e45-4631-8fdc-9e677613f563 tempest-SnapshotMetadataTestJSON-1633806383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-470db1aa-517e-4ecd-8ad1-de6b6be389c3 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:06 devstack sudo[93053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-470db1aa-517e-4ecd-8ad1-de6b6be389c3 Jul 10 10:08:06 devstack sudo[93053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:06 devstack sudo[92733]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c29d8186-b78c-4787-9788-0b5797447172 tempest-GroupSnapshotsV319Test-587758063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f2e9d807-b3b9-4adb-8656-827e87e0a616" returned: 0 in 0.691s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:06 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-c29d8186-b78c-4787-9788-0b5797447172 tempest-GroupSnapshotsV319Test-587758063 None] <== create_volume: return (1629ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:08:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-c29d8186-b78c-4787-9788-0b5797447172 tempest-GroupSnapshotsV319Test-587758063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.633s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:08:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-21494694-7df2-48ce-a206-c92f33d7b493 tempest-VolumesActionsTest-1820532270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.071s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:08:06 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-21494694-7df2-48ce-a206-c92f33d7b493 tempest-VolumesActionsTest-1820532270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:08:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-272181445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2565c256-d7ce-4f4b-ad58-95a329fb41b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881f973d09a7486899687543f9cb7ed4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:08:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:08:03Z,use_quota=True,user_id='35ac5cc870c949268bc6158db3b1f77a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:08:06 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-21494694-7df2-48ce-a206-c92f33d7b493 tempest-VolumesActionsTest-1820532270 None] Creating volume 2565c256-d7ce-4f4b-ad58-95a329fb41b7 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:08:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-21494694-7df2-48ce-a206-c92f33d7b493 tempest-VolumesActionsTest-1820532270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:08:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-21494694-7df2-48ce-a206-c92f33d7b493 tempest-VolumesActionsTest-1820532270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:08:06 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-21494694-7df2-48ce-a206-c92f33d7b493 tempest-VolumesActionsTest-1820532270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:08:06 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-21494694-7df2-48ce-a206-c92f33d7b493 tempest-VolumesActionsTest-1820532270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:08:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-21494694-7df2-48ce-a206-c92f33d7b493 tempest-VolumesActionsTest-1820532270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:08:06 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-21494694-7df2-48ce-a206-c92f33d7b493 tempest-VolumesActionsTest-1820532270 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:08:06 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-21494694-7df2-48ce-a206-c92f33d7b493 tempest-VolumesActionsTest-1820532270 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:08:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-21494694-7df2-48ce-a206-c92f33d7b493 tempest-VolumesActionsTest-1820532270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2565c256-d7ce-4f4b-ad58-95a329fb41b7 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:06 devstack sudo[93057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2565c256-d7ce-4f4b-ad58-95a329fb41b7 1073741824 Jul 10 10:08:06 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c29d8186-b78c-4787-9788-0b5797447172 tempest-GroupSnapshotsV319Test-587758063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a644c9e-efde-4fc9-b28a-67e6b15c64fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2e9d807-b3b9-4adb-8656-827e87e0a616', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:08:06 devstack sudo[93057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:06 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c29d8186-b78c-4787-9788-0b5797447172 tempest-GroupSnapshotsV319Test-587758063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f814b3fc-438f-475f-add6-16ffa491e6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:08:06 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-c29d8186-b78c-4787-9788-0b5797447172 tempest-GroupSnapshotsV319Test-587758063 None] Volume volume-f2e9d807-b3b9-4adb-8656-827e87e0a616 (f2e9d807-b3b9-4adb-8656-827e87e0a616): created successfully Jul 10 10:08:06 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c29d8186-b78c-4787-9788-0b5797447172 tempest-GroupSnapshotsV319Test-587758063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f814b3fc-438f-475f-add6-16ffa491e6c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:08:06 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c29d8186-b78c-4787-9788-0b5797447172 tempest-GroupSnapshotsV319Test-587758063 None] Flow 'volume_create_manager' (cb77165c-6098-4401-8eba-2e47afe2b437) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:08:06 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-c29d8186-b78c-4787-9788-0b5797447172 tempest-GroupSnapshotsV319Test-587758063 None] Created volume successfully. Jul 10 10:08:07 devstack sudo[93053]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-6ef64730-0e45-4631-8fdc-9e677613f563 tempest-SnapshotMetadataTestJSON-1633806383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-470db1aa-517e-4ecd-8ad1-de6b6be389c3" returned: 0 in 0.796s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-6ef64730-0e45-4631-8fdc-9e677613f563 tempest-SnapshotMetadataTestJSON-1633806383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-470db1aa-517e-4ecd-8ad1-de6b6be389c3.e66dce5b-ef06-4fd8-b312-65730642d2b2 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:07 devstack sudo[93062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-470db1aa-517e-4ecd-8ad1-de6b6be389c3.e66dce5b-ef06-4fd8-b312-65730642d2b2 Jul 10 10:08:07 devstack sudo[93062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:07 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-0447040f-f1b6-47cf-960d-4373ed38d532 tempest-GroupSnapshotsV319Test-587758063 None] GroupSnapshot aea301fe-d881-46ca-a6a5-d3b152f81bd1: creating. Jul 10 10:08:07 devstack sudo[93057]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-21494694-7df2-48ce-a206-c92f33d7b493 tempest-VolumesActionsTest-1820532270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2565c256-d7ce-4f4b-ad58-95a329fb41b7 1073741824" returned: 0 in 0.955s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:07 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-0447040f-f1b6-47cf-960d-4373ed38d532 tempest-GroupSnapshotsV319Test-587758063 None] Group snapshot aea301fe-d881-46ca-a6a5-d3b152f81bd1: creating. {{(pid=87234) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 10 10:08:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-0447040f-f1b6-47cf-960d-4373ed38d532 tempest-GroupSnapshotsV319Test-587758063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:08:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-21494694-7df2-48ce-a206-c92f33d7b493 tempest-VolumesActionsTest-1820532270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2565c256-d7ce-4f4b-ad58-95a329fb41b7 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:07 devstack sudo[93067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2565c256-d7ce-4f4b-ad58-95a329fb41b7 Jul 10 10:08:07 devstack sudo[93067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:07 devstack sudo[93062]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-6ef64730-0e45-4631-8fdc-9e677613f563 tempest-SnapshotMetadataTestJSON-1633806383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-470db1aa-517e-4ecd-8ad1-de6b6be389c3.e66dce5b-ef06-4fd8-b312-65730642d2b2" returned: 0 in 0.778s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-6ef64730-0e45-4631-8fdc-9e677613f563 tempest-SnapshotMetadataTestJSON-1633806383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-470db1aa-517e-4ecd-8ad1-de6b6be389c3.e66dce5b-ef06-4fd8-b312-65730642d2b2 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:07 devstack sudo[93072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-470db1aa-517e-4ecd-8ad1-de6b6be389c3.e66dce5b-ef06-4fd8-b312-65730642d2b2 Jul 10 10:08:07 devstack sudo[93072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:08 devstack sudo[93067]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:08 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-21494694-7df2-48ce-a206-c92f33d7b493 tempest-VolumesActionsTest-1820532270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2565c256-d7ce-4f4b-ad58-95a329fb41b7" returned: 0 in 0.665s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:08 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-21494694-7df2-48ce-a206-c92f33d7b493 tempest-VolumesActionsTest-1820532270 None] <== create_volume: return (1672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:08:08 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-21494694-7df2-48ce-a206-c92f33d7b493 tempest-VolumesActionsTest-1820532270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.675s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:08:08 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-0447040f-f1b6-47cf-960d-4373ed38d532 tempest-GroupSnapshotsV319Test-587758063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.680s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:08:08 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-21494694-7df2-48ce-a206-c92f33d7b493 tempest-VolumesActionsTest-1820532270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf0a57b8-d340-4461-901e-7b27f75d9330) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2565c256-d7ce-4f4b-ad58-95a329fb41b7', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:08:08 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-21494694-7df2-48ce-a206-c92f33d7b493 tempest-VolumesActionsTest-1820532270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af37b69a-9f3e-4847-8bfc-629f2851ddc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:08:08 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-0447040f-f1b6-47cf-960d-4373ed38d532 tempest-GroupSnapshotsV319Test-587758063 None] Creating offline snapshot 280761d0-09fd-4d26-a38c-c08e48940005 of volume f2e9d807-b3b9-4adb-8656-827e87e0a616 {{(pid=87234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 10:08:08 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-21494694-7df2-48ce-a206-c92f33d7b493 tempest-VolumesActionsTest-1820532270 None] Volume volume-2565c256-d7ce-4f4b-ad58-95a329fb41b7 (2565c256-d7ce-4f4b-ad58-95a329fb41b7): created successfully Jul 10 10:08:08 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-21494694-7df2-48ce-a206-c92f33d7b493 tempest-VolumesActionsTest-1820532270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af37b69a-9f3e-4847-8bfc-629f2851ddc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:08:08 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-21494694-7df2-48ce-a206-c92f33d7b493 tempest-VolumesActionsTest-1820532270 None] Flow 'volume_create_manager' (9de4f988-be56-4ec9-89ca-4e7e0eea5953) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:08:08 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0fde532-d800-4ea4-9a80-4b1f3745b573]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:08:08 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0447040f-f1b6-47cf-960d-4373ed38d532 tempest-GroupSnapshotsV319Test-587758063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f2e9d807-b3b9-4adb-8656-827e87e0a616 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:08 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-21494694-7df2-48ce-a206-c92f33d7b493 tempest-VolumesActionsTest-1820532270 None] Created volume successfully. Jul 10 10:08:08 devstack sudo[93075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f2e9d807-b3b9-4adb-8656-827e87e0a616 Jul 10 10:08:08 devstack sudo[93075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:08 devstack sudo[93072]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:08 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-6ef64730-0e45-4631-8fdc-9e677613f563 tempest-SnapshotMetadataTestJSON-1633806383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-470db1aa-517e-4ecd-8ad1-de6b6be389c3.e66dce5b-ef06-4fd8-b312-65730642d2b2" returned: 0 in 0.708s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:08 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-6ef64730-0e45-4631-8fdc-9e677613f563 tempest-SnapshotMetadataTestJSON-1633806383 None] Lock "cinder-quobyte-e66dce5b-ef06-4fd8-b312-65730642d2b2" released by "_delete_snapshot" :: held 3.327s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:08:08 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-6ef64730-0e45-4631-8fdc-9e677613f563 tempest-SnapshotMetadataTestJSON-1633806383 None] Lock "cinder-quobyte-470db1aa-517e-4ecd-8ad1-de6b6be389c3" released by "delete_snapshot" :: held 3.348s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:08:08 devstack cinder-volume[87234]: WARNING cinder.quota [None req-6ef64730-0e45-4631-8fdc-9e677613f563 tempest-SnapshotMetadataTestJSON-1633806383 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 10 10:08:08 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-6ef64730-0e45-4631-8fdc-9e677613f563 tempest-SnapshotMetadataTestJSON-1633806383 None] Created reservations ['82edaf77-32ef-47d1-b899-c60f4b317be2', '2f912f1c-c20b-4dd3-97ea-85f70c8ced0b', 'bfaed4d3-2511-4aac-858d-1b284dd674e8', 'c5f5122a-9191-4e2f-911b-417f2dfdd728'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:08:08 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-6ef64730-0e45-4631-8fdc-9e677613f563 tempest-SnapshotMetadataTestJSON-1633806383 None] Delete snapshot completed successfully. Jul 10 10:08:08 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-6ef64730-0e45-4631-8fdc-9e677613f563 tempest-SnapshotMetadataTestJSON-1633806383 None] Lock "cinder-e66dce5b-ef06-4fd8-b312-65730642d2b2-delete_snapshot" released by "delete_snapshot" :: held 3.505s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:08:09 devstack sudo[93075]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:09 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0447040f-f1b6-47cf-960d-4373ed38d532 tempest-GroupSnapshotsV319Test-587758063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f2e9d807-b3b9-4adb-8656-827e87e0a616" returned: 0 in 0.823s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:09 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0447040f-f1b6-47cf-960d-4373ed38d532 tempest-GroupSnapshotsV319Test-587758063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f2e9d807-b3b9-4adb-8656-827e87e0a616,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f2e9d807-b3b9-4adb-8656-827e87e0a616.280761d0-09fd-4d26-a38c-c08e48940005 1G {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:09 devstack sudo[93081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f2e9d807-b3b9-4adb-8656-827e87e0a616,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f2e9d807-b3b9-4adb-8656-827e87e0a616.280761d0-09fd-4d26-a38c-c08e48940005 1G Jul 10 10:08:09 devstack sudo[93081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:09 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-9cdeca55-fcb7-4a14-a256-b980240b3468 tempest-VolumesActionsTest-1820532270 None] Acquiring lock "cinder-2565c256-d7ce-4f4b-ad58-95a329fb41b7-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:08:09 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-9cdeca55-fcb7-4a14-a256-b980240b3468 tempest-VolumesActionsTest-1820532270 None] Lock "cinder-2565c256-d7ce-4f4b-ad58-95a329fb41b7-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:08:09 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-9cdeca55-fcb7-4a14-a256-b980240b3468 tempest-VolumesActionsTest-1820532270 None] Acquiring lock "cinder-quobyte-2565c256-d7ce-4f4b-ad58-95a329fb41b7" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:08:09 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-9cdeca55-fcb7-4a14-a256-b980240b3468 tempest-VolumesActionsTest-1820532270 None] Lock "cinder-quobyte-2565c256-d7ce-4f4b-ad58-95a329fb41b7" acquired by "delete_volume" :: waited 0.016s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:08:09 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfdc36c9-0adc-4a1a-8e48-aa6026120604]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:08:09 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9cdeca55-fcb7-4a14-a256-b980240b3468 tempest-VolumesActionsTest-1820532270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2565c256-d7ce-4f4b-ad58-95a329fb41b7 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:09 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-24c8e71a-9c11-44fb-9fdd-4f4b5bb6b564 tempest-SnapshotMetadataTestJSON-1633806383 None] Acquiring lock "cinder-470db1aa-517e-4ecd-8ad1-de6b6be389c3-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:08:09 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-24c8e71a-9c11-44fb-9fdd-4f4b5bb6b564 tempest-SnapshotMetadataTestJSON-1633806383 None] Lock "cinder-470db1aa-517e-4ecd-8ad1-de6b6be389c3-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:08:09 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-24c8e71a-9c11-44fb-9fdd-4f4b5bb6b564 tempest-SnapshotMetadataTestJSON-1633806383 None] Acquiring lock "cinder-quobyte-470db1aa-517e-4ecd-8ad1-de6b6be389c3" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:08:09 devstack sudo[93117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2565c256-d7ce-4f4b-ad58-95a329fb41b7 Jul 10 10:08:09 devstack sudo[93117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:09 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-24c8e71a-9c11-44fb-9fdd-4f4b5bb6b564 tempest-SnapshotMetadataTestJSON-1633806383 None] Lock "cinder-quobyte-470db1aa-517e-4ecd-8ad1-de6b6be389c3" acquired by "delete_volume" :: waited 0.031s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:08:09 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd62a18-2a93-4c0c-baf9-22e94128d830]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:08:09 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-24c8e71a-9c11-44fb-9fdd-4f4b5bb6b564 tempest-SnapshotMetadataTestJSON-1633806383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-470db1aa-517e-4ecd-8ad1-de6b6be389c3 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:09 devstack sudo[93120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-470db1aa-517e-4ecd-8ad1-de6b6be389c3 Jul 10 10:08:09 devstack sudo[93120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:10 devstack sudo[93081]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:10 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0447040f-f1b6-47cf-960d-4373ed38d532 tempest-GroupSnapshotsV319Test-587758063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f2e9d807-b3b9-4adb-8656-827e87e0a616,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f2e9d807-b3b9-4adb-8656-827e87e0a616.280761d0-09fd-4d26-a38c-c08e48940005 1G" returned: 0 in 1.124s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:10 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0447040f-f1b6-47cf-960d-4373ed38d532 tempest-GroupSnapshotsV319Test-587758063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2e9d807-b3b9-4adb-8656-827e87e0a616 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f2e9d807-b3b9-4adb-8656-827e87e0a616.280761d0-09fd-4d26-a38c-c08e48940005 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:10 devstack sudo[93128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2e9d807-b3b9-4adb-8656-827e87e0a616 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f2e9d807-b3b9-4adb-8656-827e87e0a616.280761d0-09fd-4d26-a38c-c08e48940005 Jul 10 10:08:10 devstack sudo[93128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:10 devstack sudo[93117]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:10 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9cdeca55-fcb7-4a14-a256-b980240b3468 tempest-VolumesActionsTest-1820532270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2565c256-d7ce-4f4b-ad58-95a329fb41b7" returned: 0 in 1.020s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:10 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9cdeca55-fcb7-4a14-a256-b980240b3468 tempest-VolumesActionsTest-1820532270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2565c256-d7ce-4f4b-ad58-95a329fb41b7 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:10 devstack sudo[93135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2565c256-d7ce-4f4b-ad58-95a329fb41b7 Jul 10 10:08:10 devstack sudo[93135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:10 devstack sudo[93120]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:10 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-24c8e71a-9c11-44fb-9fdd-4f4b5bb6b564 tempest-SnapshotMetadataTestJSON-1633806383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-470db1aa-517e-4ecd-8ad1-de6b6be389c3" returned: 0 in 0.873s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:10 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-24c8e71a-9c11-44fb-9fdd-4f4b5bb6b564 tempest-SnapshotMetadataTestJSON-1633806383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-470db1aa-517e-4ecd-8ad1-de6b6be389c3 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:10 devstack sudo[93138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-470db1aa-517e-4ecd-8ad1-de6b6be389c3 Jul 10 10:08:10 devstack sudo[93138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:11 devstack sudo[93128]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:11 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0447040f-f1b6-47cf-960d-4373ed38d532 tempest-GroupSnapshotsV319Test-587758063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2e9d807-b3b9-4adb-8656-827e87e0a616 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f2e9d807-b3b9-4adb-8656-827e87e0a616.280761d0-09fd-4d26-a38c-c08e48940005" returned: 0 in 0.707s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:11 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-0447040f-f1b6-47cf-960d-4373ed38d532 tempest-GroupSnapshotsV319Test-587758063 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f2e9d807-b3b9-4adb-8656-827e87e0a616.280761d0-09fd-4d26-a38c-c08e48940005 is being set with open permissions: ugo+rw: NotImplementedError Jul 10 10:08:11 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0447040f-f1b6-47cf-960d-4373ed38d532 tempest-GroupSnapshotsV319Test-587758063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f2e9d807-b3b9-4adb-8656-827e87e0a616.280761d0-09fd-4d26-a38c-c08e48940005 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:11 devstack sudo[93143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f2e9d807-b3b9-4adb-8656-827e87e0a616.280761d0-09fd-4d26-a38c-c08e48940005 Jul 10 10:08:11 devstack sudo[93143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:11 devstack sudo[93135]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:11 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9cdeca55-fcb7-4a14-a256-b980240b3468 tempest-VolumesActionsTest-1820532270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2565c256-d7ce-4f4b-ad58-95a329fb41b7" returned: 0 in 0.753s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:11 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-9cdeca55-fcb7-4a14-a256-b980240b3468 tempest-VolumesActionsTest-1820532270 None] Lock "cinder-quobyte-2565c256-d7ce-4f4b-ad58-95a329fb41b7" released by "delete_volume" :: held 1.854s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:08:11 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-9cdeca55-fcb7-4a14-a256-b980240b3468 tempest-VolumesActionsTest-1820532270 None] Created reservations ['8b5bbed0-8578-4f2b-bb86-4a0e52b150d4', '133cbeb4-c1fc-4843-a50f-5db73639174c', '198031d1-1a6a-4708-9132-389ffbd5ff40', 'a565dc64-94bc-4fad-b286-f5179a3b621f'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:08:11 devstack sudo[93138]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:11 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-24c8e71a-9c11-44fb-9fdd-4f4b5bb6b564 tempest-SnapshotMetadataTestJSON-1633806383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-470db1aa-517e-4ecd-8ad1-de6b6be389c3" returned: 0 in 0.755s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:11 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-24c8e71a-9c11-44fb-9fdd-4f4b5bb6b564 tempest-SnapshotMetadataTestJSON-1633806383 None] Lock "cinder-quobyte-470db1aa-517e-4ecd-8ad1-de6b6be389c3" released by "delete_volume" :: held 1.714s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:08:11 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-9cdeca55-fcb7-4a14-a256-b980240b3468 tempest-VolumesActionsTest-1820532270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:08:11 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-9cdeca55-fcb7-4a14-a256-b980240b3468 tempest-VolumesActionsTest-1820532270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:08:11 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-9cdeca55-fcb7-4a14-a256-b980240b3468 tempest-VolumesActionsTest-1820532270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:08:11 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-9cdeca55-fcb7-4a14-a256-b980240b3468 tempest-VolumesActionsTest-1820532270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:08:11 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-9cdeca55-fcb7-4a14-a256-b980240b3468 tempest-VolumesActionsTest-1820532270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:08:11 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9cdeca55-fcb7-4a14-a256-b980240b3468 tempest-VolumesActionsTest-1820532270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:11 devstack sudo[93149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:08:11 devstack sudo[93149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:11 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-24c8e71a-9c11-44fb-9fdd-4f4b5bb6b564 tempest-SnapshotMetadataTestJSON-1633806383 None] Created reservations ['f60a49d6-e187-43d8-99fe-9b0d153636ea', '0cfeef00-b461-4ed9-bdf2-eac1d959d1a7', '938b233e-c166-4691-a443-4f95baa0ef47', '48cbb0f3-ee14-4895-9f44-766de0b69230'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:08:11 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-24c8e71a-9c11-44fb-9fdd-4f4b5bb6b564 tempest-SnapshotMetadataTestJSON-1633806383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:08:11 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-24c8e71a-9c11-44fb-9fdd-4f4b5bb6b564 tempest-SnapshotMetadataTestJSON-1633806383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:08:11 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-24c8e71a-9c11-44fb-9fdd-4f4b5bb6b564 tempest-SnapshotMetadataTestJSON-1633806383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:08:11 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-24c8e71a-9c11-44fb-9fdd-4f4b5bb6b564 tempest-SnapshotMetadataTestJSON-1633806383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:08:11 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-24c8e71a-9c11-44fb-9fdd-4f4b5bb6b564 tempest-SnapshotMetadataTestJSON-1633806383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:08:11 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-24c8e71a-9c11-44fb-9fdd-4f4b5bb6b564 tempest-SnapshotMetadataTestJSON-1633806383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:11 devstack sudo[93157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:08:11 devstack sudo[93157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:11 devstack sudo[93143]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:11 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0447040f-f1b6-47cf-960d-4373ed38d532 tempest-GroupSnapshotsV319Test-587758063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f2e9d807-b3b9-4adb-8656-827e87e0a616.280761d0-09fd-4d26-a38c-c08e48940005" returned: 0 in 0.782s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:11 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0447040f-f1b6-47cf-960d-4373ed38d532 tempest-GroupSnapshotsV319Test-587758063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f2e9d807-b3b9-4adb-8656-827e87e0a616.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:11 devstack sudo[93160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f2e9d807-b3b9-4adb-8656-827e87e0a616.info Jul 10 10:08:11 devstack sudo[93160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:12 devstack sudo[93149]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9cdeca55-fcb7-4a14-a256-b980240b3468 tempest-VolumesActionsTest-1820532270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 1.039s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:12 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-9cdeca55-fcb7-4a14-a256-b980240b3468 tempest-VolumesActionsTest-1820532270 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:08:12 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-9cdeca55-fcb7-4a14-a256-b980240b3468 tempest-VolumesActionsTest-1820532270 None] Deleted volume successfully. Jul 10 10:08:12 devstack sudo[93157]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-24c8e71a-9c11-44fb-9fdd-4f4b5bb6b564 tempest-SnapshotMetadataTestJSON-1633806383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.893s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:12 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-24c8e71a-9c11-44fb-9fdd-4f4b5bb6b564 tempest-SnapshotMetadataTestJSON-1633806383 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:08:12 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-24c8e71a-9c11-44fb-9fdd-4f4b5bb6b564 tempest-SnapshotMetadataTestJSON-1633806383 None] Deleted volume successfully. Jul 10 10:08:12 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-9cdeca55-fcb7-4a14-a256-b980240b3468 tempest-VolumesActionsTest-1820532270 None] Lock "cinder-2565c256-d7ce-4f4b-ad58-95a329fb41b7-delete_volume" released by "delete_volume" :: held 3.209s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:08:12 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-24c8e71a-9c11-44fb-9fdd-4f4b5bb6b564 tempest-SnapshotMetadataTestJSON-1633806383 None] Lock "cinder-470db1aa-517e-4ecd-8ad1-de6b6be389c3-delete_volume" released by "delete_volume" :: held 2.949s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:08:12 devstack sudo[93160]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0447040f-f1b6-47cf-960d-4373ed38d532 tempest-GroupSnapshotsV319Test-587758063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f2e9d807-b3b9-4adb-8656-827e87e0a616.info" returned: 0 in 0.906s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:12 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-0447040f-f1b6-47cf-960d-4373ed38d532 tempest-GroupSnapshotsV319Test-587758063 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f2e9d807-b3b9-4adb-8656-827e87e0a616.info is being set with open permissions: ugo+rw: NotImplementedError Jul 10 10:08:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0447040f-f1b6-47cf-960d-4373ed38d532 tempest-GroupSnapshotsV319Test-587758063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f2e9d807-b3b9-4adb-8656-827e87e0a616.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:12 devstack sudo[93166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f2e9d807-b3b9-4adb-8656-827e87e0a616.info Jul 10 10:08:12 devstack sudo[93166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:13 devstack sudo[93166]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:13 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0447040f-f1b6-47cf-960d-4373ed38d532 tempest-GroupSnapshotsV319Test-587758063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f2e9d807-b3b9-4adb-8656-827e87e0a616.info" returned: 0 in 0.702s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:13 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-0447040f-f1b6-47cf-960d-4373ed38d532 tempest-GroupSnapshotsV319Test-587758063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.197s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:08:13 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-0447040f-f1b6-47cf-960d-4373ed38d532 tempest-GroupSnapshotsV319Test-587758063 None] group_snapshot aea301fe-d881-46ca-a6a5-d3b152f81bd1: created successfully Jul 10 10:08:14 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-917da6a3-0a27-4234-81b1-dabc305d97a0 tempest-GroupSnapshotsV319Test-587758063 None] group_snapshot aea301fe-d881-46ca-a6a5-d3b152f81bd1: deleting Jul 10 10:08:14 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-917da6a3-0a27-4234-81b1-dabc305d97a0 tempest-GroupSnapshotsV319Test-587758063 None] group_snapshot aea301fe-d881-46ca-a6a5-d3b152f81bd1: deleting {{(pid=87234) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 10 10:08:14 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-917da6a3-0a27-4234-81b1-dabc305d97a0 tempest-GroupSnapshotsV319Test-587758063 None] Acquiring lock "cinder-quobyte-f2e9d807-b3b9-4adb-8656-827e87e0a616" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:08:14 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-917da6a3-0a27-4234-81b1-dabc305d97a0 tempest-GroupSnapshotsV319Test-587758063 None] Lock "cinder-quobyte-f2e9d807-b3b9-4adb-8656-827e87e0a616" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:08:14 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-917da6a3-0a27-4234-81b1-dabc305d97a0 tempest-GroupSnapshotsV319Test-587758063 None] Acquiring lock "cinder-quobyte-280761d0-09fd-4d26-a38c-c08e48940005" by "_delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:08:14 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-917da6a3-0a27-4234-81b1-dabc305d97a0 tempest-GroupSnapshotsV319Test-587758063 None] Lock "cinder-quobyte-280761d0-09fd-4d26-a38c-c08e48940005" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:08:14 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-917da6a3-0a27-4234-81b1-dabc305d97a0 tempest-GroupSnapshotsV319Test-587758063 None] Deleting offline snapshot 280761d0-09fd-4d26-a38c-c08e48940005 of volume f2e9d807-b3b9-4adb-8656-827e87e0a616 {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 10:08:14 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-917da6a3-0a27-4234-81b1-dabc305d97a0 tempest-GroupSnapshotsV319Test-587758063 None] snapshot_file for this snap is: volume-f2e9d807-b3b9-4adb-8656-827e87e0a616.280761d0-09fd-4d26-a38c-c08e48940005 {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 10:08:14 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57f7681-2fad-4227-90b7-b38f0356e4d8]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:08:14 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-917da6a3-0a27-4234-81b1-dabc305d97a0 tempest-GroupSnapshotsV319Test-587758063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f2e9d807-b3b9-4adb-8656-827e87e0a616.280761d0-09fd-4d26-a38c-c08e48940005 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:14 devstack sudo[93171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f2e9d807-b3b9-4adb-8656-827e87e0a616.280761d0-09fd-4d26-a38c-c08e48940005 Jul 10 10:08:14 devstack sudo[93171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:15 devstack sudo[93171]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:15 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-917da6a3-0a27-4234-81b1-dabc305d97a0 tempest-GroupSnapshotsV319Test-587758063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f2e9d807-b3b9-4adb-8656-827e87e0a616.280761d0-09fd-4d26-a38c-c08e48940005" returned: 0 in 1.009s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:15 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-917da6a3-0a27-4234-81b1-dabc305d97a0 tempest-GroupSnapshotsV319Test-587758063 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2e9d807-b3b9-4adb-8656-827e87e0a616(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 10:08:15 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5e78da-5144-45d0-95df-73a5491a3834]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:08:15 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-917da6a3-0a27-4234-81b1-dabc305d97a0 tempest-GroupSnapshotsV319Test-587758063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f2e9d807-b3b9-4adb-8656-827e87e0a616 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:15 devstack sudo[93176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f2e9d807-b3b9-4adb-8656-827e87e0a616 Jul 10 10:08:15 devstack sudo[93176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:15 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-946f775b-da29-47a2-8613-67967a28ec0e tempest-VolumesCloneTest-221284204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:08:16 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-946f775b-da29-47a2-8613-67967a28ec0e tempest-VolumesCloneTest-221284204 None] Flow 'volume_create_manager' (6d739c89-8196-491b-b058-1947b999e6bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:08:16 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-946f775b-da29-47a2-8613-67967a28ec0e tempest-VolumesCloneTest-221284204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0ac84cf-62ee-4969-ab29-cda348594a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:08:16 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-946f775b-da29-47a2-8613-67967a28ec0e tempest-VolumesCloneTest-221284204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0ac84cf-62ee-4969-ab29-cda348594a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:08:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1647798291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=312b1c42-a6ec-4cc1-b525-1466d774b905,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78540f4a84b84cd29b1d2de54884f558',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:08:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:08:16Z,use_quota=True,user_id='f7a4323c131a402a98d367e747f5c5dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:08:16 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-946f775b-da29-47a2-8613-67967a28ec0e tempest-VolumesCloneTest-221284204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c3cc0b0-543b-48df-8e3f-3a79a0404734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:08:16 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-946f775b-da29-47a2-8613-67967a28ec0e tempest-VolumesCloneTest-221284204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c3cc0b0-543b-48df-8e3f-3a79a0404734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:08:16 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-946f775b-da29-47a2-8613-67967a28ec0e tempest-VolumesCloneTest-221284204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3abfb7de-5d9a-468a-bc6f-4f2042b7857c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:08:16 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-946f775b-da29-47a2-8613-67967a28ec0e tempest-VolumesCloneTest-221284204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3abfb7de-5d9a-468a-bc6f-4f2042b7857c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '312b1c42-a6ec-4cc1-b525-1466d774b905', 'volume_name': 'volume-312b1c42-a6ec-4cc1-b525-1466d774b905', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:08:16 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-946f775b-da29-47a2-8613-67967a28ec0e tempest-VolumesCloneTest-221284204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63e1fad4-6926-4851-9880-d76d4545bf4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:08:16 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-946f775b-da29-47a2-8613-67967a28ec0e tempest-VolumesCloneTest-221284204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63e1fad4-6926-4851-9880-d76d4545bf4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:08:16 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-946f775b-da29-47a2-8613-67967a28ec0e tempest-VolumesCloneTest-221284204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92fd839e-5a9d-4262-b4a7-a438819cf505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:08:16 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-946f775b-da29-47a2-8613-67967a28ec0e tempest-VolumesCloneTest-221284204 None] Volume 312b1c42-a6ec-4cc1-b525-1466d774b905: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-312b1c42-a6ec-4cc1-b525-1466d774b905', 'volume_size': 1} Jul 10 10:08:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-946f775b-da29-47a2-8613-67967a28ec0e tempest-VolumesCloneTest-221284204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:08:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-946f775b-da29-47a2-8613-67967a28ec0e tempest-VolumesCloneTest-221284204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:08:16 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-946f775b-da29-47a2-8613-67967a28ec0e tempest-VolumesCloneTest-221284204 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:08:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1647798291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=312b1c42-a6ec-4cc1-b525-1466d774b905,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78540f4a84b84cd29b1d2de54884f558',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:08:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:08:16Z,use_quota=True,user_id='f7a4323c131a402a98d367e747f5c5dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:08:16 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-946f775b-da29-47a2-8613-67967a28ec0e tempest-VolumesCloneTest-221284204 None] Creating volume 312b1c42-a6ec-4cc1-b525-1466d774b905 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:08:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-946f775b-da29-47a2-8613-67967a28ec0e tempest-VolumesCloneTest-221284204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:08:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-946f775b-da29-47a2-8613-67967a28ec0e tempest-VolumesCloneTest-221284204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:08:16 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-946f775b-da29-47a2-8613-67967a28ec0e tempest-VolumesCloneTest-221284204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:08:16 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-946f775b-da29-47a2-8613-67967a28ec0e tempest-VolumesCloneTest-221284204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:08:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-946f775b-da29-47a2-8613-67967a28ec0e tempest-VolumesCloneTest-221284204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:08:16 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-946f775b-da29-47a2-8613-67967a28ec0e tempest-VolumesCloneTest-221284204 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:08:16 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-946f775b-da29-47a2-8613-67967a28ec0e tempest-VolumesCloneTest-221284204 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:08:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-946f775b-da29-47a2-8613-67967a28ec0e tempest-VolumesCloneTest-221284204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-312b1c42-a6ec-4cc1-b525-1466d774b905 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:16 devstack sudo[93179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-312b1c42-a6ec-4cc1-b525-1466d774b905 1073741824 Jul 10 10:08:16 devstack sudo[93179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:16 devstack sudo[93176]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-917da6a3-0a27-4234-81b1-dabc305d97a0 tempest-GroupSnapshotsV319Test-587758063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f2e9d807-b3b9-4adb-8656-827e87e0a616" returned: 0 in 1.092s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-917da6a3-0a27-4234-81b1-dabc305d97a0 tempest-GroupSnapshotsV319Test-587758063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f2e9d807-b3b9-4adb-8656-827e87e0a616.280761d0-09fd-4d26-a38c-c08e48940005 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:16 devstack sudo[93186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f2e9d807-b3b9-4adb-8656-827e87e0a616.280761d0-09fd-4d26-a38c-c08e48940005 Jul 10 10:08:16 devstack sudo[93186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:17 devstack sudo[93179]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-946f775b-da29-47a2-8613-67967a28ec0e tempest-VolumesCloneTest-221284204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-312b1c42-a6ec-4cc1-b525-1466d774b905 1073741824" returned: 0 in 1.002s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-946f775b-da29-47a2-8613-67967a28ec0e tempest-VolumesCloneTest-221284204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-312b1c42-a6ec-4cc1-b525-1466d774b905 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:17 devstack sudo[93192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-312b1c42-a6ec-4cc1-b525-1466d774b905 Jul 10 10:08:17 devstack sudo[93192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:17 devstack sudo[93186]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-917da6a3-0a27-4234-81b1-dabc305d97a0 tempest-GroupSnapshotsV319Test-587758063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f2e9d807-b3b9-4adb-8656-827e87e0a616.280761d0-09fd-4d26-a38c-c08e48940005" returned: 0 in 0.851s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-917da6a3-0a27-4234-81b1-dabc305d97a0 tempest-GroupSnapshotsV319Test-587758063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f2e9d807-b3b9-4adb-8656-827e87e0a616.280761d0-09fd-4d26-a38c-c08e48940005 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:17 devstack sudo[93197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f2e9d807-b3b9-4adb-8656-827e87e0a616.280761d0-09fd-4d26-a38c-c08e48940005 Jul 10 10:08:17 devstack sudo[93197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:17 devstack sudo[93192]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-946f775b-da29-47a2-8613-67967a28ec0e tempest-VolumesCloneTest-221284204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-312b1c42-a6ec-4cc1-b525-1466d774b905" returned: 0 in 0.714s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:17 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-946f775b-da29-47a2-8613-67967a28ec0e tempest-VolumesCloneTest-221284204 None] <== create_volume: return (1771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:08:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-946f775b-da29-47a2-8613-67967a28ec0e tempest-VolumesCloneTest-221284204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.774s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:08:17 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-946f775b-da29-47a2-8613-67967a28ec0e tempest-VolumesCloneTest-221284204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92fd839e-5a9d-4262-b4a7-a438819cf505) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-312b1c42-a6ec-4cc1-b525-1466d774b905', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:08:17 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-946f775b-da29-47a2-8613-67967a28ec0e tempest-VolumesCloneTest-221284204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b49647f-8fb7-4d07-8929-4746517032ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:08:17 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-946f775b-da29-47a2-8613-67967a28ec0e tempest-VolumesCloneTest-221284204 None] Volume volume-312b1c42-a6ec-4cc1-b525-1466d774b905 (312b1c42-a6ec-4cc1-b525-1466d774b905): created successfully Jul 10 10:08:17 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-946f775b-da29-47a2-8613-67967a28ec0e tempest-VolumesCloneTest-221284204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b49647f-8fb7-4d07-8929-4746517032ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:08:17 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-946f775b-da29-47a2-8613-67967a28ec0e tempest-VolumesCloneTest-221284204 None] Flow 'volume_create_manager' (6d739c89-8196-491b-b058-1947b999e6bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:08:17 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-946f775b-da29-47a2-8613-67967a28ec0e tempest-VolumesCloneTest-221284204 None] Created volume successfully. Jul 10 10:08:18 devstack sudo[93197]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:18 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-917da6a3-0a27-4234-81b1-dabc305d97a0 tempest-GroupSnapshotsV319Test-587758063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f2e9d807-b3b9-4adb-8656-827e87e0a616.280761d0-09fd-4d26-a38c-c08e48940005" returned: 0 in 0.739s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:18 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-917da6a3-0a27-4234-81b1-dabc305d97a0 tempest-GroupSnapshotsV319Test-587758063 None] Lock "cinder-quobyte-280761d0-09fd-4d26-a38c-c08e48940005" released by "_delete_snapshot" :: held 3.818s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:08:18 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-917da6a3-0a27-4234-81b1-dabc305d97a0 tempest-GroupSnapshotsV319Test-587758063 None] Lock "cinder-quobyte-f2e9d807-b3b9-4adb-8656-827e87e0a616" released by "delete_snapshot" :: held 3.844s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:08:18 devstack cinder-volume[87234]: WARNING cinder.quota [None req-917da6a3-0a27-4234-81b1-dabc305d97a0 tempest-GroupSnapshotsV319Test-587758063 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1038689877 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1038689877, it is now deprecated. Please use the default quota class for default quota. Jul 10 10:08:18 devstack cinder-volume[87234]: WARNING cinder.quota [None req-917da6a3-0a27-4234-81b1-dabc305d97a0 tempest-GroupSnapshotsV319Test-587758063 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1038689877 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1038689877, it is now deprecated. Please use the default quota class for default quota. Jul 10 10:08:18 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-917da6a3-0a27-4234-81b1-dabc305d97a0 tempest-GroupSnapshotsV319Test-587758063 None] Created reservations ['951d13b2-23a2-4485-a2b4-4d5c2480f109', 'e7e080af-cafe-4116-8da2-0bbd14809f72', 'a6ac0b56-3033-433e-aca1-30bcb776035e', '9ef519b7-ff02-48df-b4de-35cf2d41ce8c'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:08:18 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-917da6a3-0a27-4234-81b1-dabc305d97a0 tempest-GroupSnapshotsV319Test-587758063 None] group_snapshot aea301fe-d881-46ca-a6a5-d3b152f81bd1: deleted successfully Jul 10 10:08:19 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-0978b34d-d95d-497b-b292-f146db5079f0 tempest-GroupSnapshotsV319Test-587758063 None] Acquiring lock "cinder-quobyte-f2e9d807-b3b9-4adb-8656-827e87e0a616" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:08:19 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-0978b34d-d95d-497b-b292-f146db5079f0 tempest-GroupSnapshotsV319Test-587758063 None] Lock "cinder-quobyte-f2e9d807-b3b9-4adb-8656-827e87e0a616" acquired by "delete_volume" :: waited 0.039s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:08:19 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d56fdfd-24d0-42a5-bcec-a1eff77cef84]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:08:19 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0978b34d-d95d-497b-b292-f146db5079f0 tempest-GroupSnapshotsV319Test-587758063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f2e9d807-b3b9-4adb-8656-827e87e0a616 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:19 devstack sudo[93210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f2e9d807-b3b9-4adb-8656-827e87e0a616 Jul 10 10:08:19 devstack sudo[93210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:19 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d1f20c4-6705-421d-b5ec-098e6ab5c9f7 tempest-VolumesCloneTest-221284204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:08:20 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4d1f20c4-6705-421d-b5ec-098e6ab5c9f7 tempest-VolumesCloneTest-221284204 None] Flow 'volume_create_manager' (8d97b17e-6190-4bfb-89b5-bdafe63d0687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:08:20 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4d1f20c4-6705-421d-b5ec-098e6ab5c9f7 tempest-VolumesCloneTest-221284204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f49a35d9-bea0-4016-af9d-087f221d3488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:08:20 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4d1f20c4-6705-421d-b5ec-098e6ab5c9f7 tempest-VolumesCloneTest-221284204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f49a35d9-bea0-4016-af9d-087f221d3488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:08:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-3537011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cf30c1e-7a47-4dbc-b802-d9b79010be44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78540f4a84b84cd29b1d2de54884f558',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:08:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=312b1c42-a6ec-4cc1-b525-1466d774b905,status='creating',terminated_at=None,updated_at=2026-07-10T08:08:20Z,use_quota=True,user_id='f7a4323c131a402a98d367e747f5c5dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:08:20 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4d1f20c4-6705-421d-b5ec-098e6ab5c9f7 tempest-VolumesCloneTest-221284204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56f1bc70-8fd6-4762-9205-bf4085576448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:08:20 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4d1f20c4-6705-421d-b5ec-098e6ab5c9f7 tempest-VolumesCloneTest-221284204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56f1bc70-8fd6-4762-9205-bf4085576448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:08:20 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4d1f20c4-6705-421d-b5ec-098e6ab5c9f7 tempest-VolumesCloneTest-221284204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fffdf35a-fe6b-4061-a9ab-3e498c0eb9ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:08:20 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4d1f20c4-6705-421d-b5ec-098e6ab5c9f7 tempest-VolumesCloneTest-221284204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fffdf35a-fe6b-4061-a9ab-3e498c0eb9ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '6cf30c1e-7a47-4dbc-b802-d9b79010be44', 'volume_name': 'volume-6cf30c1e-7a47-4dbc-b802-d9b79010be44', 'volume_size': 2, 'source_volid': '312b1c42-a6ec-4cc1-b525-1466d774b905', 'source_volstatus': 'available'}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:08:20 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4d1f20c4-6705-421d-b5ec-098e6ab5c9f7 tempest-VolumesCloneTest-221284204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28d376de-b3ea-4b82-a417-e3823466c988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:08:20 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4d1f20c4-6705-421d-b5ec-098e6ab5c9f7 tempest-VolumesCloneTest-221284204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28d376de-b3ea-4b82-a417-e3823466c988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:08:20 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4d1f20c4-6705-421d-b5ec-098e6ab5c9f7 tempest-VolumesCloneTest-221284204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d248030-2769-4c12-941a-933da5e1343f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:08:20 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-4d1f20c4-6705-421d-b5ec-098e6ab5c9f7 tempest-VolumesCloneTest-221284204 None] Volume 6cf30c1e-7a47-4dbc-b802-d9b79010be44: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-6cf30c1e-7a47-4dbc-b802-d9b79010be44', 'volume_size': 2, 'source_volid': '312b1c42-a6ec-4cc1-b525-1466d774b905', 'source_volstatus': 'available'} Jul 10 10:08:20 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-4d1f20c4-6705-421d-b5ec-098e6ab5c9f7 tempest-VolumesCloneTest-221284204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:08:20 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-4d1f20c4-6705-421d-b5ec-098e6ab5c9f7 tempest-VolumesCloneTest-221284204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.002s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:08:20 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-4d1f20c4-6705-421d-b5ec-098e6ab5c9f7 tempest-VolumesCloneTest-221284204 None] Cloning volume 312b1c42-a6ec-4cc1-b525-1466d774b905 to volume 6cf30c1e-7a47-4dbc-b802-d9b79010be44 Jul 10 10:08:20 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-4d1f20c4-6705-421d-b5ec-098e6ab5c9f7 tempest-VolumesCloneTest-221284204 None] Creating offline snapshot 9ab053a5-51b5-40e7-b163-d511a90bab52 of volume 312b1c42-a6ec-4cc1-b525-1466d774b905 {{(pid=87234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 10:08:20 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[e87b5986-2602-4a23-93bb-d5d14d2d62ef]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:08:20 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4d1f20c4-6705-421d-b5ec-098e6ab5c9f7 tempest-VolumesCloneTest-221284204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-312b1c42-a6ec-4cc1-b525-1466d774b905 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:20 devstack sudo[93270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-312b1c42-a6ec-4cc1-b525-1466d774b905 Jul 10 10:08:20 devstack sudo[93270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:20 devstack sudo[93210]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:20 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0978b34d-d95d-497b-b292-f146db5079f0 tempest-GroupSnapshotsV319Test-587758063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f2e9d807-b3b9-4adb-8656-827e87e0a616" returned: 0 in 1.350s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:20 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0978b34d-d95d-497b-b292-f146db5079f0 tempest-GroupSnapshotsV319Test-587758063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f2e9d807-b3b9-4adb-8656-827e87e0a616 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:20 devstack sudo[93319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f2e9d807-b3b9-4adb-8656-827e87e0a616 Jul 10 10:08:20 devstack sudo[93319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:21 devstack sudo[93270]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:21 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4d1f20c4-6705-421d-b5ec-098e6ab5c9f7 tempest-VolumesCloneTest-221284204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-312b1c42-a6ec-4cc1-b525-1466d774b905" returned: 0 in 1.074s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:21 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4d1f20c4-6705-421d-b5ec-098e6ab5c9f7 tempest-VolumesCloneTest-221284204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-312b1c42-a6ec-4cc1-b525-1466d774b905,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-312b1c42-a6ec-4cc1-b525-1466d774b905.9ab053a5-51b5-40e7-b163-d511a90bab52 1G {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:21 devstack sudo[93326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-312b1c42-a6ec-4cc1-b525-1466d774b905,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-312b1c42-a6ec-4cc1-b525-1466d774b905.9ab053a5-51b5-40e7-b163-d511a90bab52 1G Jul 10 10:08:21 devstack sudo[93326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:21 devstack sudo[93319]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:21 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0978b34d-d95d-497b-b292-f146db5079f0 tempest-GroupSnapshotsV319Test-587758063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f2e9d807-b3b9-4adb-8656-827e87e0a616" returned: 0 in 0.897s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:21 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-0978b34d-d95d-497b-b292-f146db5079f0 tempest-GroupSnapshotsV319Test-587758063 None] Lock "cinder-quobyte-f2e9d807-b3b9-4adb-8656-827e87e0a616" released by "delete_volume" :: held 2.418s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:08:21 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-0978b34d-d95d-497b-b292-f146db5079f0 tempest-GroupSnapshotsV319Test-587758063 None] Created reservations ['91d676ec-3c66-46ff-8eea-49cc2f1fd428'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:08:21 devstack cinder-volume[87234]: WARNING cinder.quota [None req-0978b34d-d95d-497b-b292-f146db5079f0 tempest-GroupSnapshotsV319Test-587758063 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1038689877 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1038689877, it is now deprecated. Please use the default quota class for default quota. Jul 10 10:08:21 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-0978b34d-d95d-497b-b292-f146db5079f0 tempest-GroupSnapshotsV319Test-587758063 None] Created reservations ['fab6ed3b-343a-4c87-a03c-a5b6220333da', 'fb1b2fe2-4445-45c6-9bda-9d234d1cc831', '6b3af181-866c-484b-9e19-d7837b91d5ba', 'cebb1929-7dd6-4862-8e7e-4e673d8fd49c'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:08:21 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-0978b34d-d95d-497b-b292-f146db5079f0 tempest-GroupSnapshotsV319Test-587758063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:08:21 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-0978b34d-d95d-497b-b292-f146db5079f0 tempest-GroupSnapshotsV319Test-587758063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:08:21 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-0978b34d-d95d-497b-b292-f146db5079f0 tempest-GroupSnapshotsV319Test-587758063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:08:21 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-0978b34d-d95d-497b-b292-f146db5079f0 tempest-GroupSnapshotsV319Test-587758063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:08:21 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-0978b34d-d95d-497b-b292-f146db5079f0 tempest-GroupSnapshotsV319Test-587758063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:08:21 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0978b34d-d95d-497b-b292-f146db5079f0 tempest-GroupSnapshotsV319Test-587758063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:22 devstack sudo[93335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:08:22 devstack sudo[93335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:22 devstack sudo[93326]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4d1f20c4-6705-421d-b5ec-098e6ab5c9f7 tempest-VolumesCloneTest-221284204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-312b1c42-a6ec-4cc1-b525-1466d774b905,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-312b1c42-a6ec-4cc1-b525-1466d774b905.9ab053a5-51b5-40e7-b163-d511a90bab52 1G" returned: 0 in 1.112s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4d1f20c4-6705-421d-b5ec-098e6ab5c9f7 tempest-VolumesCloneTest-221284204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-312b1c42-a6ec-4cc1-b525-1466d774b905 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-312b1c42-a6ec-4cc1-b525-1466d774b905.9ab053a5-51b5-40e7-b163-d511a90bab52 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:22 devstack sudo[93346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-312b1c42-a6ec-4cc1-b525-1466d774b905 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-312b1c42-a6ec-4cc1-b525-1466d774b905.9ab053a5-51b5-40e7-b163-d511a90bab52 Jul 10 10:08:22 devstack sudo[93346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:22 devstack sudo[93335]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0978b34d-d95d-497b-b292-f146db5079f0 tempest-GroupSnapshotsV319Test-587758063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.785s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:22 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-0978b34d-d95d-497b-b292-f146db5079f0 tempest-GroupSnapshotsV319Test-587758063 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:08:22 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-0978b34d-d95d-497b-b292-f146db5079f0 tempest-GroupSnapshotsV319Test-587758063 None] Delete group completed successfully. Jul 10 10:08:23 devstack sudo[93346]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:23 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4d1f20c4-6705-421d-b5ec-098e6ab5c9f7 tempest-VolumesCloneTest-221284204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-312b1c42-a6ec-4cc1-b525-1466d774b905 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-312b1c42-a6ec-4cc1-b525-1466d774b905.9ab053a5-51b5-40e7-b163-d511a90bab52" returned: 0 in 0.868s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:23 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-4d1f20c4-6705-421d-b5ec-098e6ab5c9f7 tempest-VolumesCloneTest-221284204 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-312b1c42-a6ec-4cc1-b525-1466d774b905.9ab053a5-51b5-40e7-b163-d511a90bab52 is being set with open permissions: ugo+rw Jul 10 10:08:23 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4d1f20c4-6705-421d-b5ec-098e6ab5c9f7 tempest-VolumesCloneTest-221284204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-312b1c42-a6ec-4cc1-b525-1466d774b905.9ab053a5-51b5-40e7-b163-d511a90bab52 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:23 devstack sudo[93368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-312b1c42-a6ec-4cc1-b525-1466d774b905.9ab053a5-51b5-40e7-b163-d511a90bab52 Jul 10 10:08:23 devstack sudo[93368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:24 devstack sudo[93368]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4d1f20c4-6705-421d-b5ec-098e6ab5c9f7 tempest-VolumesCloneTest-221284204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-312b1c42-a6ec-4cc1-b525-1466d774b905.9ab053a5-51b5-40e7-b163-d511a90bab52" returned: 0 in 1.220s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4d1f20c4-6705-421d-b5ec-098e6ab5c9f7 tempest-VolumesCloneTest-221284204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-312b1c42-a6ec-4cc1-b525-1466d774b905.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:24 devstack sudo[93738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-312b1c42-a6ec-4cc1-b525-1466d774b905.info Jul 10 10:08:24 devstack sudo[93738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:25 devstack sudo[93738]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:25 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4d1f20c4-6705-421d-b5ec-098e6ab5c9f7 tempest-VolumesCloneTest-221284204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-312b1c42-a6ec-4cc1-b525-1466d774b905.info" returned: 0 in 1.173s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:25 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-4d1f20c4-6705-421d-b5ec-098e6ab5c9f7 tempest-VolumesCloneTest-221284204 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-312b1c42-a6ec-4cc1-b525-1466d774b905.info is being set with open permissions: ugo+rw Jul 10 10:08:25 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4d1f20c4-6705-421d-b5ec-098e6ab5c9f7 tempest-VolumesCloneTest-221284204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-312b1c42-a6ec-4cc1-b525-1466d774b905.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:25 devstack sudo[93743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-312b1c42-a6ec-4cc1-b525-1466d774b905.info Jul 10 10:08:25 devstack sudo[93743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:26 devstack sudo[93743]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4d1f20c4-6705-421d-b5ec-098e6ab5c9f7 tempest-VolumesCloneTest-221284204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-312b1c42-a6ec-4cc1-b525-1466d774b905.info" returned: 0 in 1.198s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:26 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-4d1f20c4-6705-421d-b5ec-098e6ab5c9f7 tempest-VolumesCloneTest-221284204 None] Acquiring lock "cinder-quobyte-6cf30c1e-7a47-4dbc-b802-d9b79010be44" by "_copy_volume_from_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:08:27 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-4d1f20c4-6705-421d-b5ec-098e6ab5c9f7 tempest-VolumesCloneTest-221284204 None] Lock "cinder-quobyte-6cf30c1e-7a47-4dbc-b802-d9b79010be44" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:08:27 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-4d1f20c4-6705-421d-b5ec-098e6ab5c9f7 tempest-VolumesCloneTest-221284204 None] snapshot: 9ab053a5-51b5-40e7-b163-d511a90bab52, volume: 6cf30c1e-7a47-4dbc-b802-d9b79010be44, {{(pid=87234) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 10:08:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-4d1f20c4-6705-421d-b5ec-098e6ab5c9f7 tempest-VolumesCloneTest-221284204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:08:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-4d1f20c4-6705-421d-b5ec-098e6ab5c9f7 tempest-VolumesCloneTest-221284204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:08:27 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-4d1f20c4-6705-421d-b5ec-098e6ab5c9f7 tempest-VolumesCloneTest-221284204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:08:27 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-4d1f20c4-6705-421d-b5ec-098e6ab5c9f7 tempest-VolumesCloneTest-221284204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:08:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-4d1f20c4-6705-421d-b5ec-098e6ab5c9f7 tempest-VolumesCloneTest-221284204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:08:27 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c0ce0a-1a58-4f6e-8ad4-cd802bf8147d]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:08:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4d1f20c4-6705-421d-b5ec-098e6ab5c9f7 tempest-VolumesCloneTest-221284204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-312b1c42-a6ec-4cc1-b525-1466d774b905.9ab053a5-51b5-40e7-b163-d511a90bab52 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:27 devstack sudo[93748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-312b1c42-a6ec-4cc1-b525-1466d774b905.9ab053a5-51b5-40e7-b163-d511a90bab52 Jul 10 10:08:27 devstack sudo[93748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:28 devstack sudo[93748]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4d1f20c4-6705-421d-b5ec-098e6ab5c9f7 tempest-VolumesCloneTest-221284204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-312b1c42-a6ec-4cc1-b525-1466d774b905.9ab053a5-51b5-40e7-b163-d511a90bab52" returned: 0 in 1.243s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:28 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-4d1f20c4-6705-421d-b5ec-098e6ab5c9f7 tempest-VolumesCloneTest-221284204 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-312b1c42-a6ec-4cc1-b525-1466d774b905(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 10:08:28 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-4d1f20c4-6705-421d-b5ec-098e6ab5c9f7 tempest-VolumesCloneTest-221284204 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-312b1c42-a6ec-4cc1-b525-1466d774b905 {{(pid=87234) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 10:08:28 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-4d1f20c4-6705-421d-b5ec-098e6ab5c9f7 tempest-VolumesCloneTest-221284204 None] Creating direct copy from snapshot {{(pid=87234) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 10:08:28 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd43c4c-9e8e-4211-8e5d-2c9cad769100]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:08:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4d1f20c4-6705-421d-b5ec-098e6ab5c9f7 tempest-VolumesCloneTest-221284204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-312b1c42-a6ec-4cc1-b525-1466d774b905 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:28 devstack sudo[93753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-312b1c42-a6ec-4cc1-b525-1466d774b905 Jul 10 10:08:28 devstack sudo[93753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:29 devstack sudo[93753]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:29 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4d1f20c4-6705-421d-b5ec-098e6ab5c9f7 tempest-VolumesCloneTest-221284204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-312b1c42-a6ec-4cc1-b525-1466d774b905" returned: 0 in 0.915s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:29 devstack cinder-volume[87234]: DEBUG cinder.utils [None req-4d1f20c4-6705-421d-b5ec-098e6ab5c9f7 tempest-VolumesCloneTest-221284204 None] Path /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-6cf30c1e-7a47-4dbc-b802-d9b79010be44 not found in is_blk_device check {{(pid=87234) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 10:08:29 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4d1f20c4-6705-421d-b5ec-098e6ab5c9f7 tempest-VolumesCloneTest-221284204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-312b1c42-a6ec-4cc1-b525-1466d774b905 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-6cf30c1e-7a47-4dbc-b802-d9b79010be44 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:29 devstack sudo[93764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-312b1c42-a6ec-4cc1-b525-1466d774b905 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-6cf30c1e-7a47-4dbc-b802-d9b79010be44 Jul 10 10:08:29 devstack sudo[93764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:30 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-82b2cd3e-a2ac-402b-89fc-9b2d334db271 tempest-AbsoluteLimitsTests-124283183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:08:30 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-82b2cd3e-a2ac-402b-89fc-9b2d334db271 tempest-AbsoluteLimitsTests-124283183 None] Flow 'volume_create_manager' (7b233ea8-1dd0-4971-871a-7b2d8c7f464a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:08:30 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-82b2cd3e-a2ac-402b-89fc-9b2d334db271 tempest-AbsoluteLimitsTests-124283183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa63023a-8114-4449-9da9-ad660939cb5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:08:30 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-82b2cd3e-a2ac-402b-89fc-9b2d334db271 tempest-AbsoluteLimitsTests-124283183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa63023a-8114-4449-9da9-ad660939cb5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:08:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-779874636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0353b56e-a4c7-46a9-9fcf-0f92d8ae56d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebe951355f3c494dbb1f73f2a80d349f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:08:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:08:31Z,use_quota=True,user_id='a4be02a29c2f41f4b8fb1235bdf25538',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:08:30 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-82b2cd3e-a2ac-402b-89fc-9b2d334db271 tempest-AbsoluteLimitsTests-124283183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54cd1234-76cb-4146-ac0c-1ac863832387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:08:30 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-82b2cd3e-a2ac-402b-89fc-9b2d334db271 tempest-AbsoluteLimitsTests-124283183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54cd1234-76cb-4146-ac0c-1ac863832387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:08:30 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-82b2cd3e-a2ac-402b-89fc-9b2d334db271 tempest-AbsoluteLimitsTests-124283183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eba3f73-24ee-40b8-819e-62356ac02a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:08:30 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-82b2cd3e-a2ac-402b-89fc-9b2d334db271 tempest-AbsoluteLimitsTests-124283183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eba3f73-24ee-40b8-819e-62356ac02a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0353b56e-a4c7-46a9-9fcf-0f92d8ae56d2', 'volume_name': 'volume-0353b56e-a4c7-46a9-9fcf-0f92d8ae56d2', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:08:30 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-82b2cd3e-a2ac-402b-89fc-9b2d334db271 tempest-AbsoluteLimitsTests-124283183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67337298-4819-4c35-8fbc-a92b93776560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:08:30 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-82b2cd3e-a2ac-402b-89fc-9b2d334db271 tempest-AbsoluteLimitsTests-124283183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67337298-4819-4c35-8fbc-a92b93776560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:08:30 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-82b2cd3e-a2ac-402b-89fc-9b2d334db271 tempest-AbsoluteLimitsTests-124283183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6baa97b5-886e-4b70-bdae-352e8fa84a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:08:30 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-82b2cd3e-a2ac-402b-89fc-9b2d334db271 tempest-AbsoluteLimitsTests-124283183 None] Volume 0353b56e-a4c7-46a9-9fcf-0f92d8ae56d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0353b56e-a4c7-46a9-9fcf-0f92d8ae56d2', 'volume_size': 1} Jul 10 10:08:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-82b2cd3e-a2ac-402b-89fc-9b2d334db271 tempest-AbsoluteLimitsTests-124283183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:08:33 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-2744be4b-865d-4b19-b585-18bf3c897c03 tempest-SnapshotsActionsTest-852873252 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:08:33 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-2744be4b-865d-4b19-b585-18bf3c897c03 tempest-SnapshotsActionsTest-852873252 None] Flow 'volume_create_manager' (a4f5c489-a8c9-4672-bb49-4555a35487c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:08:33 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-2744be4b-865d-4b19-b585-18bf3c897c03 tempest-SnapshotsActionsTest-852873252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3614e13e-64ae-47c6-a7b5-055473776255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:08:33 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-2744be4b-865d-4b19-b585-18bf3c897c03 tempest-SnapshotsActionsTest-852873252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3614e13e-64ae-47c6-a7b5-055473776255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1058046592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c136b0f5-b6de-4617-8094-382c31e31841,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dec2dfffca4471cbe43cd9c1d02129a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:08:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:08:33Z,use_quota=True,user_id='577fdaef94f443758d88e310e5089f57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:08:33 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-2744be4b-865d-4b19-b585-18bf3c897c03 tempest-SnapshotsActionsTest-852873252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00129528-bdc7-4a08-85b5-6c8d9f366851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:08:33 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-2744be4b-865d-4b19-b585-18bf3c897c03 tempest-SnapshotsActionsTest-852873252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00129528-bdc7-4a08-85b5-6c8d9f366851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:08:33 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-2744be4b-865d-4b19-b585-18bf3c897c03 tempest-SnapshotsActionsTest-852873252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0f7e3e0-f93c-4a23-8427-a33cf4d35e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:08:33 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-2744be4b-865d-4b19-b585-18bf3c897c03 tempest-SnapshotsActionsTest-852873252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0f7e3e0-f93c-4a23-8427-a33cf4d35e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c136b0f5-b6de-4617-8094-382c31e31841', 'volume_name': 'volume-c136b0f5-b6de-4617-8094-382c31e31841', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:08:33 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-2744be4b-865d-4b19-b585-18bf3c897c03 tempest-SnapshotsActionsTest-852873252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9843ec5-2b96-4bae-8289-4a3a304dd6de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:08:33 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-2744be4b-865d-4b19-b585-18bf3c897c03 tempest-SnapshotsActionsTest-852873252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9843ec5-2b96-4bae-8289-4a3a304dd6de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:08:33 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-2744be4b-865d-4b19-b585-18bf3c897c03 tempest-SnapshotsActionsTest-852873252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f49c98ce-e60d-4357-a919-f470a56e2d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:08:33 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-2744be4b-865d-4b19-b585-18bf3c897c03 tempest-SnapshotsActionsTest-852873252 None] Volume c136b0f5-b6de-4617-8094-382c31e31841: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c136b0f5-b6de-4617-8094-382c31e31841', 'volume_size': 1} Jul 10 10:08:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-2744be4b-865d-4b19-b585-18bf3c897c03 tempest-SnapshotsActionsTest-852873252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:08:35 devstack sudo[93764]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:35 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4d1f20c4-6705-421d-b5ec-098e6ab5c9f7 tempest-VolumesCloneTest-221284204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-312b1c42-a6ec-4cc1-b525-1466d774b905 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-6cf30c1e-7a47-4dbc-b802-d9b79010be44" returned: 0 in 6.329s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:35 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[f256b92b-6763-4fa5-b31d-7baf5571814b]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:08:35 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4d1f20c4-6705-421d-b5ec-098e6ab5c9f7 tempest-VolumesCloneTest-221284204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-312b1c42-a6ec-4cc1-b525-1466d774b905 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:35 devstack sudo[93778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-312b1c42-a6ec-4cc1-b525-1466d774b905 Jul 10 10:08:35 devstack sudo[93778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:36 devstack sudo[93778]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:36 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4d1f20c4-6705-421d-b5ec-098e6ab5c9f7 tempest-VolumesCloneTest-221284204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-312b1c42-a6ec-4cc1-b525-1466d774b905" returned: 0 in 0.957s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:36 devstack cinder-volume[87234]: DEBUG cinder.image.image_utils [None req-4d1f20c4-6705-421d-b5ec-098e6ab5c9f7 tempest-VolumesCloneTest-221284204 None] Image conversion details: src /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-312b1c42-a6ec-4cc1-b525-1466d774b905, size 1024.00 MB, duration 6.33 sec, destination /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-6cf30c1e-7a47-4dbc-b802-d9b79010be44 {{(pid=87234) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 10:08:36 devstack cinder-volume[87234]: INFO cinder.image.image_utils [None req-4d1f20c4-6705-421d-b5ec-098e6ab5c9f7 tempest-VolumesCloneTest-221284204 None] Converted 1024.00 MB image at 161.77 MB/s Jul 10 10:08:36 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-4d1f20c4-6705-421d-b5ec-098e6ab5c9f7 tempest-VolumesCloneTest-221284204 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-6cf30c1e-7a47-4dbc-b802-d9b79010be44 is being set with open permissions: ugo+rw Jul 10 10:08:36 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4d1f20c4-6705-421d-b5ec-098e6ab5c9f7 tempest-VolumesCloneTest-221284204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-6cf30c1e-7a47-4dbc-b802-d9b79010be44 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:36 devstack sudo[93784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-6cf30c1e-7a47-4dbc-b802-d9b79010be44 Jul 10 10:08:36 devstack sudo[93784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:37 devstack sudo[93784]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:37 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4d1f20c4-6705-421d-b5ec-098e6ab5c9f7 tempest-VolumesCloneTest-221284204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-6cf30c1e-7a47-4dbc-b802-d9b79010be44" returned: 0 in 0.653s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:37 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-4d1f20c4-6705-421d-b5ec-098e6ab5c9f7 tempest-VolumesCloneTest-221284204 None] Lock "cinder-quobyte-6cf30c1e-7a47-4dbc-b802-d9b79010be44" released by "_copy_volume_from_snapshot" :: held 10.231s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:08:37 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-4d1f20c4-6705-421d-b5ec-098e6ab5c9f7 tempest-VolumesCloneTest-221284204 None] Acquiring lock "cinder-quobyte-9ab053a5-51b5-40e7-b163-d511a90bab52" by "_delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:08:37 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-4d1f20c4-6705-421d-b5ec-098e6ab5c9f7 tempest-VolumesCloneTest-221284204 None] Lock "cinder-quobyte-9ab053a5-51b5-40e7-b163-d511a90bab52" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:08:37 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-4d1f20c4-6705-421d-b5ec-098e6ab5c9f7 tempest-VolumesCloneTest-221284204 None] Deleting offline snapshot 9ab053a5-51b5-40e7-b163-d511a90bab52 of volume 312b1c42-a6ec-4cc1-b525-1466d774b905 {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 10:08:37 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-4d1f20c4-6705-421d-b5ec-098e6ab5c9f7 tempest-VolumesCloneTest-221284204 None] snapshot_file for this snap is: volume-312b1c42-a6ec-4cc1-b525-1466d774b905.9ab053a5-51b5-40e7-b163-d511a90bab52 {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 10:08:37 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1d26c9-4473-49e9-826e-69e272edb7bd]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:08:37 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4d1f20c4-6705-421d-b5ec-098e6ab5c9f7 tempest-VolumesCloneTest-221284204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-312b1c42-a6ec-4cc1-b525-1466d774b905.9ab053a5-51b5-40e7-b163-d511a90bab52 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:37 devstack sudo[93787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-312b1c42-a6ec-4cc1-b525-1466d774b905.9ab053a5-51b5-40e7-b163-d511a90bab52 Jul 10 10:08:37 devstack sudo[93787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:38 devstack sudo[93787]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4d1f20c4-6705-421d-b5ec-098e6ab5c9f7 tempest-VolumesCloneTest-221284204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-312b1c42-a6ec-4cc1-b525-1466d774b905.9ab053a5-51b5-40e7-b163-d511a90bab52" returned: 0 in 0.769s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:38 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-4d1f20c4-6705-421d-b5ec-098e6ab5c9f7 tempest-VolumesCloneTest-221284204 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-312b1c42-a6ec-4cc1-b525-1466d774b905(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 10:08:38 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b8ba4b8-4d07-4576-8eda-b437affe78f6]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:08:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4d1f20c4-6705-421d-b5ec-098e6ab5c9f7 tempest-VolumesCloneTest-221284204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-312b1c42-a6ec-4cc1-b525-1466d774b905 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:38 devstack sudo[93802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-312b1c42-a6ec-4cc1-b525-1466d774b905 Jul 10 10:08:38 devstack sudo[93802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:38 devstack sudo[93802]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4d1f20c4-6705-421d-b5ec-098e6ab5c9f7 tempest-VolumesCloneTest-221284204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-312b1c42-a6ec-4cc1-b525-1466d774b905" returned: 0 in 0.764s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4d1f20c4-6705-421d-b5ec-098e6ab5c9f7 tempest-VolumesCloneTest-221284204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-312b1c42-a6ec-4cc1-b525-1466d774b905.9ab053a5-51b5-40e7-b163-d511a90bab52 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:38 devstack sudo[93807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-312b1c42-a6ec-4cc1-b525-1466d774b905.9ab053a5-51b5-40e7-b163-d511a90bab52 Jul 10 10:08:38 devstack sudo[93807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:39 devstack sudo[93807]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:39 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4d1f20c4-6705-421d-b5ec-098e6ab5c9f7 tempest-VolumesCloneTest-221284204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-312b1c42-a6ec-4cc1-b525-1466d774b905.9ab053a5-51b5-40e7-b163-d511a90bab52" returned: 0 in 0.719s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:39 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4d1f20c4-6705-421d-b5ec-098e6ab5c9f7 tempest-VolumesCloneTest-221284204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-312b1c42-a6ec-4cc1-b525-1466d774b905.9ab053a5-51b5-40e7-b163-d511a90bab52 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:39 devstack sudo[93812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-312b1c42-a6ec-4cc1-b525-1466d774b905.9ab053a5-51b5-40e7-b163-d511a90bab52 Jul 10 10:08:39 devstack sudo[93812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:40 devstack sudo[93812]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4d1f20c4-6705-421d-b5ec-098e6ab5c9f7 tempest-VolumesCloneTest-221284204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-312b1c42-a6ec-4cc1-b525-1466d774b905.9ab053a5-51b5-40e7-b163-d511a90bab52" returned: 0 in 0.659s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:40 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-4d1f20c4-6705-421d-b5ec-098e6ab5c9f7 tempest-VolumesCloneTest-221284204 None] Lock "cinder-quobyte-9ab053a5-51b5-40e7-b163-d511a90bab52" released by "_delete_snapshot" :: held 3.019s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:08:40 devstack cinder-volume[87234]: DEBUG dbcounter [-] [87234] Writing DB stats cinder:SELECT=93,cinder:UPDATE=112,cinder:DELETE=8,cinder:INSERT=27 {{(pid=87234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 10:08:40 devstack cinder-volume[87234]: DEBUG dbcounter [-] [87234] Writing DB stats cinder:SELECT=89,cinder:INSERT=23,cinder:UPDATE=102,cinder:DELETE=8 {{(pid=87234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 10:08:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-4d1f20c4-6705-421d-b5ec-098e6ab5c9f7 tempest-VolumesCloneTest-221284204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 20.159s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:08:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-82b2cd3e-a2ac-402b-89fc-9b2d334db271 tempest-AbsoluteLimitsTests-124283183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.544s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:08:40 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-82b2cd3e-a2ac-402b-89fc-9b2d334db271 tempest-AbsoluteLimitsTests-124283183 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:08:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-779874636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0353b56e-a4c7-46a9-9fcf-0f92d8ae56d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebe951355f3c494dbb1f73f2a80d349f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:08:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:08:31Z,use_quota=True,user_id='a4be02a29c2f41f4b8fb1235bdf25538',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:08:40 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-82b2cd3e-a2ac-402b-89fc-9b2d334db271 tempest-AbsoluteLimitsTests-124283183 None] Creating volume 0353b56e-a4c7-46a9-9fcf-0f92d8ae56d2 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:08:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-82b2cd3e-a2ac-402b-89fc-9b2d334db271 tempest-AbsoluteLimitsTests-124283183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:08:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-82b2cd3e-a2ac-402b-89fc-9b2d334db271 tempest-AbsoluteLimitsTests-124283183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:08:40 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-82b2cd3e-a2ac-402b-89fc-9b2d334db271 tempest-AbsoluteLimitsTests-124283183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:08:40 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-82b2cd3e-a2ac-402b-89fc-9b2d334db271 tempest-AbsoluteLimitsTests-124283183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:08:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-82b2cd3e-a2ac-402b-89fc-9b2d334db271 tempest-AbsoluteLimitsTests-124283183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:08:40 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-82b2cd3e-a2ac-402b-89fc-9b2d334db271 tempest-AbsoluteLimitsTests-124283183 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:08:40 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-82b2cd3e-a2ac-402b-89fc-9b2d334db271 tempest-AbsoluteLimitsTests-124283183 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:08:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-82b2cd3e-a2ac-402b-89fc-9b2d334db271 tempest-AbsoluteLimitsTests-124283183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0353b56e-a4c7-46a9-9fcf-0f92d8ae56d2 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:40 devstack sudo[93839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0353b56e-a4c7-46a9-9fcf-0f92d8ae56d2 1073741824 Jul 10 10:08:40 devstack sudo[93839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:40 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4d1f20c4-6705-421d-b5ec-098e6ab5c9f7 tempest-VolumesCloneTest-221284204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d248030-2769-4c12-941a-933da5e1343f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cf30c1e-7a47-4dbc-b802-d9b79010be44', 'volume_size': 2, 'source_volid': '312b1c42-a6ec-4cc1-b525-1466d774b905', 'source_volstatus': 'available'}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:08:40 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4d1f20c4-6705-421d-b5ec-098e6ab5c9f7 tempest-VolumesCloneTest-221284204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f5713b0-2ac0-4571-99b2-689d4af83068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:08:40 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-4d1f20c4-6705-421d-b5ec-098e6ab5c9f7 tempest-VolumesCloneTest-221284204 None] Volume volume-6cf30c1e-7a47-4dbc-b802-d9b79010be44 (6cf30c1e-7a47-4dbc-b802-d9b79010be44): created successfully Jul 10 10:08:40 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4d1f20c4-6705-421d-b5ec-098e6ab5c9f7 tempest-VolumesCloneTest-221284204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f5713b0-2ac0-4571-99b2-689d4af83068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:08:40 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4d1f20c4-6705-421d-b5ec-098e6ab5c9f7 tempest-VolumesCloneTest-221284204 None] Flow 'volume_create_manager' (8d97b17e-6190-4bfb-89b5-bdafe63d0687) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:08:40 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-4d1f20c4-6705-421d-b5ec-098e6ab5c9f7 tempest-VolumesCloneTest-221284204 None] Created volume successfully. Jul 10 10:08:41 devstack sudo[93839]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-82b2cd3e-a2ac-402b-89fc-9b2d334db271 tempest-AbsoluteLimitsTests-124283183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0353b56e-a4c7-46a9-9fcf-0f92d8ae56d2 1073741824" returned: 0 in 0.843s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-82b2cd3e-a2ac-402b-89fc-9b2d334db271 tempest-AbsoluteLimitsTests-124283183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0353b56e-a4c7-46a9-9fcf-0f92d8ae56d2 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:41 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-a3fd89b2-51b8-4625-a425-2dc5e965759e tempest-VolumesCloneTest-221284204 None] Acquiring lock "cinder-6cf30c1e-7a47-4dbc-b802-d9b79010be44-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:08:41 devstack sudo[93845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0353b56e-a4c7-46a9-9fcf-0f92d8ae56d2 Jul 10 10:08:41 devstack sudo[93845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:41 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-a3fd89b2-51b8-4625-a425-2dc5e965759e tempest-VolumesCloneTest-221284204 None] Lock "cinder-6cf30c1e-7a47-4dbc-b802-d9b79010be44-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:08:41 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-a3fd89b2-51b8-4625-a425-2dc5e965759e tempest-VolumesCloneTest-221284204 None] Acquiring lock "cinder-quobyte-6cf30c1e-7a47-4dbc-b802-d9b79010be44" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:08:41 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-a3fd89b2-51b8-4625-a425-2dc5e965759e tempest-VolumesCloneTest-221284204 None] Lock "cinder-quobyte-6cf30c1e-7a47-4dbc-b802-d9b79010be44" acquired by "delete_volume" :: waited 0.021s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:08:41 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70b8f08-f687-4aee-a8a7-e512a128c124]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:08:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a3fd89b2-51b8-4625-a425-2dc5e965759e tempest-VolumesCloneTest-221284204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-6cf30c1e-7a47-4dbc-b802-d9b79010be44 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:41 devstack sudo[93847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-6cf30c1e-7a47-4dbc-b802-d9b79010be44 Jul 10 10:08:41 devstack sudo[93847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:41 devstack sudo[93845]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-82b2cd3e-a2ac-402b-89fc-9b2d334db271 tempest-AbsoluteLimitsTests-124283183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0353b56e-a4c7-46a9-9fcf-0f92d8ae56d2" returned: 0 in 0.675s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:41 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-82b2cd3e-a2ac-402b-89fc-9b2d334db271 tempest-AbsoluteLimitsTests-124283183 None] <== create_volume: return (1560ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:08:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-82b2cd3e-a2ac-402b-89fc-9b2d334db271 tempest-AbsoluteLimitsTests-124283183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.562s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:08:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-2744be4b-865d-4b19-b585-18bf3c897c03 tempest-SnapshotsActionsTest-852873252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.690s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:08:41 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-2744be4b-865d-4b19-b585-18bf3c897c03 tempest-SnapshotsActionsTest-852873252 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1058046592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c136b0f5-b6de-4617-8094-382c31e31841,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dec2dfffca4471cbe43cd9c1d02129a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:08:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:08:33Z,use_quota=True,user_id='577fdaef94f443758d88e310e5089f57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:08:41 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-2744be4b-865d-4b19-b585-18bf3c897c03 tempest-SnapshotsActionsTest-852873252 None] Creating volume c136b0f5-b6de-4617-8094-382c31e31841 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:08:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-2744be4b-865d-4b19-b585-18bf3c897c03 tempest-SnapshotsActionsTest-852873252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:08:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-2744be4b-865d-4b19-b585-18bf3c897c03 tempest-SnapshotsActionsTest-852873252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:08:41 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-2744be4b-865d-4b19-b585-18bf3c897c03 tempest-SnapshotsActionsTest-852873252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:08:41 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-2744be4b-865d-4b19-b585-18bf3c897c03 tempest-SnapshotsActionsTest-852873252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:08:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-2744be4b-865d-4b19-b585-18bf3c897c03 tempest-SnapshotsActionsTest-852873252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:08:41 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-2744be4b-865d-4b19-b585-18bf3c897c03 tempest-SnapshotsActionsTest-852873252 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:08:41 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-2744be4b-865d-4b19-b585-18bf3c897c03 tempest-SnapshotsActionsTest-852873252 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:08:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-2744be4b-865d-4b19-b585-18bf3c897c03 tempest-SnapshotsActionsTest-852873252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:41 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-82b2cd3e-a2ac-402b-89fc-9b2d334db271 tempest-AbsoluteLimitsTests-124283183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6baa97b5-886e-4b70-bdae-352e8fa84a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0353b56e-a4c7-46a9-9fcf-0f92d8ae56d2', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:08:41 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-82b2cd3e-a2ac-402b-89fc-9b2d334db271 tempest-AbsoluteLimitsTests-124283183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5c070f8-2df0-4534-af54-75d3659302c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:08:41 devstack sudo[93850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841 1073741824 Jul 10 10:08:41 devstack sudo[93850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:41 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-82b2cd3e-a2ac-402b-89fc-9b2d334db271 tempest-AbsoluteLimitsTests-124283183 None] Volume volume-0353b56e-a4c7-46a9-9fcf-0f92d8ae56d2 (0353b56e-a4c7-46a9-9fcf-0f92d8ae56d2): created successfully Jul 10 10:08:41 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-82b2cd3e-a2ac-402b-89fc-9b2d334db271 tempest-AbsoluteLimitsTests-124283183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5c070f8-2df0-4534-af54-75d3659302c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:08:41 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-82b2cd3e-a2ac-402b-89fc-9b2d334db271 tempest-AbsoluteLimitsTests-124283183 None] Flow 'volume_create_manager' (7b233ea8-1dd0-4971-871a-7b2d8c7f464a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:08:41 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-82b2cd3e-a2ac-402b-89fc-9b2d334db271 tempest-AbsoluteLimitsTests-124283183 None] Created volume successfully. Jul 10 10:08:42 devstack cinder-volume[87234]: DEBUG oslo_service.periodic_task [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 10:08:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:08:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:08:42 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:08:42 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:08:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:08:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:42 devstack sudo[93855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:08:42 devstack sudo[93855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:42 devstack sudo[93847]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a3fd89b2-51b8-4625-a425-2dc5e965759e tempest-VolumesCloneTest-221284204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-6cf30c1e-7a47-4dbc-b802-d9b79010be44" returned: 0 in 0.803s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a3fd89b2-51b8-4625-a425-2dc5e965759e tempest-VolumesCloneTest-221284204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-6cf30c1e-7a47-4dbc-b802-d9b79010be44 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:42 devstack sudo[93857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-6cf30c1e-7a47-4dbc-b802-d9b79010be44 Jul 10 10:08:42 devstack sudo[93857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:42 devstack sudo[93855]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.701s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:42 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:08:42 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-080b334e-a918-4bfe-9357-91d7ac2d1428 tempest-AbsoluteLimitsTests-124283183 None] Acquiring lock "cinder-0353b56e-a4c7-46a9-9fcf-0f92d8ae56d2-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:08:42 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-080b334e-a918-4bfe-9357-91d7ac2d1428 tempest-AbsoluteLimitsTests-124283183 None] Lock "cinder-0353b56e-a4c7-46a9-9fcf-0f92d8ae56d2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:08:42 devstack sudo[93857]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:42 devstack sudo[93850]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a3fd89b2-51b8-4625-a425-2dc5e965759e tempest-VolumesCloneTest-221284204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-6cf30c1e-7a47-4dbc-b802-d9b79010be44" returned: 0 in 0.747s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-2744be4b-865d-4b19-b585-18bf3c897c03 tempest-SnapshotsActionsTest-852873252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841 1073741824" returned: 0 in 0.993s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:42 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-080b334e-a918-4bfe-9357-91d7ac2d1428 tempest-AbsoluteLimitsTests-124283183 None] Acquiring lock "cinder-quobyte-0353b56e-a4c7-46a9-9fcf-0f92d8ae56d2" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:08:42 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-a3fd89b2-51b8-4625-a425-2dc5e965759e tempest-VolumesCloneTest-221284204 None] Lock "cinder-quobyte-6cf30c1e-7a47-4dbc-b802-d9b79010be44" released by "delete_volume" :: held 1.617s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:08:42 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-080b334e-a918-4bfe-9357-91d7ac2d1428 tempest-AbsoluteLimitsTests-124283183 None] Lock "cinder-quobyte-0353b56e-a4c7-46a9-9fcf-0f92d8ae56d2" acquired by "delete_volume" :: waited 0.029s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:08:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-2744be4b-865d-4b19-b585-18bf3c897c03 tempest-SnapshotsActionsTest-852873252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:43 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[844d4a97-1a16-40fe-87e7-62f4b3790f4a]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:08:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-080b334e-a918-4bfe-9357-91d7ac2d1428 tempest-AbsoluteLimitsTests-124283183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0353b56e-a4c7-46a9-9fcf-0f92d8ae56d2 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:43 devstack sudo[93865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841 Jul 10 10:08:43 devstack sudo[93865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:43 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-a3fd89b2-51b8-4625-a425-2dc5e965759e tempest-VolumesCloneTest-221284204 None] Created reservations ['034e4797-db85-4445-be7c-b41321d8b52c', 'e8e7b76f-a716-4598-9c60-ce6e93e909c3', 'a9e08589-6c9a-4511-8c61-dc84bdbf1d63', 'b7331410-87f6-430c-9676-3cd033689cf6'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:08:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-a3fd89b2-51b8-4625-a425-2dc5e965759e tempest-VolumesCloneTest-221284204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:08:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-a3fd89b2-51b8-4625-a425-2dc5e965759e tempest-VolumesCloneTest-221284204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:08:43 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-a3fd89b2-51b8-4625-a425-2dc5e965759e tempest-VolumesCloneTest-221284204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:08:43 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-a3fd89b2-51b8-4625-a425-2dc5e965759e tempest-VolumesCloneTest-221284204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:08:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-a3fd89b2-51b8-4625-a425-2dc5e965759e tempest-VolumesCloneTest-221284204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:08:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a3fd89b2-51b8-4625-a425-2dc5e965759e tempest-VolumesCloneTest-221284204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:43 devstack sudo[93866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0353b56e-a4c7-46a9-9fcf-0f92d8ae56d2 Jul 10 10:08:43 devstack sudo[93866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:43 devstack sudo[93868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:08:43 devstack sudo[93868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:43 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-42ba1ff3-c8ed-4031-bf94-2bc774798f5a tempest-VolumesCloneTest-221284204 None] Acquiring lock "cinder-312b1c42-a6ec-4cc1-b525-1466d774b905-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:08:43 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-42ba1ff3-c8ed-4031-bf94-2bc774798f5a tempest-VolumesCloneTest-221284204 None] Lock "cinder-312b1c42-a6ec-4cc1-b525-1466d774b905-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:08:43 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-42ba1ff3-c8ed-4031-bf94-2bc774798f5a tempest-VolumesCloneTest-221284204 None] Acquiring lock "cinder-quobyte-312b1c42-a6ec-4cc1-b525-1466d774b905" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:08:43 devstack sudo[93865]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-2744be4b-865d-4b19-b585-18bf3c897c03 tempest-SnapshotsActionsTest-852873252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841" returned: 0 in 0.719s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:43 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-2744be4b-865d-4b19-b585-18bf3c897c03 tempest-SnapshotsActionsTest-852873252 None] <== create_volume: return (1795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:08:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-2744be4b-865d-4b19-b585-18bf3c897c03 tempest-SnapshotsActionsTest-852873252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.801s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:08:43 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-42ba1ff3-c8ed-4031-bf94-2bc774798f5a tempest-VolumesCloneTest-221284204 None] Lock "cinder-quobyte-312b1c42-a6ec-4cc1-b525-1466d774b905" acquired by "delete_volume" :: waited 0.026s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:08:43 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-2744be4b-865d-4b19-b585-18bf3c897c03 tempest-SnapshotsActionsTest-852873252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f49c98ce-e60d-4357-a919-f470a56e2d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c136b0f5-b6de-4617-8094-382c31e31841', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:08:43 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-2744be4b-865d-4b19-b585-18bf3c897c03 tempest-SnapshotsActionsTest-852873252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fcc3e0f-09fb-458b-a78d-bbb981ac048e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:08:43 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5fc6a7a-762b-4f95-a1bc-62c3b996c512]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:08:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-42ba1ff3-c8ed-4031-bf94-2bc774798f5a tempest-VolumesCloneTest-221284204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-312b1c42-a6ec-4cc1-b525-1466d774b905 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:43 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-2744be4b-865d-4b19-b585-18bf3c897c03 tempest-SnapshotsActionsTest-852873252 None] Volume volume-c136b0f5-b6de-4617-8094-382c31e31841 (c136b0f5-b6de-4617-8094-382c31e31841): created successfully Jul 10 10:08:43 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-2744be4b-865d-4b19-b585-18bf3c897c03 tempest-SnapshotsActionsTest-852873252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fcc3e0f-09fb-458b-a78d-bbb981ac048e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:08:43 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-2744be4b-865d-4b19-b585-18bf3c897c03 tempest-SnapshotsActionsTest-852873252 None] Flow 'volume_create_manager' (a4f5c489-a8c9-4672-bb49-4555a35487c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:08:43 devstack sudo[93866]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-080b334e-a918-4bfe-9357-91d7ac2d1428 tempest-AbsoluteLimitsTests-124283183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0353b56e-a4c7-46a9-9fcf-0f92d8ae56d2" returned: 0 in 0.840s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-080b334e-a918-4bfe-9357-91d7ac2d1428 tempest-AbsoluteLimitsTests-124283183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0353b56e-a4c7-46a9-9fcf-0f92d8ae56d2 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:43 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-2744be4b-865d-4b19-b585-18bf3c897c03 tempest-SnapshotsActionsTest-852873252 None] Created volume successfully. Jul 10 10:08:43 devstack sudo[93877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0353b56e-a4c7-46a9-9fcf-0f92d8ae56d2 Jul 10 10:08:43 devstack sudo[93877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:43 devstack sudo[93868]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a3fd89b2-51b8-4625-a425-2dc5e965759e tempest-VolumesCloneTest-221284204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.791s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:43 devstack sudo[93876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-312b1c42-a6ec-4cc1-b525-1466d774b905 Jul 10 10:08:43 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-a3fd89b2-51b8-4625-a425-2dc5e965759e tempest-VolumesCloneTest-221284204 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:08:43 devstack sudo[93876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:43 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-a3fd89b2-51b8-4625-a425-2dc5e965759e tempest-VolumesCloneTest-221284204 None] Deleted volume successfully. Jul 10 10:08:43 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-a3fd89b2-51b8-4625-a425-2dc5e965759e tempest-VolumesCloneTest-221284204 None] Lock "cinder-6cf30c1e-7a47-4dbc-b802-d9b79010be44-delete_volume" released by "delete_volume" :: held 2.671s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:08:44 devstack sudo[93877]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-080b334e-a918-4bfe-9357-91d7ac2d1428 tempest-AbsoluteLimitsTests-124283183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0353b56e-a4c7-46a9-9fcf-0f92d8ae56d2" returned: 0 in 0.665s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:44 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-080b334e-a918-4bfe-9357-91d7ac2d1428 tempest-AbsoluteLimitsTests-124283183 None] Lock "cinder-quobyte-0353b56e-a4c7-46a9-9fcf-0f92d8ae56d2" released by "delete_volume" :: held 1.565s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:08:44 devstack sudo[93876]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:44 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-080b334e-a918-4bfe-9357-91d7ac2d1428 tempest-AbsoluteLimitsTests-124283183 None] Created reservations ['c2dff414-a95d-4fab-be99-3f4ca6f01b8e', '7e5cfccc-5acb-4263-a331-10849addfc85', 'ce6dc90f-6ae1-4e35-9606-d79a2556e011', '5edc662b-31b8-476e-8be0-55d0bd0b46a1'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:08:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-42ba1ff3-c8ed-4031-bf94-2bc774798f5a tempest-VolumesCloneTest-221284204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-312b1c42-a6ec-4cc1-b525-1466d774b905" returned: 0 in 0.797s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-42ba1ff3-c8ed-4031-bf94-2bc774798f5a tempest-VolumesCloneTest-221284204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-312b1c42-a6ec-4cc1-b525-1466d774b905 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:44 devstack sudo[93884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-312b1c42-a6ec-4cc1-b525-1466d774b905 Jul 10 10:08:44 devstack sudo[93884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-080b334e-a918-4bfe-9357-91d7ac2d1428 tempest-AbsoluteLimitsTests-124283183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:08:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-080b334e-a918-4bfe-9357-91d7ac2d1428 tempest-AbsoluteLimitsTests-124283183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:08:44 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-080b334e-a918-4bfe-9357-91d7ac2d1428 tempest-AbsoluteLimitsTests-124283183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:08:44 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-080b334e-a918-4bfe-9357-91d7ac2d1428 tempest-AbsoluteLimitsTests-124283183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:08:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-080b334e-a918-4bfe-9357-91d7ac2d1428 tempest-AbsoluteLimitsTests-124283183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:08:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-080b334e-a918-4bfe-9357-91d7ac2d1428 tempest-AbsoluteLimitsTests-124283183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:44 devstack sudo[93886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:08:44 devstack sudo[93886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-55ab1077-9f9d-4e6d-a01d-d43c5747b028 tempest-SnapshotsActionsTest-852873252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:08:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-55ab1077-9f9d-4e6d-a01d-d43c5747b028 tempest-SnapshotsActionsTest-852873252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:08:45 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-55ab1077-9f9d-4e6d-a01d-d43c5747b028 tempest-SnapshotsActionsTest-852873252 None] Creating offline snapshot b47c4fb0-9be6-4004-ac87-3d46de908169 of volume c136b0f5-b6de-4617-8094-382c31e31841 {{(pid=87234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 10:08:45 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba0ace47-d7d4-4baf-b7ce-6b8d1dd20ec1]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:08:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-55ab1077-9f9d-4e6d-a01d-d43c5747b028 tempest-SnapshotsActionsTest-852873252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:45 devstack sudo[93888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841 Jul 10 10:08:45 devstack sudo[93888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:45 devstack sudo[93884]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-42ba1ff3-c8ed-4031-bf94-2bc774798f5a tempest-VolumesCloneTest-221284204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-312b1c42-a6ec-4cc1-b525-1466d774b905" returned: 0 in 0.794s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:45 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-42ba1ff3-c8ed-4031-bf94-2bc774798f5a tempest-VolumesCloneTest-221284204 None] Lock "cinder-quobyte-312b1c42-a6ec-4cc1-b525-1466d774b905" released by "delete_volume" :: held 1.700s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:08:45 devstack sudo[93886]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-080b334e-a918-4bfe-9357-91d7ac2d1428 tempest-AbsoluteLimitsTests-124283183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.786s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:45 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-080b334e-a918-4bfe-9357-91d7ac2d1428 tempest-AbsoluteLimitsTests-124283183 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:08:45 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-080b334e-a918-4bfe-9357-91d7ac2d1428 tempest-AbsoluteLimitsTests-124283183 None] Deleted volume successfully. Jul 10 10:08:45 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-080b334e-a918-4bfe-9357-91d7ac2d1428 tempest-AbsoluteLimitsTests-124283183 None] Lock "cinder-0353b56e-a4c7-46a9-9fcf-0f92d8ae56d2-delete_volume" released by "delete_volume" :: held 2.620s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:08:45 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-42ba1ff3-c8ed-4031-bf94-2bc774798f5a tempest-VolumesCloneTest-221284204 None] Created reservations ['5ca7d224-de06-4600-a0c2-5254728e3028', 'faa79386-e126-4b5a-aecd-a7802ef0904e', '8a9e1e56-69ed-4755-bfb8-f1b118fced0e', '9c677a00-45be-4366-8e88-a44ea9ef7d00'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:08:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-42ba1ff3-c8ed-4031-bf94-2bc774798f5a tempest-VolumesCloneTest-221284204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:08:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-42ba1ff3-c8ed-4031-bf94-2bc774798f5a tempest-VolumesCloneTest-221284204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:08:45 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-42ba1ff3-c8ed-4031-bf94-2bc774798f5a tempest-VolumesCloneTest-221284204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:08:45 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-42ba1ff3-c8ed-4031-bf94-2bc774798f5a tempest-VolumesCloneTest-221284204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:08:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-42ba1ff3-c8ed-4031-bf94-2bc774798f5a tempest-VolumesCloneTest-221284204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:08:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-42ba1ff3-c8ed-4031-bf94-2bc774798f5a tempest-VolumesCloneTest-221284204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:45 devstack sudo[93892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:08:45 devstack sudo[93892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:46 devstack sudo[93888]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-55ab1077-9f9d-4e6d-a01d-d43c5747b028 tempest-SnapshotsActionsTest-852873252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841" returned: 0 in 1.014s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-55ab1077-9f9d-4e6d-a01d-d43c5747b028 tempest-SnapshotsActionsTest-852873252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.b47c4fb0-9be6-4004-ac87-3d46de908169 1G {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:46 devstack sudo[93898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.b47c4fb0-9be6-4004-ac87-3d46de908169 1G Jul 10 10:08:46 devstack sudo[93898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:46 devstack sudo[93892]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-42ba1ff3-c8ed-4031-bf94-2bc774798f5a tempest-VolumesCloneTest-221284204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.968s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:46 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-42ba1ff3-c8ed-4031-bf94-2bc774798f5a tempest-VolumesCloneTest-221284204 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:08:46 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-42ba1ff3-c8ed-4031-bf94-2bc774798f5a tempest-VolumesCloneTest-221284204 None] Deleted volume successfully. Jul 10 10:08:46 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-42ba1ff3-c8ed-4031-bf94-2bc774798f5a tempest-VolumesCloneTest-221284204 None] Lock "cinder-312b1c42-a6ec-4cc1-b525-1466d774b905-delete_volume" released by "delete_volume" :: held 3.052s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:08:47 devstack sudo[93898]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-55ab1077-9f9d-4e6d-a01d-d43c5747b028 tempest-SnapshotsActionsTest-852873252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.b47c4fb0-9be6-4004-ac87-3d46de908169 1G" returned: 0 in 1.161s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-55ab1077-9f9d-4e6d-a01d-d43c5747b028 tempest-SnapshotsActionsTest-852873252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c136b0f5-b6de-4617-8094-382c31e31841 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.b47c4fb0-9be6-4004-ac87-3d46de908169 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:47 devstack sudo[93906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c136b0f5-b6de-4617-8094-382c31e31841 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.b47c4fb0-9be6-4004-ac87-3d46de908169 Jul 10 10:08:47 devstack sudo[93906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:48 devstack sudo[93906]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-55ab1077-9f9d-4e6d-a01d-d43c5747b028 tempest-SnapshotsActionsTest-852873252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c136b0f5-b6de-4617-8094-382c31e31841 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.b47c4fb0-9be6-4004-ac87-3d46de908169" returned: 0 in 0.881s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:48 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-55ab1077-9f9d-4e6d-a01d-d43c5747b028 tempest-SnapshotsActionsTest-852873252 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.b47c4fb0-9be6-4004-ac87-3d46de908169 is being set with open permissions: ugo+rw Jul 10 10:08:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-55ab1077-9f9d-4e6d-a01d-d43c5747b028 tempest-SnapshotsActionsTest-852873252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.b47c4fb0-9be6-4004-ac87-3d46de908169 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:48 devstack sudo[93915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.b47c4fb0-9be6-4004-ac87-3d46de908169 Jul 10 10:08:48 devstack sudo[93915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:48 devstack sudo[93915]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-55ab1077-9f9d-4e6d-a01d-d43c5747b028 tempest-SnapshotsActionsTest-852873252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.b47c4fb0-9be6-4004-ac87-3d46de908169" returned: 0 in 0.688s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-55ab1077-9f9d-4e6d-a01d-d43c5747b028 tempest-SnapshotsActionsTest-852873252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:48 devstack sudo[93918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.info Jul 10 10:08:48 devstack sudo[93918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:49 devstack cinder-volume[87234]: INFO cinder.volume.manager [req-acc76166-63ac-4477-a6af-d62474c1ddfe req-967ad0ab-460c-4571-9646-4d6b2e417145 tempest-AttachVolumeTestJSON-202001593 None] Terminate volume connection completed successfully. Jul 10 10:08:49 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [req-acc76166-63ac-4477-a6af-d62474c1ddfe req-967ad0ab-460c-4571-9646-4d6b2e417145 tempest-AttachVolumeTestJSON-202001593 None] Deleting attachment d9b55b7d-8be1-4954-91bf-623f87ba1460. {{(pid=87234) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 10:08:49 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4e478cb-aa39-4385-b5e6-eb3dd24982ae tempest-VolumesGetTest-197214973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:08:49 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-e4e478cb-aa39-4385-b5e6-eb3dd24982ae tempest-VolumesGetTest-197214973 None] Flow 'volume_create_manager' (2f986977-7725-4a79-947c-f41d828cea44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:08:49 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-e4e478cb-aa39-4385-b5e6-eb3dd24982ae tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68732689-0148-444a-8f2a-c76985aaa266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:08:49 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-e4e478cb-aa39-4385-b5e6-eb3dd24982ae tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68732689-0148-444a-8f2a-c76985aaa266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:08:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1386614466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1cae148-2b4b-4dcf-85de-77f06f54878a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b6e1b243e2ee4fa3bf1c3dda0bf8b5da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:08:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:08:50Z,use_quota=True,user_id='683315fe0f3a4835aed6459f8e52b1dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:08:49 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-e4e478cb-aa39-4385-b5e6-eb3dd24982ae tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d139022-ea1a-4924-9ffc-cd1c0d22a6aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:08:49 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-e4e478cb-aa39-4385-b5e6-eb3dd24982ae tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d139022-ea1a-4924-9ffc-cd1c0d22a6aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:08:49 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-e4e478cb-aa39-4385-b5e6-eb3dd24982ae tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a41213fd-9bee-4d91-b512-51c4d0155e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:08:49 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-e4e478cb-aa39-4385-b5e6-eb3dd24982ae tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a41213fd-9bee-4d91-b512-51c4d0155e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1cae148-2b4b-4dcf-85de-77f06f54878a', 'volume_name': 'volume-e1cae148-2b4b-4dcf-85de-77f06f54878a', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:08:49 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-e4e478cb-aa39-4385-b5e6-eb3dd24982ae tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (929054bb-6a04-4ee4-905e-a3491a37772d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:08:49 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-e4e478cb-aa39-4385-b5e6-eb3dd24982ae tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (929054bb-6a04-4ee4-905e-a3491a37772d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:08:49 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-e4e478cb-aa39-4385-b5e6-eb3dd24982ae tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (874b1af6-16ef-4e6e-95d3-0fac3206b05f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:08:49 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-e4e478cb-aa39-4385-b5e6-eb3dd24982ae tempest-VolumesGetTest-197214973 None] Volume e1cae148-2b4b-4dcf-85de-77f06f54878a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1cae148-2b4b-4dcf-85de-77f06f54878a', 'volume_size': 1} Jul 10 10:08:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-e4e478cb-aa39-4385-b5e6-eb3dd24982ae tempest-VolumesGetTest-197214973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:08:49 devstack sudo[93918]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-55ab1077-9f9d-4e6d-a01d-d43c5747b028 tempest-SnapshotsActionsTest-852873252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.info" returned: 0 in 0.805s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:49 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-55ab1077-9f9d-4e6d-a01d-d43c5747b028 tempest-SnapshotsActionsTest-852873252 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.info is being set with open permissions: ugo+rw Jul 10 10:08:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-55ab1077-9f9d-4e6d-a01d-d43c5747b028 tempest-SnapshotsActionsTest-852873252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:49 devstack sudo[93925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.info Jul 10 10:08:49 devstack sudo[93925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:50 devstack sudo[93925]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-55ab1077-9f9d-4e6d-a01d-d43c5747b028 tempest-SnapshotsActionsTest-852873252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.info" returned: 0 in 0.753s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-55ab1077-9f9d-4e6d-a01d-d43c5747b028 tempest-SnapshotsActionsTest-852873252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.438s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:08:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-e4e478cb-aa39-4385-b5e6-eb3dd24982ae tempest-VolumesGetTest-197214973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.826s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:08:50 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-e4e478cb-aa39-4385-b5e6-eb3dd24982ae tempest-VolumesGetTest-197214973 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:08:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1386614466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1cae148-2b4b-4dcf-85de-77f06f54878a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b6e1b243e2ee4fa3bf1c3dda0bf8b5da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:08:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:08:50Z,use_quota=True,user_id='683315fe0f3a4835aed6459f8e52b1dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:08:50 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-e4e478cb-aa39-4385-b5e6-eb3dd24982ae tempest-VolumesGetTest-197214973 None] Creating volume e1cae148-2b4b-4dcf-85de-77f06f54878a {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:08:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-e4e478cb-aa39-4385-b5e6-eb3dd24982ae tempest-VolumesGetTest-197214973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:08:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-e4e478cb-aa39-4385-b5e6-eb3dd24982ae tempest-VolumesGetTest-197214973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:08:50 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-e4e478cb-aa39-4385-b5e6-eb3dd24982ae tempest-VolumesGetTest-197214973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:08:50 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-e4e478cb-aa39-4385-b5e6-eb3dd24982ae tempest-VolumesGetTest-197214973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:08:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-e4e478cb-aa39-4385-b5e6-eb3dd24982ae tempest-VolumesGetTest-197214973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:08:50 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-e4e478cb-aa39-4385-b5e6-eb3dd24982ae tempest-VolumesGetTest-197214973 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:08:50 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-e4e478cb-aa39-4385-b5e6-eb3dd24982ae tempest-VolumesGetTest-197214973 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:08:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e4e478cb-aa39-4385-b5e6-eb3dd24982ae tempest-VolumesGetTest-197214973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e1cae148-2b4b-4dcf-85de-77f06f54878a 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:50 devstack sudo[93929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e1cae148-2b4b-4dcf-85de-77f06f54878a 1073741824 Jul 10 10:08:50 devstack sudo[93929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:50 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-55ab1077-9f9d-4e6d-a01d-d43c5747b028 tempest-SnapshotsActionsTest-852873252 None] Create snapshot completed successfully Jul 10 10:08:50 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-86eb36d3-1208-4771-a63a-298a3224bace tempest-VolumesListTestJSON-751308652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:08:50 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-86eb36d3-1208-4771-a63a-298a3224bace tempest-VolumesListTestJSON-751308652 None] Flow 'volume_create_manager' (b36c7623-7b64-4533-941c-60f8b3215db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:08:50 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-86eb36d3-1208-4771-a63a-298a3224bace tempest-VolumesListTestJSON-751308652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2bfd054-2ea9-4500-8fcc-2f5598f39083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:08:50 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-86eb36d3-1208-4771-a63a-298a3224bace tempest-VolumesListTestJSON-751308652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2bfd054-2ea9-4500-8fcc-2f5598f39083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:08:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1997879303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05db0b1a-bab7-4167-b89f-3f97d168a8a2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='152561e8f19b45b0b710c3de736e506e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:08:51Z,use_quota=True,user_id='f9d871eeacdd466e8e7d332ed18f47cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:08:50 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-86eb36d3-1208-4771-a63a-298a3224bace tempest-VolumesListTestJSON-751308652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b33e7dad-b2ec-42ec-9ac7-9e8e6aa58dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:08:50 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-86eb36d3-1208-4771-a63a-298a3224bace tempest-VolumesListTestJSON-751308652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b33e7dad-b2ec-42ec-9ac7-9e8e6aa58dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:08:50 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-86eb36d3-1208-4771-a63a-298a3224bace tempest-VolumesListTestJSON-751308652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ab67855-7555-4d89-8770-1553869e0ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:08:50 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-86eb36d3-1208-4771-a63a-298a3224bace tempest-VolumesListTestJSON-751308652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ab67855-7555-4d89-8770-1553869e0ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05db0b1a-bab7-4167-b89f-3f97d168a8a2', 'volume_name': 'volume-05db0b1a-bab7-4167-b89f-3f97d168a8a2', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:08:50 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-86eb36d3-1208-4771-a63a-298a3224bace tempest-VolumesListTestJSON-751308652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9db4f2b-e52e-4a6d-913f-5b4d499639a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:08:50 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-86eb36d3-1208-4771-a63a-298a3224bace tempest-VolumesListTestJSON-751308652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9db4f2b-e52e-4a6d-913f-5b4d499639a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:08:50 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-86eb36d3-1208-4771-a63a-298a3224bace tempest-VolumesListTestJSON-751308652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93f700fe-72b0-483a-81e7-3847c3e5c7ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:08:50 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-86eb36d3-1208-4771-a63a-298a3224bace tempest-VolumesListTestJSON-751308652 None] Volume 05db0b1a-bab7-4167-b89f-3f97d168a8a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05db0b1a-bab7-4167-b89f-3f97d168a8a2', 'volume_size': 1} Jul 10 10:08:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-86eb36d3-1208-4771-a63a-298a3224bace tempest-VolumesListTestJSON-751308652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:08:51 devstack sudo[93929]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e4e478cb-aa39-4385-b5e6-eb3dd24982ae tempest-VolumesGetTest-197214973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e1cae148-2b4b-4dcf-85de-77f06f54878a 1073741824" returned: 0 in 0.890s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e4e478cb-aa39-4385-b5e6-eb3dd24982ae tempest-VolumesGetTest-197214973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e1cae148-2b4b-4dcf-85de-77f06f54878a {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:51 devstack sudo[93936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e1cae148-2b4b-4dcf-85de-77f06f54878a Jul 10 10:08:51 devstack sudo[93936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-4f7c74ba-739d-4153-ba1b-8a0dc85224b7 tempest-SnapshotsActionsTest-852873252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:08:52 devstack sudo[93936]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e4e478cb-aa39-4385-b5e6-eb3dd24982ae tempest-VolumesGetTest-197214973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e1cae148-2b4b-4dcf-85de-77f06f54878a" returned: 0 in 0.729s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:52 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-e4e478cb-aa39-4385-b5e6-eb3dd24982ae tempest-VolumesGetTest-197214973 None] <== create_volume: return (1668ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:08:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-e4e478cb-aa39-4385-b5e6-eb3dd24982ae tempest-VolumesGetTest-197214973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.671s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:08:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-86eb36d3-1208-4771-a63a-298a3224bace tempest-VolumesListTestJSON-751308652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.450s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:08:52 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-86eb36d3-1208-4771-a63a-298a3224bace tempest-VolumesListTestJSON-751308652 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:08:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1997879303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05db0b1a-bab7-4167-b89f-3f97d168a8a2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='152561e8f19b45b0b710c3de736e506e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:08:51Z,use_quota=True,user_id='f9d871eeacdd466e8e7d332ed18f47cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:08:52 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-86eb36d3-1208-4771-a63a-298a3224bace tempest-VolumesListTestJSON-751308652 None] Creating volume 05db0b1a-bab7-4167-b89f-3f97d168a8a2 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:08:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-86eb36d3-1208-4771-a63a-298a3224bace tempest-VolumesListTestJSON-751308652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:08:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-86eb36d3-1208-4771-a63a-298a3224bace tempest-VolumesListTestJSON-751308652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:08:52 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-86eb36d3-1208-4771-a63a-298a3224bace tempest-VolumesListTestJSON-751308652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:08:52 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-86eb36d3-1208-4771-a63a-298a3224bace tempest-VolumesListTestJSON-751308652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:08:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-86eb36d3-1208-4771-a63a-298a3224bace tempest-VolumesListTestJSON-751308652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:08:52 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-86eb36d3-1208-4771-a63a-298a3224bace tempest-VolumesListTestJSON-751308652 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:08:52 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-86eb36d3-1208-4771-a63a-298a3224bace tempest-VolumesListTestJSON-751308652 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:08:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-86eb36d3-1208-4771-a63a-298a3224bace tempest-VolumesListTestJSON-751308652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-05db0b1a-bab7-4167-b89f-3f97d168a8a2 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:52 devstack sudo[93947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-05db0b1a-bab7-4167-b89f-3f97d168a8a2 1073741824 Jul 10 10:08:52 devstack sudo[93947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:52 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-e4e478cb-aa39-4385-b5e6-eb3dd24982ae tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (874b1af6-16ef-4e6e-95d3-0fac3206b05f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1cae148-2b4b-4dcf-85de-77f06f54878a', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:08:52 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-e4e478cb-aa39-4385-b5e6-eb3dd24982ae tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4851c71-5eb8-4f7a-9dfa-814b44078b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:08:52 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-e4e478cb-aa39-4385-b5e6-eb3dd24982ae tempest-VolumesGetTest-197214973 None] Volume volume-e1cae148-2b4b-4dcf-85de-77f06f54878a (e1cae148-2b4b-4dcf-85de-77f06f54878a): created successfully Jul 10 10:08:52 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-e4e478cb-aa39-4385-b5e6-eb3dd24982ae tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4851c71-5eb8-4f7a-9dfa-814b44078b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:08:52 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-e4e478cb-aa39-4385-b5e6-eb3dd24982ae tempest-VolumesGetTest-197214973 None] Flow 'volume_create_manager' (2f986977-7725-4a79-947c-f41d828cea44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:08:52 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-e4e478cb-aa39-4385-b5e6-eb3dd24982ae tempest-VolumesGetTest-197214973 None] Created volume successfully. Jul 10 10:08:53 devstack sudo[93947]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-86eb36d3-1208-4771-a63a-298a3224bace tempest-VolumesListTestJSON-751308652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-05db0b1a-bab7-4167-b89f-3f97d168a8a2 1073741824" returned: 0 in 0.882s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-86eb36d3-1208-4771-a63a-298a3224bace tempest-VolumesListTestJSON-751308652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-05db0b1a-bab7-4167-b89f-3f97d168a8a2 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:53 devstack sudo[93957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-05db0b1a-bab7-4167-b89f-3f97d168a8a2 Jul 10 10:08:53 devstack sudo[93957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:53 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f49c8b5-9d21-4f31-80ce-6a5483bf5eae tempest-VolumesGetTest-197214973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:08:53 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9f49c8b5-9d21-4f31-80ce-6a5483bf5eae tempest-VolumesGetTest-197214973 None] Flow 'volume_create_manager' (5ce3b9f4-9854-4022-a67d-320b3d08bb7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:08:53 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9f49c8b5-9d21-4f31-80ce-6a5483bf5eae tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baa14c76-7a86-47f6-af58-24239d62b812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:08:53 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9f49c8b5-9d21-4f31-80ce-6a5483bf5eae tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baa14c76-7a86-47f6-af58-24239d62b812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:08:53Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1392813811',display_name='tempest-VolumesGetTest-Volume-734189471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e223a6a3-0df5-46e5-8a06-cb778bcbe137,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6e1b243e2ee4fa3bf1c3dda0bf8b5da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:08:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:08:53Z,use_quota=True,user_id='683315fe0f3a4835aed6459f8e52b1dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:08:53 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9f49c8b5-9d21-4f31-80ce-6a5483bf5eae tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef1081c5-57ef-4239-a6b8-866dfa214b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:08:53 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9f49c8b5-9d21-4f31-80ce-6a5483bf5eae tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef1081c5-57ef-4239-a6b8-866dfa214b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:08:53 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9f49c8b5-9d21-4f31-80ce-6a5483bf5eae tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (870dc7c6-2d0b-48c6-a41b-91ac840a0e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:08:53 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9f49c8b5-9d21-4f31-80ce-6a5483bf5eae tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (870dc7c6-2d0b-48c6-a41b-91ac840a0e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e223a6a3-0df5-46e5-8a06-cb778bcbe137', 'volume_name': 'volume-e223a6a3-0df5-46e5-8a06-cb778bcbe137', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:08:53 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9f49c8b5-9d21-4f31-80ce-6a5483bf5eae tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c33d83b-2b79-4b2f-b6ce-712d6d3c32ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:08:53 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9f49c8b5-9d21-4f31-80ce-6a5483bf5eae tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c33d83b-2b79-4b2f-b6ce-712d6d3c32ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:08:53 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9f49c8b5-9d21-4f31-80ce-6a5483bf5eae tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83c213fb-4b4d-4d9c-8317-96250f737da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:08:53 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-9f49c8b5-9d21-4f31-80ce-6a5483bf5eae tempest-VolumesGetTest-197214973 None] Volume e223a6a3-0df5-46e5-8a06-cb778bcbe137: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e223a6a3-0df5-46e5-8a06-cb778bcbe137', 'volume_size': 1} Jul 10 10:08:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-9f49c8b5-9d21-4f31-80ce-6a5483bf5eae tempest-VolumesGetTest-197214973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:08:53 devstack sudo[93957]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-86eb36d3-1208-4771-a63a-298a3224bace tempest-VolumesListTestJSON-751308652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-05db0b1a-bab7-4167-b89f-3f97d168a8a2" returned: 0 in 0.697s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:53 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-86eb36d3-1208-4771-a63a-298a3224bace tempest-VolumesListTestJSON-751308652 None] <== create_volume: return (1624ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:08:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-86eb36d3-1208-4771-a63a-298a3224bace tempest-VolumesListTestJSON-751308652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.627s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:08:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-4f7c74ba-739d-4153-ba1b-8a0dc85224b7 tempest-SnapshotsActionsTest-852873252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.794s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:08:53 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-86eb36d3-1208-4771-a63a-298a3224bace tempest-VolumesListTestJSON-751308652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93f700fe-72b0-483a-81e7-3847c3e5c7ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05db0b1a-bab7-4167-b89f-3f97d168a8a2', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:08:53 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-86eb36d3-1208-4771-a63a-298a3224bace tempest-VolumesListTestJSON-751308652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68630e58-da05-45f1-8870-0d0e91110a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:08:53 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-4f7c74ba-739d-4153-ba1b-8a0dc85224b7 tempest-SnapshotsActionsTest-852873252 None] Creating offline snapshot 822e9fd9-1581-4067-8ca1-6052e1442f25 of volume c136b0f5-b6de-4617-8094-382c31e31841 {{(pid=87234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 10:08:53 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-86eb36d3-1208-4771-a63a-298a3224bace tempest-VolumesListTestJSON-751308652 None] Volume volume-05db0b1a-bab7-4167-b89f-3f97d168a8a2 (05db0b1a-bab7-4167-b89f-3f97d168a8a2): created successfully Jul 10 10:08:53 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-86eb36d3-1208-4771-a63a-298a3224bace tempest-VolumesListTestJSON-751308652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68630e58-da05-45f1-8870-0d0e91110a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:08:53 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-86eb36d3-1208-4771-a63a-298a3224bace tempest-VolumesListTestJSON-751308652 None] Flow 'volume_create_manager' (b36c7623-7b64-4533-941c-60f8b3215db2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:08:53 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8fc7d48-e1a9-4abe-b079-5b0170013253]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:08:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4f7c74ba-739d-4153-ba1b-8a0dc85224b7 tempest-SnapshotsActionsTest-852873252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.b47c4fb0-9be6-4004-ac87-3d46de908169 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:53 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-86eb36d3-1208-4771-a63a-298a3224bace tempest-VolumesListTestJSON-751308652 None] Created volume successfully. Jul 10 10:08:54 devstack sudo[93961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.b47c4fb0-9be6-4004-ac87-3d46de908169 Jul 10 10:08:54 devstack sudo[93961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:54 devstack sudo[93961]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:54 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4f7c74ba-739d-4153-ba1b-8a0dc85224b7 tempest-SnapshotsActionsTest-852873252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.b47c4fb0-9be6-4004-ac87-3d46de908169" returned: 0 in 0.772s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:54 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-4f7c74ba-739d-4153-ba1b-8a0dc85224b7 tempest-SnapshotsActionsTest-852873252 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c136b0f5-b6de-4617-8094-382c31e31841(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 10:08:54 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4f7c74ba-739d-4153-ba1b-8a0dc85224b7 tempest-SnapshotsActionsTest-852873252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.b47c4fb0-9be6-4004-ac87-3d46de908169,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.822e9fd9-1581-4067-8ca1-6052e1442f25 1G {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:54 devstack sudo[93966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.b47c4fb0-9be6-4004-ac87-3d46de908169,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.822e9fd9-1581-4067-8ca1-6052e1442f25 1G Jul 10 10:08:54 devstack sudo[93966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:55 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0b7af38-a3f5-431a-be91-8fef0a3dfc0c tempest-VolumesListTestJSON-751308652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:08:55 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-d0b7af38-a3f5-431a-be91-8fef0a3dfc0c tempest-VolumesListTestJSON-751308652 None] Flow 'volume_create_manager' (7628186b-3908-4c30-aa17-61cba24e718c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:08:55 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-d0b7af38-a3f5-431a-be91-8fef0a3dfc0c tempest-VolumesListTestJSON-751308652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3973ebdc-2462-4f02-8675-fcb948161e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:08:55 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-d0b7af38-a3f5-431a-be91-8fef0a3dfc0c tempest-VolumesListTestJSON-751308652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3973ebdc-2462-4f02-8675-fcb948161e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:08:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2104197877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d54bf5b-84a9-45e8-b819-ab3f7dfaf76f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='152561e8f19b45b0b710c3de736e506e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:08:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:08:55Z,use_quota=True,user_id='f9d871eeacdd466e8e7d332ed18f47cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:08:55 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-d0b7af38-a3f5-431a-be91-8fef0a3dfc0c tempest-VolumesListTestJSON-751308652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2777f2d7-85e9-4b30-8547-ff8082997cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:08:55 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-d0b7af38-a3f5-431a-be91-8fef0a3dfc0c tempest-VolumesListTestJSON-751308652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2777f2d7-85e9-4b30-8547-ff8082997cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:08:55 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-d0b7af38-a3f5-431a-be91-8fef0a3dfc0c tempest-VolumesListTestJSON-751308652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (244feffd-fcac-4fef-8a29-e1f81ab87ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:08:55 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-d0b7af38-a3f5-431a-be91-8fef0a3dfc0c tempest-VolumesListTestJSON-751308652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (244feffd-fcac-4fef-8a29-e1f81ab87ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d54bf5b-84a9-45e8-b819-ab3f7dfaf76f', 'volume_name': 'volume-3d54bf5b-84a9-45e8-b819-ab3f7dfaf76f', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:08:55 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-d0b7af38-a3f5-431a-be91-8fef0a3dfc0c tempest-VolumesListTestJSON-751308652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ebe3316-5488-44e4-a413-5322d4e13b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:08:55 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-d0b7af38-a3f5-431a-be91-8fef0a3dfc0c tempest-VolumesListTestJSON-751308652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ebe3316-5488-44e4-a413-5322d4e13b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:08:55 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-d0b7af38-a3f5-431a-be91-8fef0a3dfc0c tempest-VolumesListTestJSON-751308652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e9817cc-a93a-4de7-929f-ff6ecf647466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:08:55 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-d0b7af38-a3f5-431a-be91-8fef0a3dfc0c tempest-VolumesListTestJSON-751308652 None] Volume 3d54bf5b-84a9-45e8-b819-ab3f7dfaf76f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d54bf5b-84a9-45e8-b819-ab3f7dfaf76f', 'volume_size': 1} Jul 10 10:08:55 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-d0b7af38-a3f5-431a-be91-8fef0a3dfc0c tempest-VolumesListTestJSON-751308652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:08:55 devstack sudo[93966]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:55 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4f7c74ba-739d-4153-ba1b-8a0dc85224b7 tempest-SnapshotsActionsTest-852873252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.b47c4fb0-9be6-4004-ac87-3d46de908169,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.822e9fd9-1581-4067-8ca1-6052e1442f25 1G" returned: 0 in 0.892s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:55 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4f7c74ba-739d-4153-ba1b-8a0dc85224b7 tempest-SnapshotsActionsTest-852873252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c136b0f5-b6de-4617-8094-382c31e31841.b47c4fb0-9be6-4004-ac87-3d46de908169 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.822e9fd9-1581-4067-8ca1-6052e1442f25 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:55 devstack sudo[93972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c136b0f5-b6de-4617-8094-382c31e31841.b47c4fb0-9be6-4004-ac87-3d46de908169 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.822e9fd9-1581-4067-8ca1-6052e1442f25 Jul 10 10:08:55 devstack sudo[93972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:56 devstack sudo[93972]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4f7c74ba-739d-4153-ba1b-8a0dc85224b7 tempest-SnapshotsActionsTest-852873252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c136b0f5-b6de-4617-8094-382c31e31841.b47c4fb0-9be6-4004-ac87-3d46de908169 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.822e9fd9-1581-4067-8ca1-6052e1442f25" returned: 0 in 0.706s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:56 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-4f7c74ba-739d-4153-ba1b-8a0dc85224b7 tempest-SnapshotsActionsTest-852873252 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.822e9fd9-1581-4067-8ca1-6052e1442f25 is being set with open permissions: ugo+rw Jul 10 10:08:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4f7c74ba-739d-4153-ba1b-8a0dc85224b7 tempest-SnapshotsActionsTest-852873252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.822e9fd9-1581-4067-8ca1-6052e1442f25 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:56 devstack sudo[93977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.822e9fd9-1581-4067-8ca1-6052e1442f25 Jul 10 10:08:56 devstack sudo[93977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:56 devstack sudo[93977]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4f7c74ba-739d-4153-ba1b-8a0dc85224b7 tempest-SnapshotsActionsTest-852873252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.822e9fd9-1581-4067-8ca1-6052e1442f25" returned: 0 in 0.641s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-4f7c74ba-739d-4153-ba1b-8a0dc85224b7 tempest-SnapshotsActionsTest-852873252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.144s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:08:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-9f49c8b5-9d21-4f31-80ce-6a5483bf5eae tempest-VolumesGetTest-197214973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.541s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:08:56 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-9f49c8b5-9d21-4f31-80ce-6a5483bf5eae tempest-VolumesGetTest-197214973 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:08:53Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1392813811',display_name='tempest-VolumesGetTest-Volume-734189471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e223a6a3-0df5-46e5-8a06-cb778bcbe137,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6e1b243e2ee4fa3bf1c3dda0bf8b5da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:08:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:08:53Z,use_quota=True,user_id='683315fe0f3a4835aed6459f8e52b1dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:08:56 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-9f49c8b5-9d21-4f31-80ce-6a5483bf5eae tempest-VolumesGetTest-197214973 None] Creating volume e223a6a3-0df5-46e5-8a06-cb778bcbe137 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:08:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-9f49c8b5-9d21-4f31-80ce-6a5483bf5eae tempest-VolumesGetTest-197214973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:08:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-9f49c8b5-9d21-4f31-80ce-6a5483bf5eae tempest-VolumesGetTest-197214973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:08:56 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-9f49c8b5-9d21-4f31-80ce-6a5483bf5eae tempest-VolumesGetTest-197214973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:08:56 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-9f49c8b5-9d21-4f31-80ce-6a5483bf5eae tempest-VolumesGetTest-197214973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:08:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-9f49c8b5-9d21-4f31-80ce-6a5483bf5eae tempest-VolumesGetTest-197214973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:08:56 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-9f49c8b5-9d21-4f31-80ce-6a5483bf5eae tempest-VolumesGetTest-197214973 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:08:56 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-9f49c8b5-9d21-4f31-80ce-6a5483bf5eae tempest-VolumesGetTest-197214973 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:08:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9f49c8b5-9d21-4f31-80ce-6a5483bf5eae tempest-VolumesGetTest-197214973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e223a6a3-0df5-46e5-8a06-cb778bcbe137 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:57 devstack sudo[93981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e223a6a3-0df5-46e5-8a06-cb778bcbe137 1073741824 Jul 10 10:08:57 devstack sudo[93981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:57 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-4f7c74ba-739d-4153-ba1b-8a0dc85224b7 tempest-SnapshotsActionsTest-852873252 None] Create snapshot completed successfully Jul 10 10:08:57 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-57b7a187-875f-4eab-ab0a-130639b07e58 tempest-SnapshotsActionsTest-453962261 None] Acquiring lock "cinder-822e9fd9-1581-4067-8ca1-6052e1442f25-delete_snapshot" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:08:57 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-57b7a187-875f-4eab-ab0a-130639b07e58 tempest-SnapshotsActionsTest-453962261 None] Lock "cinder-822e9fd9-1581-4067-8ca1-6052e1442f25-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:08:57 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-57b7a187-875f-4eab-ab0a-130639b07e58 tempest-SnapshotsActionsTest-453962261 None] Acquiring lock "cinder-quobyte-c136b0f5-b6de-4617-8094-382c31e31841" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:08:57 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-57b7a187-875f-4eab-ab0a-130639b07e58 tempest-SnapshotsActionsTest-453962261 None] Lock "cinder-quobyte-c136b0f5-b6de-4617-8094-382c31e31841" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:08:57 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-57b7a187-875f-4eab-ab0a-130639b07e58 tempest-SnapshotsActionsTest-453962261 None] Acquiring lock "cinder-quobyte-822e9fd9-1581-4067-8ca1-6052e1442f25" by "_delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:08:57 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-57b7a187-875f-4eab-ab0a-130639b07e58 tempest-SnapshotsActionsTest-453962261 None] Lock "cinder-quobyte-822e9fd9-1581-4067-8ca1-6052e1442f25" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:08:57 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-57b7a187-875f-4eab-ab0a-130639b07e58 tempest-SnapshotsActionsTest-453962261 None] Deleting offline snapshot 822e9fd9-1581-4067-8ca1-6052e1442f25 of volume c136b0f5-b6de-4617-8094-382c31e31841 {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 10:08:57 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-57b7a187-875f-4eab-ab0a-130639b07e58 tempest-SnapshotsActionsTest-453962261 None] snapshot_file for this snap is: volume-c136b0f5-b6de-4617-8094-382c31e31841.822e9fd9-1581-4067-8ca1-6052e1442f25 {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 10:08:57 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e80c15a-8af4-41cb-890c-fde74936ea04]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:08:57 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-57b7a187-875f-4eab-ab0a-130639b07e58 tempest-SnapshotsActionsTest-453962261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.822e9fd9-1581-4067-8ca1-6052e1442f25 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:57 devstack sudo[93984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.822e9fd9-1581-4067-8ca1-6052e1442f25 Jul 10 10:08:57 devstack sudo[93984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:57 devstack sudo[93981]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:57 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9f49c8b5-9d21-4f31-80ce-6a5483bf5eae tempest-VolumesGetTest-197214973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e223a6a3-0df5-46e5-8a06-cb778bcbe137 1073741824" returned: 0 in 0.885s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:57 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9f49c8b5-9d21-4f31-80ce-6a5483bf5eae tempest-VolumesGetTest-197214973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e223a6a3-0df5-46e5-8a06-cb778bcbe137 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:57 devstack sudo[93990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e223a6a3-0df5-46e5-8a06-cb778bcbe137 Jul 10 10:08:57 devstack sudo[93990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:58 devstack sudo[93984]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-57b7a187-875f-4eab-ab0a-130639b07e58 tempest-SnapshotsActionsTest-453962261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.822e9fd9-1581-4067-8ca1-6052e1442f25" returned: 0 in 0.771s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:58 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-57b7a187-875f-4eab-ab0a-130639b07e58 tempest-SnapshotsActionsTest-453962261 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c136b0f5-b6de-4617-8094-382c31e31841(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 10:08:58 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[7660070d-9d61-411d-a4f5-118f67bbf734]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:08:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-57b7a187-875f-4eab-ab0a-130639b07e58 tempest-SnapshotsActionsTest-453962261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.b47c4fb0-9be6-4004-ac87-3d46de908169 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:58 devstack sudo[93995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.b47c4fb0-9be6-4004-ac87-3d46de908169 Jul 10 10:08:58 devstack sudo[93995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:58 devstack sudo[93990]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9f49c8b5-9d21-4f31-80ce-6a5483bf5eae tempest-VolumesGetTest-197214973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e223a6a3-0df5-46e5-8a06-cb778bcbe137" returned: 0 in 0.799s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:58 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-9f49c8b5-9d21-4f31-80ce-6a5483bf5eae tempest-VolumesGetTest-197214973 None] <== create_volume: return (1727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:08:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-9f49c8b5-9d21-4f31-80ce-6a5483bf5eae tempest-VolumesGetTest-197214973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.730s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:08:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-d0b7af38-a3f5-431a-be91-8fef0a3dfc0c tempest-VolumesListTestJSON-751308652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.267s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:08:58 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-d0b7af38-a3f5-431a-be91-8fef0a3dfc0c tempest-VolumesListTestJSON-751308652 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:08:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2104197877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d54bf5b-84a9-45e8-b819-ab3f7dfaf76f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='152561e8f19b45b0b710c3de736e506e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:08:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:08:55Z,use_quota=True,user_id='f9d871eeacdd466e8e7d332ed18f47cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:08:58 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-d0b7af38-a3f5-431a-be91-8fef0a3dfc0c tempest-VolumesListTestJSON-751308652 None] Creating volume 3d54bf5b-84a9-45e8-b819-ab3f7dfaf76f {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:08:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-d0b7af38-a3f5-431a-be91-8fef0a3dfc0c tempest-VolumesListTestJSON-751308652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:08:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-d0b7af38-a3f5-431a-be91-8fef0a3dfc0c tempest-VolumesListTestJSON-751308652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:08:58 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-d0b7af38-a3f5-431a-be91-8fef0a3dfc0c tempest-VolumesListTestJSON-751308652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:08:58 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-d0b7af38-a3f5-431a-be91-8fef0a3dfc0c tempest-VolumesListTestJSON-751308652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:08:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-d0b7af38-a3f5-431a-be91-8fef0a3dfc0c tempest-VolumesListTestJSON-751308652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:08:58 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-d0b7af38-a3f5-431a-be91-8fef0a3dfc0c tempest-VolumesListTestJSON-751308652 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:08:58 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-d0b7af38-a3f5-431a-be91-8fef0a3dfc0c tempest-VolumesListTestJSON-751308652 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:08:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-d0b7af38-a3f5-431a-be91-8fef0a3dfc0c tempest-VolumesListTestJSON-751308652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3d54bf5b-84a9-45e8-b819-ab3f7dfaf76f 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:58 devstack sudo[94010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3d54bf5b-84a9-45e8-b819-ab3f7dfaf76f 1073741824 Jul 10 10:08:58 devstack sudo[94010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:58 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9f49c8b5-9d21-4f31-80ce-6a5483bf5eae tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83c213fb-4b4d-4d9c-8317-96250f737da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e223a6a3-0df5-46e5-8a06-cb778bcbe137', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:08:58 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9f49c8b5-9d21-4f31-80ce-6a5483bf5eae tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f7229b7-805b-4e47-af0d-16e46034ff02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:08:58 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-9f49c8b5-9d21-4f31-80ce-6a5483bf5eae tempest-VolumesGetTest-197214973 None] Volume volume-e223a6a3-0df5-46e5-8a06-cb778bcbe137 (e223a6a3-0df5-46e5-8a06-cb778bcbe137): created successfully Jul 10 10:08:58 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9f49c8b5-9d21-4f31-80ce-6a5483bf5eae tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f7229b7-805b-4e47-af0d-16e46034ff02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:08:58 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9f49c8b5-9d21-4f31-80ce-6a5483bf5eae tempest-VolumesGetTest-197214973 None] Flow 'volume_create_manager' (5ce3b9f4-9854-4022-a67d-320b3d08bb7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:08:58 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-9f49c8b5-9d21-4f31-80ce-6a5483bf5eae tempest-VolumesGetTest-197214973 None] Created volume successfully. Jul 10 10:08:59 devstack sudo[93995]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:59 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-57b7a187-875f-4eab-ab0a-130639b07e58 tempest-SnapshotsActionsTest-453962261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.b47c4fb0-9be6-4004-ac87-3d46de908169" returned: 0 in 0.989s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:59 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-57b7a187-875f-4eab-ab0a-130639b07e58 tempest-SnapshotsActionsTest-453962261 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c136b0f5-b6de-4617-8094-382c31e31841(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 10:08:59 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-57b7a187-875f-4eab-ab0a-130639b07e58 tempest-SnapshotsActionsTest-453962261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.822e9fd9-1581-4067-8ca1-6052e1442f25 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:59 devstack sudo[94020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.822e9fd9-1581-4067-8ca1-6052e1442f25 Jul 10 10:08:59 devstack sudo[94020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:59 devstack sudo[94010]: pam_unix(sudo:session): session closed for user root Jul 10 10:08:59 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-d0b7af38-a3f5-431a-be91-8fef0a3dfc0c tempest-VolumesListTestJSON-751308652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3d54bf5b-84a9-45e8-b819-ab3f7dfaf76f 1073741824" returned: 0 in 0.956s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:08:59 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-d0b7af38-a3f5-431a-be91-8fef0a3dfc0c tempest-VolumesListTestJSON-751308652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3d54bf5b-84a9-45e8-b819-ab3f7dfaf76f {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:08:59 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-d7dba8cc-b258-4f5a-b715-ac32fe5f2796 tempest-VolumesGetTest-197214973 None] Acquiring lock "cinder-e223a6a3-0df5-46e5-8a06-cb778bcbe137-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:08:59 devstack sudo[94027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3d54bf5b-84a9-45e8-b819-ab3f7dfaf76f Jul 10 10:08:59 devstack sudo[94027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:08:59 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-d7dba8cc-b258-4f5a-b715-ac32fe5f2796 tempest-VolumesGetTest-197214973 None] Lock "cinder-e223a6a3-0df5-46e5-8a06-cb778bcbe137-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:08:59 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-d7dba8cc-b258-4f5a-b715-ac32fe5f2796 tempest-VolumesGetTest-197214973 None] Acquiring lock "cinder-quobyte-e223a6a3-0df5-46e5-8a06-cb778bcbe137" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:08:59 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-d7dba8cc-b258-4f5a-b715-ac32fe5f2796 tempest-VolumesGetTest-197214973 None] Lock "cinder-quobyte-e223a6a3-0df5-46e5-8a06-cb778bcbe137" acquired by "delete_volume" :: waited 0.020s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:08:59 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[12dbcac0-bf42-4dbb-9ecd-f9325a159c8b]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:08:59 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-d7dba8cc-b258-4f5a-b715-ac32fe5f2796 tempest-VolumesGetTest-197214973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e223a6a3-0df5-46e5-8a06-cb778bcbe137 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:00 devstack sudo[94037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e223a6a3-0df5-46e5-8a06-cb778bcbe137 Jul 10 10:09:00 devstack sudo[94037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:00 devstack sudo[94020]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:00 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-57b7a187-875f-4eab-ab0a-130639b07e58 tempest-SnapshotsActionsTest-453962261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.822e9fd9-1581-4067-8ca1-6052e1442f25" returned: 0 in 0.910s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:00 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-57b7a187-875f-4eab-ab0a-130639b07e58 tempest-SnapshotsActionsTest-453962261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.822e9fd9-1581-4067-8ca1-6052e1442f25 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:00 devstack sudo[94042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.822e9fd9-1581-4067-8ca1-6052e1442f25 Jul 10 10:09:00 devstack sudo[94042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:00 devstack sudo[94027]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:00 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-d0b7af38-a3f5-431a-be91-8fef0a3dfc0c tempest-VolumesListTestJSON-751308652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3d54bf5b-84a9-45e8-b819-ab3f7dfaf76f" returned: 0 in 0.752s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:00 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-d0b7af38-a3f5-431a-be91-8fef0a3dfc0c tempest-VolumesListTestJSON-751308652 None] <== create_volume: return (1770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:09:00 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-d0b7af38-a3f5-431a-be91-8fef0a3dfc0c tempest-VolumesListTestJSON-751308652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.773s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:09:00 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-d0b7af38-a3f5-431a-be91-8fef0a3dfc0c tempest-VolumesListTestJSON-751308652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e9817cc-a93a-4de7-929f-ff6ecf647466) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d54bf5b-84a9-45e8-b819-ab3f7dfaf76f', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:09:00 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-d0b7af38-a3f5-431a-be91-8fef0a3dfc0c tempest-VolumesListTestJSON-751308652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87263e98-a859-4a71-b5de-6aae0676f4bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:09:00 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-d0b7af38-a3f5-431a-be91-8fef0a3dfc0c tempest-VolumesListTestJSON-751308652 None] Volume volume-3d54bf5b-84a9-45e8-b819-ab3f7dfaf76f (3d54bf5b-84a9-45e8-b819-ab3f7dfaf76f): created successfully Jul 10 10:09:00 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-d0b7af38-a3f5-431a-be91-8fef0a3dfc0c tempest-VolumesListTestJSON-751308652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87263e98-a859-4a71-b5de-6aae0676f4bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:09:00 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-d0b7af38-a3f5-431a-be91-8fef0a3dfc0c tempest-VolumesListTestJSON-751308652 None] Flow 'volume_create_manager' (7628186b-3908-4c30-aa17-61cba24e718c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:09:00 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-d0b7af38-a3f5-431a-be91-8fef0a3dfc0c tempest-VolumesListTestJSON-751308652 None] Created volume successfully. Jul 10 10:09:00 devstack sudo[94037]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:00 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-d7dba8cc-b258-4f5a-b715-ac32fe5f2796 tempest-VolumesGetTest-197214973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e223a6a3-0df5-46e5-8a06-cb778bcbe137" returned: 0 in 0.870s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:00 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-d7dba8cc-b258-4f5a-b715-ac32fe5f2796 tempest-VolumesGetTest-197214973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e223a6a3-0df5-46e5-8a06-cb778bcbe137 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:00 devstack sudo[94056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e223a6a3-0df5-46e5-8a06-cb778bcbe137 Jul 10 10:09:00 devstack sudo[94056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:00 devstack sudo[94042]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:00 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-57b7a187-875f-4eab-ab0a-130639b07e58 tempest-SnapshotsActionsTest-453962261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.822e9fd9-1581-4067-8ca1-6052e1442f25" returned: 0 in 0.700s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:00 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-57b7a187-875f-4eab-ab0a-130639b07e58 tempest-SnapshotsActionsTest-453962261 None] Lock "cinder-quobyte-822e9fd9-1581-4067-8ca1-6052e1442f25" released by "_delete_snapshot" :: held 3.515s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:09:00 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-57b7a187-875f-4eab-ab0a-130639b07e58 tempest-SnapshotsActionsTest-453962261 None] Lock "cinder-quobyte-c136b0f5-b6de-4617-8094-382c31e31841" released by "delete_snapshot" :: held 3.541s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:09:01 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-57b7a187-875f-4eab-ab0a-130639b07e58 tempest-SnapshotsActionsTest-453962261 None] Created reservations ['c28ceb22-3575-4cf8-96ac-937858121c82', '5732ad75-eb90-4f1e-af2d-d43b81e8ca12', 'cf7c27d6-997c-4b9c-a0c1-0a0cdc3a0ee7', '047d37c6-7c26-4673-9690-9e4e0d9ebe46'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:09:01 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-57b7a187-875f-4eab-ab0a-130639b07e58 tempest-SnapshotsActionsTest-453962261 None] Delete snapshot completed successfully. Jul 10 10:09:01 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-57b7a187-875f-4eab-ab0a-130639b07e58 tempest-SnapshotsActionsTest-453962261 None] Lock "cinder-822e9fd9-1581-4067-8ca1-6052e1442f25-delete_snapshot" released by "delete_snapshot" :: held 3.736s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:09:01 devstack sudo[94056]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:01 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-d7dba8cc-b258-4f5a-b715-ac32fe5f2796 tempest-VolumesGetTest-197214973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e223a6a3-0df5-46e5-8a06-cb778bcbe137" returned: 0 in 0.978s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:01 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-d7dba8cc-b258-4f5a-b715-ac32fe5f2796 tempest-VolumesGetTest-197214973 None] Lock "cinder-quobyte-e223a6a3-0df5-46e5-8a06-cb778bcbe137" released by "delete_volume" :: held 1.959s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:09:01 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-d7dba8cc-b258-4f5a-b715-ac32fe5f2796 tempest-VolumesGetTest-197214973 None] Created reservations ['82fcfe59-afc8-48ae-8178-98ccfeba25fb', '0ea7becc-c846-460e-9be2-2b1703f40636', 'e1e20f57-9177-404f-97e8-9e02ab77a8a8', 'db8e01a8-02ec-446f-a854-52e9fa2b437e'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:09:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-d7dba8cc-b258-4f5a-b715-ac32fe5f2796 tempest-VolumesGetTest-197214973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:09:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-d7dba8cc-b258-4f5a-b715-ac32fe5f2796 tempest-VolumesGetTest-197214973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:09:02 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-d7dba8cc-b258-4f5a-b715-ac32fe5f2796 tempest-VolumesGetTest-197214973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:09:02 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-d7dba8cc-b258-4f5a-b715-ac32fe5f2796 tempest-VolumesGetTest-197214973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:09:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-d7dba8cc-b258-4f5a-b715-ac32fe5f2796 tempest-VolumesGetTest-197214973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:09:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-d7dba8cc-b258-4f5a-b715-ac32fe5f2796 tempest-VolumesGetTest-197214973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:02 devstack sudo[94112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:09:02 devstack sudo[94112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-5b93dc51-04ce-4384-b714-5f49c2e3ce14 tempest-SnapshotsActionsTest-852873252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:09:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-5b93dc51-04ce-4384-b714-5f49c2e3ce14 tempest-SnapshotsActionsTest-852873252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:09:02 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-5b93dc51-04ce-4384-b714-5f49c2e3ce14 tempest-SnapshotsActionsTest-852873252 None] Creating offline snapshot e7bb3896-d5af-4f07-9a78-194faae0766f of volume c136b0f5-b6de-4617-8094-382c31e31841 {{(pid=87234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 10:09:02 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d79225f-bbd1-4070-85db-acbc7bc76afb]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:09:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5b93dc51-04ce-4384-b714-5f49c2e3ce14 tempest-SnapshotsActionsTest-852873252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.b47c4fb0-9be6-4004-ac87-3d46de908169 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:02 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-6ec7cf00-514a-4405-9819-d722bc19b59f tempest-VolumesGetTest-197214973 None] Acquiring lock "cinder-e1cae148-2b4b-4dcf-85de-77f06f54878a-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:09:02 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-6ec7cf00-514a-4405-9819-d722bc19b59f tempest-VolumesGetTest-197214973 None] Lock "cinder-e1cae148-2b4b-4dcf-85de-77f06f54878a-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:09:02 devstack sudo[94124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.b47c4fb0-9be6-4004-ac87-3d46de908169 Jul 10 10:09:02 devstack sudo[94124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:02 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-6ec7cf00-514a-4405-9819-d722bc19b59f tempest-VolumesGetTest-197214973 None] Acquiring lock "cinder-quobyte-e1cae148-2b4b-4dcf-85de-77f06f54878a" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:09:02 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-6ec7cf00-514a-4405-9819-d722bc19b59f tempest-VolumesGetTest-197214973 None] Lock "cinder-quobyte-e1cae148-2b4b-4dcf-85de-77f06f54878a" acquired by "delete_volume" :: waited 0.057s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:09:02 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0c46c2d-950e-436f-8a96-c3e026b1725d tempest-VolumesListTestJSON-751308652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:09:03 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-b0c46c2d-950e-436f-8a96-c3e026b1725d tempest-VolumesListTestJSON-751308652 None] Flow 'volume_create_manager' (3467bc19-8273-40d6-a92f-eacaa88c68bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:09:03 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-b0c46c2d-950e-436f-8a96-c3e026b1725d tempest-VolumesListTestJSON-751308652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba908455-a0c8-4ab4-87da-8e8aca3cff8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:09:03 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab8ba3f-8d90-4a3a-8511-b38f3a896bf5]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:09:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-6ec7cf00-514a-4405-9819-d722bc19b59f tempest-VolumesGetTest-197214973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e1cae148-2b4b-4dcf-85de-77f06f54878a {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:03 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-b0c46c2d-950e-436f-8a96-c3e026b1725d tempest-VolumesListTestJSON-751308652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba908455-a0c8-4ab4-87da-8e8aca3cff8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:09:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1670630296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc6bf177-7bb0-4f2e-8eca-fc2126c1967b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='152561e8f19b45b0b710c3de736e506e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:09:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:09:03Z,use_quota=True,user_id='f9d871eeacdd466e8e7d332ed18f47cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:09:03 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-b0c46c2d-950e-436f-8a96-c3e026b1725d tempest-VolumesListTestJSON-751308652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (987a75d7-53eb-419f-88a1-5a03df99bf31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:09:03 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-b0c46c2d-950e-436f-8a96-c3e026b1725d tempest-VolumesListTestJSON-751308652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (987a75d7-53eb-419f-88a1-5a03df99bf31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:09:03 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-b0c46c2d-950e-436f-8a96-c3e026b1725d tempest-VolumesListTestJSON-751308652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf3d1747-a5c9-4600-9ece-22c439a0b8b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:09:03 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-b0c46c2d-950e-436f-8a96-c3e026b1725d tempest-VolumesListTestJSON-751308652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf3d1747-a5c9-4600-9ece-22c439a0b8b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc6bf177-7bb0-4f2e-8eca-fc2126c1967b', 'volume_name': 'volume-dc6bf177-7bb0-4f2e-8eca-fc2126c1967b', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:09:03 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-b0c46c2d-950e-436f-8a96-c3e026b1725d tempest-VolumesListTestJSON-751308652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d27d243-06d4-48a1-a378-b996ea49c321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:09:03 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-b0c46c2d-950e-436f-8a96-c3e026b1725d tempest-VolumesListTestJSON-751308652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d27d243-06d4-48a1-a378-b996ea49c321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:09:03 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-b0c46c2d-950e-436f-8a96-c3e026b1725d tempest-VolumesListTestJSON-751308652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a52d3922-b577-412d-8262-88fe64c7b61d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:09:03 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-b0c46c2d-950e-436f-8a96-c3e026b1725d tempest-VolumesListTestJSON-751308652 None] Volume dc6bf177-7bb0-4f2e-8eca-fc2126c1967b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc6bf177-7bb0-4f2e-8eca-fc2126c1967b', 'volume_size': 1} Jul 10 10:09:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-b0c46c2d-950e-436f-8a96-c3e026b1725d tempest-VolumesListTestJSON-751308652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:09:03 devstack sudo[94130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e1cae148-2b4b-4dcf-85de-77f06f54878a Jul 10 10:09:03 devstack sudo[94130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:03 devstack sudo[94112]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-d7dba8cc-b258-4f5a-b715-ac32fe5f2796 tempest-VolumesGetTest-197214973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 1.411s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:03 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-d7dba8cc-b258-4f5a-b715-ac32fe5f2796 tempest-VolumesGetTest-197214973 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:09:03 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-d7dba8cc-b258-4f5a-b715-ac32fe5f2796 tempest-VolumesGetTest-197214973 None] Deleted volume successfully. Jul 10 10:09:03 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-d7dba8cc-b258-4f5a-b715-ac32fe5f2796 tempest-VolumesGetTest-197214973 None] Lock "cinder-e223a6a3-0df5-46e5-8a06-cb778bcbe137-delete_volume" released by "delete_volume" :: held 3.772s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:09:03 devstack sudo[94124]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5b93dc51-04ce-4384-b714-5f49c2e3ce14 tempest-SnapshotsActionsTest-852873252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.b47c4fb0-9be6-4004-ac87-3d46de908169" returned: 0 in 1.070s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:03 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-5b93dc51-04ce-4384-b714-5f49c2e3ce14 tempest-SnapshotsActionsTest-852873252 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c136b0f5-b6de-4617-8094-382c31e31841(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 10:09:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5b93dc51-04ce-4384-b714-5f49c2e3ce14 tempest-SnapshotsActionsTest-852873252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.b47c4fb0-9be6-4004-ac87-3d46de908169,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.e7bb3896-d5af-4f07-9a78-194faae0766f 1G {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:03 devstack sudo[94136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.b47c4fb0-9be6-4004-ac87-3d46de908169,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.e7bb3896-d5af-4f07-9a78-194faae0766f 1G Jul 10 10:09:03 devstack sudo[94136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:04 devstack sudo[94130]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-6ec7cf00-514a-4405-9819-d722bc19b59f tempest-VolumesGetTest-197214973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e1cae148-2b4b-4dcf-85de-77f06f54878a" returned: 0 in 1.000s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-6ec7cf00-514a-4405-9819-d722bc19b59f tempest-VolumesGetTest-197214973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e1cae148-2b4b-4dcf-85de-77f06f54878a {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:04 devstack sudo[94142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e1cae148-2b4b-4dcf-85de-77f06f54878a Jul 10 10:09:04 devstack sudo[94142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:04 devstack sudo[94136]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5b93dc51-04ce-4384-b714-5f49c2e3ce14 tempest-SnapshotsActionsTest-852873252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.b47c4fb0-9be6-4004-ac87-3d46de908169,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.e7bb3896-d5af-4f07-9a78-194faae0766f 1G" returned: 0 in 1.075s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5b93dc51-04ce-4384-b714-5f49c2e3ce14 tempest-SnapshotsActionsTest-852873252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c136b0f5-b6de-4617-8094-382c31e31841.b47c4fb0-9be6-4004-ac87-3d46de908169 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.e7bb3896-d5af-4f07-9a78-194faae0766f {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:04 devstack sudo[94148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c136b0f5-b6de-4617-8094-382c31e31841.b47c4fb0-9be6-4004-ac87-3d46de908169 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.e7bb3896-d5af-4f07-9a78-194faae0766f Jul 10 10:09:04 devstack sudo[94148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:04 devstack sudo[94142]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-6ec7cf00-514a-4405-9819-d722bc19b59f tempest-VolumesGetTest-197214973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e1cae148-2b4b-4dcf-85de-77f06f54878a" returned: 0 in 0.863s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:04 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-6ec7cf00-514a-4405-9819-d722bc19b59f tempest-VolumesGetTest-197214973 None] Lock "cinder-quobyte-e1cae148-2b4b-4dcf-85de-77f06f54878a" released by "delete_volume" :: held 1.993s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:09:05 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-6ec7cf00-514a-4405-9819-d722bc19b59f tempest-VolumesGetTest-197214973 None] Created reservations ['89749a13-d75d-407b-b3a9-e4f26d934098', '08e13b89-7924-4899-b3aa-15aa39d68e5c', 'ec8bd6df-7a9a-40b1-ace4-437c751f8292', 'b5b8d380-a8aa-41e1-af8b-f8477aa0c586'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:09:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-6ec7cf00-514a-4405-9819-d722bc19b59f tempest-VolumesGetTest-197214973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:09:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-6ec7cf00-514a-4405-9819-d722bc19b59f tempest-VolumesGetTest-197214973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:09:05 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-6ec7cf00-514a-4405-9819-d722bc19b59f tempest-VolumesGetTest-197214973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:09:05 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-6ec7cf00-514a-4405-9819-d722bc19b59f tempest-VolumesGetTest-197214973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:09:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-6ec7cf00-514a-4405-9819-d722bc19b59f tempest-VolumesGetTest-197214973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:09:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-6ec7cf00-514a-4405-9819-d722bc19b59f tempest-VolumesGetTest-197214973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:05 devstack sudo[94151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:09:05 devstack sudo[94151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:05 devstack sudo[94148]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5b93dc51-04ce-4384-b714-5f49c2e3ce14 tempest-SnapshotsActionsTest-852873252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c136b0f5-b6de-4617-8094-382c31e31841.b47c4fb0-9be6-4004-ac87-3d46de908169 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.e7bb3896-d5af-4f07-9a78-194faae0766f" returned: 0 in 0.759s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:05 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-5b93dc51-04ce-4384-b714-5f49c2e3ce14 tempest-SnapshotsActionsTest-852873252 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.e7bb3896-d5af-4f07-9a78-194faae0766f is being set with open permissions: ugo+rw Jul 10 10:09:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5b93dc51-04ce-4384-b714-5f49c2e3ce14 tempest-SnapshotsActionsTest-852873252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.e7bb3896-d5af-4f07-9a78-194faae0766f {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:05 devstack sudo[94159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.e7bb3896-d5af-4f07-9a78-194faae0766f Jul 10 10:09:05 devstack sudo[94159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:05 devstack sudo[94151]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-6ec7cf00-514a-4405-9819-d722bc19b59f tempest-VolumesGetTest-197214973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.738s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:05 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-6ec7cf00-514a-4405-9819-d722bc19b59f tempest-VolumesGetTest-197214973 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:09:05 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-6ec7cf00-514a-4405-9819-d722bc19b59f tempest-VolumesGetTest-197214973 None] Deleted volume successfully. Jul 10 10:09:05 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-6ec7cf00-514a-4405-9819-d722bc19b59f tempest-VolumesGetTest-197214973 None] Lock "cinder-e1cae148-2b4b-4dcf-85de-77f06f54878a-delete_volume" released by "delete_volume" :: held 3.143s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:09:06 devstack sudo[94159]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5b93dc51-04ce-4384-b714-5f49c2e3ce14 tempest-SnapshotsActionsTest-852873252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.e7bb3896-d5af-4f07-9a78-194faae0766f" returned: 0 in 0.715s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-5b93dc51-04ce-4384-b714-5f49c2e3ce14 tempest-SnapshotsActionsTest-852873252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.847s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:09:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-b0c46c2d-950e-436f-8a96-c3e026b1725d tempest-VolumesListTestJSON-751308652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.151s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:09:06 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-b0c46c2d-950e-436f-8a96-c3e026b1725d tempest-VolumesListTestJSON-751308652 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:09:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1670630296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc6bf177-7bb0-4f2e-8eca-fc2126c1967b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='152561e8f19b45b0b710c3de736e506e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:09:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:09:03Z,use_quota=True,user_id='f9d871eeacdd466e8e7d332ed18f47cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:09:06 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-b0c46c2d-950e-436f-8a96-c3e026b1725d tempest-VolumesListTestJSON-751308652 None] Creating volume dc6bf177-7bb0-4f2e-8eca-fc2126c1967b {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:09:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-b0c46c2d-950e-436f-8a96-c3e026b1725d tempest-VolumesListTestJSON-751308652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:09:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-b0c46c2d-950e-436f-8a96-c3e026b1725d tempest-VolumesListTestJSON-751308652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:09:06 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-b0c46c2d-950e-436f-8a96-c3e026b1725d tempest-VolumesListTestJSON-751308652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:09:06 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-b0c46c2d-950e-436f-8a96-c3e026b1725d tempest-VolumesListTestJSON-751308652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:09:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-b0c46c2d-950e-436f-8a96-c3e026b1725d tempest-VolumesListTestJSON-751308652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:09:06 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-b0c46c2d-950e-436f-8a96-c3e026b1725d tempest-VolumesListTestJSON-751308652 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:09:06 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-b0c46c2d-950e-436f-8a96-c3e026b1725d tempest-VolumesListTestJSON-751308652 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:09:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-b0c46c2d-950e-436f-8a96-c3e026b1725d tempest-VolumesListTestJSON-751308652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-dc6bf177-7bb0-4f2e-8eca-fc2126c1967b 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:06 devstack sudo[94163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-dc6bf177-7bb0-4f2e-8eca-fc2126c1967b 1073741824 Jul 10 10:09:06 devstack sudo[94163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:06 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-5b93dc51-04ce-4384-b714-5f49c2e3ce14 tempest-SnapshotsActionsTest-852873252 None] Create snapshot completed successfully Jul 10 10:09:06 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd4ff051-387e-4750-94f3-464c4f0b1d40 tempest-VolumesGetTest-197214973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:09:06 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-bd4ff051-387e-4750-94f3-464c4f0b1d40 tempest-VolumesGetTest-197214973 None] Flow 'volume_create_manager' (9ff2a5e9-b415-4b13-bfbd-660d600edd55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:09:06 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-bd4ff051-387e-4750-94f3-464c4f0b1d40 tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd9c6311-dee2-4772-b15d-b4cb4b76a926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:09:06 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-bd4ff051-387e-4750-94f3-464c4f0b1d40 tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd9c6311-dee2-4772-b15d-b4cb4b76a926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:09:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1084127144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6e1b243e2ee4fa3bf1c3dda0bf8b5da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:09:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:09:07Z,use_quota=True,user_id='683315fe0f3a4835aed6459f8e52b1dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:09:06 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-bd4ff051-387e-4750-94f3-464c4f0b1d40 tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (360e620e-4d82-46cf-b294-c6daff12322d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:09:06 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-bd4ff051-387e-4750-94f3-464c4f0b1d40 tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (360e620e-4d82-46cf-b294-c6daff12322d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:09:06 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-bd4ff051-387e-4750-94f3-464c4f0b1d40 tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91094504-b45e-4e30-9bf5-9fcf215e254c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:09:06 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-bd4ff051-387e-4750-94f3-464c4f0b1d40 tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91094504-b45e-4e30-9bf5-9fcf215e254c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c', 'volume_name': 'volume-5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:09:06 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-bd4ff051-387e-4750-94f3-464c4f0b1d40 tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f22efa92-261b-4c7b-a243-e35667306225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:09:06 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-bd4ff051-387e-4750-94f3-464c4f0b1d40 tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f22efa92-261b-4c7b-a243-e35667306225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:09:06 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-bd4ff051-387e-4750-94f3-464c4f0b1d40 tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (661ff01c-faa9-4e51-a79e-cda06409056d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:09:06 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-bd4ff051-387e-4750-94f3-464c4f0b1d40 tempest-VolumesGetTest-197214973 None] Volume 5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c', 'volume_size': 1} Jul 10 10:09:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-bd4ff051-387e-4750-94f3-464c4f0b1d40 tempest-VolumesGetTest-197214973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:09:06 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-b37ba218-d9b4-4b7c-ae6f-a14e0e10269b tempest-SnapshotsActionsTest-453962261 None] Acquiring lock "cinder-e7bb3896-d5af-4f07-9a78-194faae0766f-delete_snapshot" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:09:06 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-b37ba218-d9b4-4b7c-ae6f-a14e0e10269b tempest-SnapshotsActionsTest-453962261 None] Lock "cinder-e7bb3896-d5af-4f07-9a78-194faae0766f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:09:06 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-b37ba218-d9b4-4b7c-ae6f-a14e0e10269b tempest-SnapshotsActionsTest-453962261 None] Acquiring lock "cinder-quobyte-c136b0f5-b6de-4617-8094-382c31e31841" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:09:06 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-b37ba218-d9b4-4b7c-ae6f-a14e0e10269b tempest-SnapshotsActionsTest-453962261 None] Lock "cinder-quobyte-c136b0f5-b6de-4617-8094-382c31e31841" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:09:06 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-b37ba218-d9b4-4b7c-ae6f-a14e0e10269b tempest-SnapshotsActionsTest-453962261 None] Acquiring lock "cinder-quobyte-e7bb3896-d5af-4f07-9a78-194faae0766f" by "_delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:09:06 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-b37ba218-d9b4-4b7c-ae6f-a14e0e10269b tempest-SnapshotsActionsTest-453962261 None] Lock "cinder-quobyte-e7bb3896-d5af-4f07-9a78-194faae0766f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:09:06 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-b37ba218-d9b4-4b7c-ae6f-a14e0e10269b tempest-SnapshotsActionsTest-453962261 None] Deleting offline snapshot e7bb3896-d5af-4f07-9a78-194faae0766f of volume c136b0f5-b6de-4617-8094-382c31e31841 {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 10:09:06 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-b37ba218-d9b4-4b7c-ae6f-a14e0e10269b tempest-SnapshotsActionsTest-453962261 None] snapshot_file for this snap is: volume-c136b0f5-b6de-4617-8094-382c31e31841.e7bb3896-d5af-4f07-9a78-194faae0766f {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 10:09:06 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49c2b74-c39b-42ff-9afe-62e2265f6c50]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:09:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-b37ba218-d9b4-4b7c-ae6f-a14e0e10269b tempest-SnapshotsActionsTest-453962261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.e7bb3896-d5af-4f07-9a78-194faae0766f {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:06 devstack sudo[94166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.e7bb3896-d5af-4f07-9a78-194faae0766f Jul 10 10:09:06 devstack sudo[94166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:07 devstack sudo[94163]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-b0c46c2d-950e-436f-8a96-c3e026b1725d tempest-VolumesListTestJSON-751308652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-dc6bf177-7bb0-4f2e-8eca-fc2126c1967b 1073741824" returned: 0 in 0.901s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-b0c46c2d-950e-436f-8a96-c3e026b1725d tempest-VolumesListTestJSON-751308652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-dc6bf177-7bb0-4f2e-8eca-fc2126c1967b {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:07 devstack sudo[94171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-dc6bf177-7bb0-4f2e-8eca-fc2126c1967b Jul 10 10:09:07 devstack sudo[94171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:07 devstack sudo[94166]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-b37ba218-d9b4-4b7c-ae6f-a14e0e10269b tempest-SnapshotsActionsTest-453962261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.e7bb3896-d5af-4f07-9a78-194faae0766f" returned: 0 in 0.806s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:07 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-b37ba218-d9b4-4b7c-ae6f-a14e0e10269b tempest-SnapshotsActionsTest-453962261 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c136b0f5-b6de-4617-8094-382c31e31841(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 10:09:07 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[03246182-9147-40ba-96ff-28a580d9cb7a]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:09:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-b37ba218-d9b4-4b7c-ae6f-a14e0e10269b tempest-SnapshotsActionsTest-453962261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.b47c4fb0-9be6-4004-ac87-3d46de908169 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:07 devstack sudo[94176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.b47c4fb0-9be6-4004-ac87-3d46de908169 Jul 10 10:09:07 devstack sudo[94176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:07 devstack sudo[94171]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-b0c46c2d-950e-436f-8a96-c3e026b1725d tempest-VolumesListTestJSON-751308652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-dc6bf177-7bb0-4f2e-8eca-fc2126c1967b" returned: 0 in 0.695s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:07 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-b0c46c2d-950e-436f-8a96-c3e026b1725d tempest-VolumesListTestJSON-751308652 None] <== create_volume: return (1645ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:09:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-b0c46c2d-950e-436f-8a96-c3e026b1725d tempest-VolumesListTestJSON-751308652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.652s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:09:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-bd4ff051-387e-4750-94f3-464c4f0b1d40 tempest-VolumesGetTest-197214973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.270s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:09:07 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-bd4ff051-387e-4750-94f3-464c4f0b1d40 tempest-VolumesGetTest-197214973 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:09:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1084127144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6e1b243e2ee4fa3bf1c3dda0bf8b5da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:09:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:09:07Z,use_quota=True,user_id='683315fe0f3a4835aed6459f8e52b1dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:09:07 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-bd4ff051-387e-4750-94f3-464c4f0b1d40 tempest-VolumesGetTest-197214973 None] Creating volume 5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:09:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-bd4ff051-387e-4750-94f3-464c4f0b1d40 tempest-VolumesGetTest-197214973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:09:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-bd4ff051-387e-4750-94f3-464c4f0b1d40 tempest-VolumesGetTest-197214973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:09:07 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-bd4ff051-387e-4750-94f3-464c4f0b1d40 tempest-VolumesGetTest-197214973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:09:07 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-bd4ff051-387e-4750-94f3-464c4f0b1d40 tempest-VolumesGetTest-197214973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:09:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-bd4ff051-387e-4750-94f3-464c4f0b1d40 tempest-VolumesGetTest-197214973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:09:07 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-bd4ff051-387e-4750-94f3-464c4f0b1d40 tempest-VolumesGetTest-197214973 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:09:07 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-bd4ff051-387e-4750-94f3-464c4f0b1d40 tempest-VolumesGetTest-197214973 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:09:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-bd4ff051-387e-4750-94f3-464c4f0b1d40 tempest-VolumesGetTest-197214973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:07 devstack sudo[94179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c 1073741824 Jul 10 10:09:07 devstack sudo[94179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:07 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-b0c46c2d-950e-436f-8a96-c3e026b1725d tempest-VolumesListTestJSON-751308652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a52d3922-b577-412d-8262-88fe64c7b61d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc6bf177-7bb0-4f2e-8eca-fc2126c1967b', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:09:07 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-b0c46c2d-950e-436f-8a96-c3e026b1725d tempest-VolumesListTestJSON-751308652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dc36b76-1889-47bc-b743-ef8d1889dc84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:09:07 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-b0c46c2d-950e-436f-8a96-c3e026b1725d tempest-VolumesListTestJSON-751308652 None] Volume volume-dc6bf177-7bb0-4f2e-8eca-fc2126c1967b (dc6bf177-7bb0-4f2e-8eca-fc2126c1967b): created successfully Jul 10 10:09:07 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-b0c46c2d-950e-436f-8a96-c3e026b1725d tempest-VolumesListTestJSON-751308652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dc36b76-1889-47bc-b743-ef8d1889dc84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:09:08 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-b0c46c2d-950e-436f-8a96-c3e026b1725d tempest-VolumesListTestJSON-751308652 None] Flow 'volume_create_manager' (3467bc19-8273-40d6-a92f-eacaa88c68bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:09:08 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-b0c46c2d-950e-436f-8a96-c3e026b1725d tempest-VolumesListTestJSON-751308652 None] Created volume successfully. Jul 10 10:09:08 devstack sudo[94176]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:08 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-b37ba218-d9b4-4b7c-ae6f-a14e0e10269b tempest-SnapshotsActionsTest-453962261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.b47c4fb0-9be6-4004-ac87-3d46de908169" returned: 0 in 0.843s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:08 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-b37ba218-d9b4-4b7c-ae6f-a14e0e10269b tempest-SnapshotsActionsTest-453962261 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c136b0f5-b6de-4617-8094-382c31e31841(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 10:09:08 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-b37ba218-d9b4-4b7c-ae6f-a14e0e10269b tempest-SnapshotsActionsTest-453962261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.e7bb3896-d5af-4f07-9a78-194faae0766f {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:08 devstack sudo[94184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.e7bb3896-d5af-4f07-9a78-194faae0766f Jul 10 10:09:08 devstack sudo[94184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:08 devstack sudo[94179]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:08 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-bd4ff051-387e-4750-94f3-464c4f0b1d40 tempest-VolumesGetTest-197214973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c 1073741824" returned: 0 in 0.956s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:08 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-bd4ff051-387e-4750-94f3-464c4f0b1d40 tempest-VolumesGetTest-197214973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:08 devstack sudo[94190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c Jul 10 10:09:08 devstack sudo[94190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:09 devstack sudo[94184]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:09 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-b37ba218-d9b4-4b7c-ae6f-a14e0e10269b tempest-SnapshotsActionsTest-453962261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.e7bb3896-d5af-4f07-9a78-194faae0766f" returned: 0 in 0.933s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:09 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-b37ba218-d9b4-4b7c-ae6f-a14e0e10269b tempest-SnapshotsActionsTest-453962261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.e7bb3896-d5af-4f07-9a78-194faae0766f {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:09 devstack sudo[94196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.e7bb3896-d5af-4f07-9a78-194faae0766f Jul 10 10:09:09 devstack sudo[94196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:09 devstack sudo[94190]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:09 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-bd4ff051-387e-4750-94f3-464c4f0b1d40 tempest-VolumesGetTest-197214973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c" returned: 0 in 0.931s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:09 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-bd4ff051-387e-4750-94f3-464c4f0b1d40 tempest-VolumesGetTest-197214973 None] <== create_volume: return (1950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:09:09 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-bd4ff051-387e-4750-94f3-464c4f0b1d40 tempest-VolumesGetTest-197214973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.954s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:09:09 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-bd4ff051-387e-4750-94f3-464c4f0b1d40 tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (661ff01c-faa9-4e51-a79e-cda06409056d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:09:09 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-bd4ff051-387e-4750-94f3-464c4f0b1d40 tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d59899f-75ff-4369-9325-4eef4b89f7b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:09:09 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-bd4ff051-387e-4750-94f3-464c4f0b1d40 tempest-VolumesGetTest-197214973 None] Volume volume-5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c (5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c): created successfully Jul 10 10:09:09 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-bd4ff051-387e-4750-94f3-464c4f0b1d40 tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d59899f-75ff-4369-9325-4eef4b89f7b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:09:09 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-bd4ff051-387e-4750-94f3-464c4f0b1d40 tempest-VolumesGetTest-197214973 None] Flow 'volume_create_manager' (9ff2a5e9-b415-4b13-bfbd-660d600edd55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:09:09 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-bd4ff051-387e-4750-94f3-464c4f0b1d40 tempest-VolumesGetTest-197214973 None] Created volume successfully. Jul 10 10:09:10 devstack sudo[94196]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:10 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-b37ba218-d9b4-4b7c-ae6f-a14e0e10269b tempest-SnapshotsActionsTest-453962261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.e7bb3896-d5af-4f07-9a78-194faae0766f" returned: 0 in 0.829s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:10 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-b37ba218-d9b4-4b7c-ae6f-a14e0e10269b tempest-SnapshotsActionsTest-453962261 None] Lock "cinder-quobyte-e7bb3896-d5af-4f07-9a78-194faae0766f" released by "_delete_snapshot" :: held 3.559s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:09:10 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-b37ba218-d9b4-4b7c-ae6f-a14e0e10269b tempest-SnapshotsActionsTest-453962261 None] Lock "cinder-quobyte-c136b0f5-b6de-4617-8094-382c31e31841" released by "delete_snapshot" :: held 3.594s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:09:10 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-b37ba218-d9b4-4b7c-ae6f-a14e0e10269b tempest-SnapshotsActionsTest-453962261 None] Created reservations ['3ffd60dd-8558-46ac-8926-33a73c4621a6', 'e704ef7a-5db2-4742-a55a-928c989d00e3', '09ab2d2d-dcc7-4de6-9fe4-582d65b77db5', 'd48a44a9-370a-4a5b-8272-be67781c0498'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:09:10 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-b37ba218-d9b4-4b7c-ae6f-a14e0e10269b tempest-SnapshotsActionsTest-453962261 None] Delete snapshot completed successfully. Jul 10 10:09:10 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-b37ba218-d9b4-4b7c-ae6f-a14e0e10269b tempest-SnapshotsActionsTest-453962261 None] Lock "cinder-e7bb3896-d5af-4f07-9a78-194faae0766f-delete_snapshot" released by "delete_snapshot" :: held 3.791s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:09:10 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-78fb418c-aca2-4617-b423-4096ff21989b tempest-VolumesListTestJSON-751308652 None] Acquiring lock "cinder-dc6bf177-7bb0-4f2e-8eca-fc2126c1967b-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:09:10 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-78fb418c-aca2-4617-b423-4096ff21989b tempest-VolumesListTestJSON-751308652 None] Lock "cinder-dc6bf177-7bb0-4f2e-8eca-fc2126c1967b-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:09:10 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-78fb418c-aca2-4617-b423-4096ff21989b tempest-VolumesListTestJSON-751308652 None] Acquiring lock "cinder-quobyte-dc6bf177-7bb0-4f2e-8eca-fc2126c1967b" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:09:10 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-78fb418c-aca2-4617-b423-4096ff21989b tempest-VolumesListTestJSON-751308652 None] Lock "cinder-quobyte-dc6bf177-7bb0-4f2e-8eca-fc2126c1967b" acquired by "delete_volume" :: waited 0.017s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:09:10 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[8faa8c4b-77fc-4cd2-aa93-c9b449b0eed2]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:09:10 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-78fb418c-aca2-4617-b423-4096ff21989b tempest-VolumesListTestJSON-751308652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-dc6bf177-7bb0-4f2e-8eca-fc2126c1967b {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:10 devstack sudo[94236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-dc6bf177-7bb0-4f2e-8eca-fc2126c1967b Jul 10 10:09:10 devstack sudo[94236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:11 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f40d7712-1e19-45c4-acb0-2d032bda9651 tempest-SnapshotsActionsTest-852873252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:09:11 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f40d7712-1e19-45c4-acb0-2d032bda9651 tempest-SnapshotsActionsTest-852873252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:09:11 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d9dbe40-c072-454d-a912-761b2cbce4cc tempest-VolumesGetTest-197214973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:09:11 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-f40d7712-1e19-45c4-acb0-2d032bda9651 tempest-SnapshotsActionsTest-852873252 None] Creating offline snapshot 4a09a977-29a9-4850-a9ac-513519df4227 of volume c136b0f5-b6de-4617-8094-382c31e31841 {{(pid=87234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 10:09:11 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1d9dbe40-c072-454d-a912-761b2cbce4cc tempest-VolumesGetTest-197214973 None] Flow 'volume_create_manager' (52549642-b197-4cea-81c1-f692b8751656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:09:11 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1d9dbe40-c072-454d-a912-761b2cbce4cc tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b4cee8d-ed45-48d2-8ba0-445830ab4a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:09:11 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[125ea6c3-0bec-471b-97b6-445ccf9f2e5a]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:09:11 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f40d7712-1e19-45c4-acb0-2d032bda9651 tempest-SnapshotsActionsTest-852873252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.b47c4fb0-9be6-4004-ac87-3d46de908169 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:11 devstack sudo[94236]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:11 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1d9dbe40-c072-454d-a912-761b2cbce4cc tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b4cee8d-ed45-48d2-8ba0-445830ab4a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:09:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-701981707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8dcc8c2-b3f0-493a-8408-e05013c10dcb,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b6e1b243e2ee4fa3bf1c3dda0bf8b5da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c,status='creating',terminated_at=None,updated_at=2026-07-10T08:09:12Z,use_quota=True,user_id='683315fe0f3a4835aed6459f8e52b1dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:09:11 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1d9dbe40-c072-454d-a912-761b2cbce4cc tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc7c876f-7abd-4f52-aed1-d176305f1cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:09:11 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1d9dbe40-c072-454d-a912-761b2cbce4cc tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc7c876f-7abd-4f52-aed1-d176305f1cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:09:11 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1d9dbe40-c072-454d-a912-761b2cbce4cc tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e74dbfb2-3daa-481f-b0d5-e099daf6cd48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:09:11 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-78fb418c-aca2-4617-b423-4096ff21989b tempest-VolumesListTestJSON-751308652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-dc6bf177-7bb0-4f2e-8eca-fc2126c1967b" returned: 0 in 0.954s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:11 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-78fb418c-aca2-4617-b423-4096ff21989b tempest-VolumesListTestJSON-751308652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-dc6bf177-7bb0-4f2e-8eca-fc2126c1967b {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:11 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1d9dbe40-c072-454d-a912-761b2cbce4cc tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e74dbfb2-3daa-481f-b0d5-e099daf6cd48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'c8dcc8c2-b3f0-493a-8408-e05013c10dcb', 'volume_name': 'volume-c8dcc8c2-b3f0-493a-8408-e05013c10dcb', 'volume_size': 1, 'source_volid': '5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c', 'source_volstatus': 'available'}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:09:11 devstack sudo[94242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-dc6bf177-7bb0-4f2e-8eca-fc2126c1967b Jul 10 10:09:11 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1d9dbe40-c072-454d-a912-761b2cbce4cc tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (566a2728-36f8-412e-bcdd-39b3c3f67770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:09:11 devstack sudo[94242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:11 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1d9dbe40-c072-454d-a912-761b2cbce4cc tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (566a2728-36f8-412e-bcdd-39b3c3f67770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:09:11 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1d9dbe40-c072-454d-a912-761b2cbce4cc tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (786d09d1-97e7-4f68-9fcf-721d341d7847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:09:11 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-1d9dbe40-c072-454d-a912-761b2cbce4cc tempest-VolumesGetTest-197214973 None] Volume c8dcc8c2-b3f0-493a-8408-e05013c10dcb: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-c8dcc8c2-b3f0-493a-8408-e05013c10dcb', 'volume_size': 1, 'source_volid': '5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c', 'source_volstatus': 'available'} Jul 10 10:09:11 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-1d9dbe40-c072-454d-a912-761b2cbce4cc tempest-VolumesGetTest-197214973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:09:11 devstack sudo[94241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.b47c4fb0-9be6-4004-ac87-3d46de908169 Jul 10 10:09:11 devstack sudo[94241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:12 devstack sudo[94242]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-78fb418c-aca2-4617-b423-4096ff21989b tempest-VolumesListTestJSON-751308652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-dc6bf177-7bb0-4f2e-8eca-fc2126c1967b" returned: 0 in 0.699s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:12 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-78fb418c-aca2-4617-b423-4096ff21989b tempest-VolumesListTestJSON-751308652 None] Lock "cinder-quobyte-dc6bf177-7bb0-4f2e-8eca-fc2126c1967b" released by "delete_volume" :: held 1.711s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:09:12 devstack sudo[94241]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f40d7712-1e19-45c4-acb0-2d032bda9651 tempest-SnapshotsActionsTest-852873252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.b47c4fb0-9be6-4004-ac87-3d46de908169" returned: 0 in 0.825s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:12 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-f40d7712-1e19-45c4-acb0-2d032bda9651 tempest-SnapshotsActionsTest-852873252 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c136b0f5-b6de-4617-8094-382c31e31841(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 10:09:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f40d7712-1e19-45c4-acb0-2d032bda9651 tempest-SnapshotsActionsTest-852873252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.b47c4fb0-9be6-4004-ac87-3d46de908169,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.4a09a977-29a9-4850-a9ac-513519df4227 1G {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:12 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-78fb418c-aca2-4617-b423-4096ff21989b tempest-VolumesListTestJSON-751308652 None] Created reservations ['186fc446-5898-4d01-8702-0f5d8e4e487e', 'e44a72e8-2bd0-416b-a9db-48c75bbc2cc7', 'fc9209f2-1a64-42c3-a4f1-7f49d78ff6c5', '78be5788-ee08-4167-9e5b-88068427cfdb'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:09:12 devstack sudo[94251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.b47c4fb0-9be6-4004-ac87-3d46de908169,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.4a09a977-29a9-4850-a9ac-513519df4227 1G Jul 10 10:09:12 devstack sudo[94251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-78fb418c-aca2-4617-b423-4096ff21989b tempest-VolumesListTestJSON-751308652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:09:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-78fb418c-aca2-4617-b423-4096ff21989b tempest-VolumesListTestJSON-751308652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:09:12 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-78fb418c-aca2-4617-b423-4096ff21989b tempest-VolumesListTestJSON-751308652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:09:12 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-78fb418c-aca2-4617-b423-4096ff21989b tempest-VolumesListTestJSON-751308652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:09:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-78fb418c-aca2-4617-b423-4096ff21989b tempest-VolumesListTestJSON-751308652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:09:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-78fb418c-aca2-4617-b423-4096ff21989b tempest-VolumesListTestJSON-751308652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:12 devstack sudo[94253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:09:12 devstack sudo[94253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:13 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-9053a15b-2dd6-4e52-b7a0-5adfc92eb56c tempest-VolumesListTestJSON-751308652 None] Acquiring lock "cinder-3d54bf5b-84a9-45e8-b819-ab3f7dfaf76f-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:09:13 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-9053a15b-2dd6-4e52-b7a0-5adfc92eb56c tempest-VolumesListTestJSON-751308652 None] Lock "cinder-3d54bf5b-84a9-45e8-b819-ab3f7dfaf76f-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:09:13 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-9053a15b-2dd6-4e52-b7a0-5adfc92eb56c tempest-VolumesListTestJSON-751308652 None] Acquiring lock "cinder-quobyte-3d54bf5b-84a9-45e8-b819-ab3f7dfaf76f" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:09:13 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-9053a15b-2dd6-4e52-b7a0-5adfc92eb56c tempest-VolumesListTestJSON-751308652 None] Lock "cinder-quobyte-3d54bf5b-84a9-45e8-b819-ab3f7dfaf76f" acquired by "delete_volume" :: waited 0.027s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:09:13 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[82017c8a-7617-405a-b59c-fc416a1aea85]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:09:13 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9053a15b-2dd6-4e52-b7a0-5adfc92eb56c tempest-VolumesListTestJSON-751308652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3d54bf5b-84a9-45e8-b819-ab3f7dfaf76f {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:13 devstack sudo[94260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3d54bf5b-84a9-45e8-b819-ab3f7dfaf76f Jul 10 10:09:13 devstack sudo[94260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:13 devstack sudo[94253]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:13 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-78fb418c-aca2-4617-b423-4096ff21989b tempest-VolumesListTestJSON-751308652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.815s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:13 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-78fb418c-aca2-4617-b423-4096ff21989b tempest-VolumesListTestJSON-751308652 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:09:13 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-78fb418c-aca2-4617-b423-4096ff21989b tempest-VolumesListTestJSON-751308652 None] Deleted volume successfully. Jul 10 10:09:13 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-78fb418c-aca2-4617-b423-4096ff21989b tempest-VolumesListTestJSON-751308652 None] Lock "cinder-dc6bf177-7bb0-4f2e-8eca-fc2126c1967b-delete_volume" released by "delete_volume" :: held 2.804s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:09:13 devstack sudo[94251]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:13 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f40d7712-1e19-45c4-acb0-2d032bda9651 tempest-SnapshotsActionsTest-852873252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.b47c4fb0-9be6-4004-ac87-3d46de908169,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.4a09a977-29a9-4850-a9ac-513519df4227 1G" returned: 0 in 1.012s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:13 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f40d7712-1e19-45c4-acb0-2d032bda9651 tempest-SnapshotsActionsTest-852873252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c136b0f5-b6de-4617-8094-382c31e31841.b47c4fb0-9be6-4004-ac87-3d46de908169 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.4a09a977-29a9-4850-a9ac-513519df4227 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:13 devstack sudo[94263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c136b0f5-b6de-4617-8094-382c31e31841.b47c4fb0-9be6-4004-ac87-3d46de908169 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.4a09a977-29a9-4850-a9ac-513519df4227 Jul 10 10:09:13 devstack sudo[94263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:14 devstack sudo[94260]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:14 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9053a15b-2dd6-4e52-b7a0-5adfc92eb56c tempest-VolumesListTestJSON-751308652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3d54bf5b-84a9-45e8-b819-ab3f7dfaf76f" returned: 0 in 0.885s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:14 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9053a15b-2dd6-4e52-b7a0-5adfc92eb56c tempest-VolumesListTestJSON-751308652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3d54bf5b-84a9-45e8-b819-ab3f7dfaf76f {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:14 devstack sudo[94268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3d54bf5b-84a9-45e8-b819-ab3f7dfaf76f Jul 10 10:09:14 devstack sudo[94268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:14 devstack sudo[94263]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:14 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f40d7712-1e19-45c4-acb0-2d032bda9651 tempest-SnapshotsActionsTest-852873252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c136b0f5-b6de-4617-8094-382c31e31841.b47c4fb0-9be6-4004-ac87-3d46de908169 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.4a09a977-29a9-4850-a9ac-513519df4227" returned: 0 in 0.755s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:14 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-f40d7712-1e19-45c4-acb0-2d032bda9651 tempest-SnapshotsActionsTest-852873252 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.4a09a977-29a9-4850-a9ac-513519df4227 is being set with open permissions: ugo+rw Jul 10 10:09:14 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f40d7712-1e19-45c4-acb0-2d032bda9651 tempest-SnapshotsActionsTest-852873252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.4a09a977-29a9-4850-a9ac-513519df4227 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:14 devstack sudo[94273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.4a09a977-29a9-4850-a9ac-513519df4227 Jul 10 10:09:14 devstack sudo[94273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:14 devstack sudo[94268]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:14 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9053a15b-2dd6-4e52-b7a0-5adfc92eb56c tempest-VolumesListTestJSON-751308652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3d54bf5b-84a9-45e8-b819-ab3f7dfaf76f" returned: 0 in 0.674s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:14 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-9053a15b-2dd6-4e52-b7a0-5adfc92eb56c tempest-VolumesListTestJSON-751308652 None] Lock "cinder-quobyte-3d54bf5b-84a9-45e8-b819-ab3f7dfaf76f" released by "delete_volume" :: held 1.603s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:09:14 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-9053a15b-2dd6-4e52-b7a0-5adfc92eb56c tempest-VolumesListTestJSON-751308652 None] Created reservations ['f2c9742a-1802-4e97-bed7-710668ac69af', '86e67c8e-5c9d-41d2-b8dd-9ad3b2571f63', 'cb430dfe-531d-435f-90ae-543c52429adf', '0934c2b5-bcf6-4b76-86df-9d58dd1bcc48'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:09:14 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-9053a15b-2dd6-4e52-b7a0-5adfc92eb56c tempest-VolumesListTestJSON-751308652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:09:14 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-9053a15b-2dd6-4e52-b7a0-5adfc92eb56c tempest-VolumesListTestJSON-751308652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:09:14 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-9053a15b-2dd6-4e52-b7a0-5adfc92eb56c tempest-VolumesListTestJSON-751308652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:09:14 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-9053a15b-2dd6-4e52-b7a0-5adfc92eb56c tempest-VolumesListTestJSON-751308652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:09:14 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-9053a15b-2dd6-4e52-b7a0-5adfc92eb56c tempest-VolumesListTestJSON-751308652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:09:14 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9053a15b-2dd6-4e52-b7a0-5adfc92eb56c tempest-VolumesListTestJSON-751308652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:14 devstack sudo[94277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:09:14 devstack sudo[94277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:15 devstack sudo[94273]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:15 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f40d7712-1e19-45c4-acb0-2d032bda9651 tempest-SnapshotsActionsTest-852873252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.4a09a977-29a9-4850-a9ac-513519df4227" returned: 0 in 0.725s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:15 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f40d7712-1e19-45c4-acb0-2d032bda9651 tempest-SnapshotsActionsTest-852873252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.472s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:09:15 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-1d9dbe40-c072-454d-a912-761b2cbce4cc tempest-VolumesGetTest-197214973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 3.233s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:09:15 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-1d9dbe40-c072-454d-a912-761b2cbce4cc tempest-VolumesGetTest-197214973 None] Cloning volume 5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c to volume c8dcc8c2-b3f0-493a-8408-e05013c10dcb Jul 10 10:09:15 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-f40d7712-1e19-45c4-acb0-2d032bda9651 tempest-SnapshotsActionsTest-852873252 None] Create snapshot completed successfully Jul 10 10:09:15 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-1d9dbe40-c072-454d-a912-761b2cbce4cc tempest-VolumesGetTest-197214973 None] Creating offline snapshot 8c5b54f6-b0f3-41af-b0f1-feafdf4175f3 of volume 5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c {{(pid=87234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 10:09:15 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f3dac9-3699-45e8-8a92-6dfe249dbdcd]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:09:15 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1d9dbe40-c072-454d-a912-761b2cbce4cc tempest-VolumesGetTest-197214973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:15 devstack sudo[94280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c Jul 10 10:09:15 devstack sudo[94280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:15 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f42490f4-f735-471d-bf7c-11450ffbd4ff tempest-VolumesListTestJSON-751308652 None] Acquiring lock "cinder-05db0b1a-bab7-4167-b89f-3f97d168a8a2-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:09:15 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f42490f4-f735-471d-bf7c-11450ffbd4ff tempest-VolumesListTestJSON-751308652 None] Lock "cinder-05db0b1a-bab7-4167-b89f-3f97d168a8a2-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:09:15 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f42490f4-f735-471d-bf7c-11450ffbd4ff tempest-VolumesListTestJSON-751308652 None] Acquiring lock "cinder-quobyte-05db0b1a-bab7-4167-b89f-3f97d168a8a2" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:09:15 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f42490f4-f735-471d-bf7c-11450ffbd4ff tempest-VolumesListTestJSON-751308652 None] Lock "cinder-quobyte-05db0b1a-bab7-4167-b89f-3f97d168a8a2" acquired by "delete_volume" :: waited 0.020s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:09:15 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[50484fa7-da4e-48d5-83be-e9ac025b0223]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:09:15 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f42490f4-f735-471d-bf7c-11450ffbd4ff tempest-VolumesListTestJSON-751308652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-05db0b1a-bab7-4167-b89f-3f97d168a8a2 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:15 devstack sudo[94283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-05db0b1a-bab7-4167-b89f-3f97d168a8a2 Jul 10 10:09:15 devstack sudo[94283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:15 devstack sudo[94277]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:15 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9053a15b-2dd6-4e52-b7a0-5adfc92eb56c tempest-VolumesListTestJSON-751308652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.712s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:15 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-9053a15b-2dd6-4e52-b7a0-5adfc92eb56c tempest-VolumesListTestJSON-751308652 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:09:15 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-9053a15b-2dd6-4e52-b7a0-5adfc92eb56c tempest-VolumesListTestJSON-751308652 None] Deleted volume successfully. Jul 10 10:09:15 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-9053a15b-2dd6-4e52-b7a0-5adfc92eb56c tempest-VolumesListTestJSON-751308652 None] Lock "cinder-3d54bf5b-84a9-45e8-b819-ab3f7dfaf76f-delete_volume" released by "delete_volume" :: held 2.582s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:09:15 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-84e01d78-d390-4532-be09-abab86c2a3d7 tempest-SnapshotsActionsTest-453962261 None] Acquiring lock "cinder-4a09a977-29a9-4850-a9ac-513519df4227-delete_snapshot" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:09:15 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-84e01d78-d390-4532-be09-abab86c2a3d7 tempest-SnapshotsActionsTest-453962261 None] Lock "cinder-4a09a977-29a9-4850-a9ac-513519df4227-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:09:15 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-84e01d78-d390-4532-be09-abab86c2a3d7 tempest-SnapshotsActionsTest-453962261 None] Acquiring lock "cinder-quobyte-c136b0f5-b6de-4617-8094-382c31e31841" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:09:15 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-84e01d78-d390-4532-be09-abab86c2a3d7 tempest-SnapshotsActionsTest-453962261 None] Lock "cinder-quobyte-c136b0f5-b6de-4617-8094-382c31e31841" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:09:15 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-84e01d78-d390-4532-be09-abab86c2a3d7 tempest-SnapshotsActionsTest-453962261 None] Acquiring lock "cinder-quobyte-4a09a977-29a9-4850-a9ac-513519df4227" by "_delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:09:15 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-84e01d78-d390-4532-be09-abab86c2a3d7 tempest-SnapshotsActionsTest-453962261 None] Lock "cinder-quobyte-4a09a977-29a9-4850-a9ac-513519df4227" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:09:15 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-84e01d78-d390-4532-be09-abab86c2a3d7 tempest-SnapshotsActionsTest-453962261 None] Deleting offline snapshot 4a09a977-29a9-4850-a9ac-513519df4227 of volume c136b0f5-b6de-4617-8094-382c31e31841 {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 10:09:15 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-84e01d78-d390-4532-be09-abab86c2a3d7 tempest-SnapshotsActionsTest-453962261 None] snapshot_file for this snap is: volume-c136b0f5-b6de-4617-8094-382c31e31841.4a09a977-29a9-4850-a9ac-513519df4227 {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 10:09:15 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1b500a-671b-41fd-9671-0ed4907f0077]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:09:15 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-84e01d78-d390-4532-be09-abab86c2a3d7 tempest-SnapshotsActionsTest-453962261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.4a09a977-29a9-4850-a9ac-513519df4227 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:16 devstack sudo[94285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.4a09a977-29a9-4850-a9ac-513519df4227 Jul 10 10:09:16 devstack sudo[94285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:16 devstack sudo[94280]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1d9dbe40-c072-454d-a912-761b2cbce4cc tempest-VolumesGetTest-197214973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c" returned: 0 in 0.964s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1d9dbe40-c072-454d-a912-761b2cbce4cc tempest-VolumesGetTest-197214973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c.8c5b54f6-b0f3-41af-b0f1-feafdf4175f3 1G {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:16 devstack sudo[94291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c.8c5b54f6-b0f3-41af-b0f1-feafdf4175f3 1G Jul 10 10:09:16 devstack sudo[94291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:16 devstack sudo[94283]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f42490f4-f735-471d-bf7c-11450ffbd4ff tempest-VolumesListTestJSON-751308652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-05db0b1a-bab7-4167-b89f-3f97d168a8a2" returned: 0 in 0.824s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f42490f4-f735-471d-bf7c-11450ffbd4ff tempest-VolumesListTestJSON-751308652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-05db0b1a-bab7-4167-b89f-3f97d168a8a2 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:16 devstack sudo[94296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-05db0b1a-bab7-4167-b89f-3f97d168a8a2 Jul 10 10:09:16 devstack sudo[94296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:16 devstack sudo[94285]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-84e01d78-d390-4532-be09-abab86c2a3d7 tempest-SnapshotsActionsTest-453962261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.4a09a977-29a9-4850-a9ac-513519df4227" returned: 0 in 0.796s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:16 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-84e01d78-d390-4532-be09-abab86c2a3d7 tempest-SnapshotsActionsTest-453962261 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c136b0f5-b6de-4617-8094-382c31e31841(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 10:09:16 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a49f44-a392-4554-afa1-7b51fdbb58e0]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:09:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-84e01d78-d390-4532-be09-abab86c2a3d7 tempest-SnapshotsActionsTest-453962261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.b47c4fb0-9be6-4004-ac87-3d46de908169 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:16 devstack sudo[94305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.b47c4fb0-9be6-4004-ac87-3d46de908169 Jul 10 10:09:16 devstack sudo[94305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:17 devstack sudo[94291]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:17 devstack sudo[94296]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1d9dbe40-c072-454d-a912-761b2cbce4cc tempest-VolumesGetTest-197214973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c.8c5b54f6-b0f3-41af-b0f1-feafdf4175f3 1G" returned: 0 in 0.887s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1d9dbe40-c072-454d-a912-761b2cbce4cc tempest-VolumesGetTest-197214973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c.8c5b54f6-b0f3-41af-b0f1-feafdf4175f3 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f42490f4-f735-471d-bf7c-11450ffbd4ff tempest-VolumesListTestJSON-751308652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-05db0b1a-bab7-4167-b89f-3f97d168a8a2" returned: 0 in 0.673s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:17 devstack sudo[94309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c.8c5b54f6-b0f3-41af-b0f1-feafdf4175f3 Jul 10 10:09:17 devstack sudo[94309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:17 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f42490f4-f735-471d-bf7c-11450ffbd4ff tempest-VolumesListTestJSON-751308652 None] Lock "cinder-quobyte-05db0b1a-bab7-4167-b89f-3f97d168a8a2" released by "delete_volume" :: held 1.546s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:09:17 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-f42490f4-f735-471d-bf7c-11450ffbd4ff tempest-VolumesListTestJSON-751308652 None] Created reservations ['f9d0c9da-1e15-4b7a-bc83-b41bf3ab3881', 'e30b7281-c3fb-44bb-beaa-d5378bf28f23', '9ee9410b-0d5b-4256-a42f-033341992029', '42e86f98-55a6-4d45-b161-f75f721e7f74'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:09:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f42490f4-f735-471d-bf7c-11450ffbd4ff tempest-VolumesListTestJSON-751308652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:09:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f42490f4-f735-471d-bf7c-11450ffbd4ff tempest-VolumesListTestJSON-751308652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:09:17 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f42490f4-f735-471d-bf7c-11450ffbd4ff tempest-VolumesListTestJSON-751308652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:09:17 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f42490f4-f735-471d-bf7c-11450ffbd4ff tempest-VolumesListTestJSON-751308652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:09:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f42490f4-f735-471d-bf7c-11450ffbd4ff tempest-VolumesListTestJSON-751308652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:09:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f42490f4-f735-471d-bf7c-11450ffbd4ff tempest-VolumesListTestJSON-751308652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:17 devstack sudo[94311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:09:17 devstack sudo[94311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:17 devstack sudo[94305]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-84e01d78-d390-4532-be09-abab86c2a3d7 tempest-SnapshotsActionsTest-453962261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.b47c4fb0-9be6-4004-ac87-3d46de908169" returned: 0 in 0.822s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:17 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-84e01d78-d390-4532-be09-abab86c2a3d7 tempest-SnapshotsActionsTest-453962261 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c136b0f5-b6de-4617-8094-382c31e31841(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 10:09:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-84e01d78-d390-4532-be09-abab86c2a3d7 tempest-SnapshotsActionsTest-453962261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.4a09a977-29a9-4850-a9ac-513519df4227 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:17 devstack sudo[94318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.4a09a977-29a9-4850-a9ac-513519df4227 Jul 10 10:09:17 devstack sudo[94318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:17 devstack sudo[94309]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1d9dbe40-c072-454d-a912-761b2cbce4cc tempest-VolumesGetTest-197214973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c.8c5b54f6-b0f3-41af-b0f1-feafdf4175f3" returned: 0 in 0.795s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:17 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-1d9dbe40-c072-454d-a912-761b2cbce4cc tempest-VolumesGetTest-197214973 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c.8c5b54f6-b0f3-41af-b0f1-feafdf4175f3 is being set with open permissions: ugo+rw Jul 10 10:09:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1d9dbe40-c072-454d-a912-761b2cbce4cc tempest-VolumesGetTest-197214973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c.8c5b54f6-b0f3-41af-b0f1-feafdf4175f3 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:17 devstack sudo[94311]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:17 devstack sudo[94324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c.8c5b54f6-b0f3-41af-b0f1-feafdf4175f3 Jul 10 10:09:17 devstack sudo[94324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f42490f4-f735-471d-bf7c-11450ffbd4ff tempest-VolumesListTestJSON-751308652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.687s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:17 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-f42490f4-f735-471d-bf7c-11450ffbd4ff tempest-VolumesListTestJSON-751308652 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:09:17 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-f42490f4-f735-471d-bf7c-11450ffbd4ff tempest-VolumesListTestJSON-751308652 None] Deleted volume successfully. Jul 10 10:09:17 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f42490f4-f735-471d-bf7c-11450ffbd4ff tempest-VolumesListTestJSON-751308652 None] Lock "cinder-05db0b1a-bab7-4167-b89f-3f97d168a8a2-delete_volume" released by "delete_volume" :: held 2.476s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:09:18 devstack sudo[94318]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:18 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-84e01d78-d390-4532-be09-abab86c2a3d7 tempest-SnapshotsActionsTest-453962261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.4a09a977-29a9-4850-a9ac-513519df4227" returned: 0 in 0.902s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:18 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-84e01d78-d390-4532-be09-abab86c2a3d7 tempest-SnapshotsActionsTest-453962261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.4a09a977-29a9-4850-a9ac-513519df4227 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:18 devstack sudo[94331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.4a09a977-29a9-4850-a9ac-513519df4227 Jul 10 10:09:18 devstack sudo[94331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:18 devstack sudo[94324]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:18 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1d9dbe40-c072-454d-a912-761b2cbce4cc tempest-VolumesGetTest-197214973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c.8c5b54f6-b0f3-41af-b0f1-feafdf4175f3" returned: 0 in 0.783s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:18 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1d9dbe40-c072-454d-a912-761b2cbce4cc tempest-VolumesGetTest-197214973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:18 devstack sudo[94334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c.info Jul 10 10:09:18 devstack sudo[94334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:19 devstack sudo[94331]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:19 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-84e01d78-d390-4532-be09-abab86c2a3d7 tempest-SnapshotsActionsTest-453962261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.4a09a977-29a9-4850-a9ac-513519df4227" returned: 0 in 0.716s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:19 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-84e01d78-d390-4532-be09-abab86c2a3d7 tempest-SnapshotsActionsTest-453962261 None] Lock "cinder-quobyte-4a09a977-29a9-4850-a9ac-513519df4227" released by "_delete_snapshot" :: held 3.342s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:09:19 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-84e01d78-d390-4532-be09-abab86c2a3d7 tempest-SnapshotsActionsTest-453962261 None] Lock "cinder-quobyte-c136b0f5-b6de-4617-8094-382c31e31841" released by "delete_snapshot" :: held 3.372s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:09:19 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-84e01d78-d390-4532-be09-abab86c2a3d7 tempest-SnapshotsActionsTest-453962261 None] Created reservations ['6775b56a-423c-4d0e-88f4-3bf980324170', '8431eafc-c845-4ccc-9bb4-f9074d8af377', '62f857df-a42f-44a2-86e4-527f9c9c8ff9', '1360a37d-5ba3-4180-b01e-5a931fd381f9'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:09:19 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-84e01d78-d390-4532-be09-abab86c2a3d7 tempest-SnapshotsActionsTest-453962261 None] Delete snapshot completed successfully. Jul 10 10:09:19 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-84e01d78-d390-4532-be09-abab86c2a3d7 tempest-SnapshotsActionsTest-453962261 None] Lock "cinder-4a09a977-29a9-4850-a9ac-513519df4227-delete_snapshot" released by "delete_snapshot" :: held 3.529s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:09:19 devstack sudo[94334]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:19 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1d9dbe40-c072-454d-a912-761b2cbce4cc tempest-VolumesGetTest-197214973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c.info" returned: 0 in 0.755s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:19 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-1d9dbe40-c072-454d-a912-761b2cbce4cc tempest-VolumesGetTest-197214973 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c.info is being set with open permissions: ugo+rw Jul 10 10:09:19 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1d9dbe40-c072-454d-a912-761b2cbce4cc tempest-VolumesGetTest-197214973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:19 devstack sudo[94338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c.info Jul 10 10:09:19 devstack sudo[94338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:20 devstack sudo[94338]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:20 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1d9dbe40-c072-454d-a912-761b2cbce4cc tempest-VolumesGetTest-197214973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c.info" returned: 0 in 0.660s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:20 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-1d9dbe40-c072-454d-a912-761b2cbce4cc tempest-VolumesGetTest-197214973 None] Acquiring lock "cinder-quobyte-c8dcc8c2-b3f0-493a-8408-e05013c10dcb" by "_copy_volume_from_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:09:20 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-1d9dbe40-c072-454d-a912-761b2cbce4cc tempest-VolumesGetTest-197214973 None] Lock "cinder-quobyte-c8dcc8c2-b3f0-493a-8408-e05013c10dcb" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:09:20 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-1d9dbe40-c072-454d-a912-761b2cbce4cc tempest-VolumesGetTest-197214973 None] snapshot: 8c5b54f6-b0f3-41af-b0f1-feafdf4175f3, volume: c8dcc8c2-b3f0-493a-8408-e05013c10dcb, {{(pid=87234) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 10:09:20 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-1d9dbe40-c072-454d-a912-761b2cbce4cc tempest-VolumesGetTest-197214973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:09:20 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-1d9dbe40-c072-454d-a912-761b2cbce4cc tempest-VolumesGetTest-197214973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:09:20 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-1d9dbe40-c072-454d-a912-761b2cbce4cc tempest-VolumesGetTest-197214973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:09:20 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-1d9dbe40-c072-454d-a912-761b2cbce4cc tempest-VolumesGetTest-197214973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:09:20 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-1d9dbe40-c072-454d-a912-761b2cbce4cc tempest-VolumesGetTest-197214973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:09:20 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c040a8-beb8-4275-8d51-30831dfdcf40]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:09:20 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1d9dbe40-c072-454d-a912-761b2cbce4cc tempest-VolumesGetTest-197214973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c.8c5b54f6-b0f3-41af-b0f1-feafdf4175f3 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:20 devstack sudo[94342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c.8c5b54f6-b0f3-41af-b0f1-feafdf4175f3 Jul 10 10:09:20 devstack sudo[94342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:20 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f0a5f299-0245-40a0-bf5b-6291da243d2d tempest-SnapshotsActionsTest-852873252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:09:20 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-66cf0df0-89a5-4088-8b43-e80e7d7e6e21 tempest-VolumesSnapshotListTestJSON-1635654721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:09:20 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-66cf0df0-89a5-4088-8b43-e80e7d7e6e21 tempest-VolumesSnapshotListTestJSON-1635654721 None] Flow 'volume_create_manager' (a21f0822-00a2-4ff4-93a8-77cc25aa87d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:09:20 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-66cf0df0-89a5-4088-8b43-e80e7d7e6e21 tempest-VolumesSnapshotListTestJSON-1635654721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05bc3ae9-f2c0-4b31-b5b2-917ed34485d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:09:20 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-66cf0df0-89a5-4088-8b43-e80e7d7e6e21 tempest-VolumesSnapshotListTestJSON-1635654721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05bc3ae9-f2c0-4b31-b5b2-917ed34485d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:09:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1393355932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58dc29ee-e952-417f-ad88-34a62b59cb41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da4d4335c9514707b8647e88c64b8893',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:09:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:09:21Z,use_quota=True,user_id='ac5ed5cfd8034cb2be8406d1227ebb65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:09:20 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-66cf0df0-89a5-4088-8b43-e80e7d7e6e21 tempest-VolumesSnapshotListTestJSON-1635654721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23783d72-934d-47df-b91a-80641d141c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:09:20 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-66cf0df0-89a5-4088-8b43-e80e7d7e6e21 tempest-VolumesSnapshotListTestJSON-1635654721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23783d72-934d-47df-b91a-80641d141c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:09:20 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-66cf0df0-89a5-4088-8b43-e80e7d7e6e21 tempest-VolumesSnapshotListTestJSON-1635654721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3c7ff8c-73db-4c41-a39c-422394b65a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:09:20 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-66cf0df0-89a5-4088-8b43-e80e7d7e6e21 tempest-VolumesSnapshotListTestJSON-1635654721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3c7ff8c-73db-4c41-a39c-422394b65a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58dc29ee-e952-417f-ad88-34a62b59cb41', 'volume_name': 'volume-58dc29ee-e952-417f-ad88-34a62b59cb41', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:09:20 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-66cf0df0-89a5-4088-8b43-e80e7d7e6e21 tempest-VolumesSnapshotListTestJSON-1635654721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33557a38-861e-4854-986c-8a471e6b4f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:09:20 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-66cf0df0-89a5-4088-8b43-e80e7d7e6e21 tempest-VolumesSnapshotListTestJSON-1635654721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33557a38-861e-4854-986c-8a471e6b4f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:09:20 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-66cf0df0-89a5-4088-8b43-e80e7d7e6e21 tempest-VolumesSnapshotListTestJSON-1635654721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cddf41e0-fbba-40c2-82d5-252b3e86622a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:09:20 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-66cf0df0-89a5-4088-8b43-e80e7d7e6e21 tempest-VolumesSnapshotListTestJSON-1635654721 None] Volume 58dc29ee-e952-417f-ad88-34a62b59cb41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58dc29ee-e952-417f-ad88-34a62b59cb41', 'volume_size': 1} Jul 10 10:09:20 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-66cf0df0-89a5-4088-8b43-e80e7d7e6e21 tempest-VolumesSnapshotListTestJSON-1635654721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:09:20 devstack sudo[94342]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:20 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1d9dbe40-c072-454d-a912-761b2cbce4cc tempest-VolumesGetTest-197214973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c.8c5b54f6-b0f3-41af-b0f1-feafdf4175f3" returned: 0 in 0.832s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:20 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-1d9dbe40-c072-454d-a912-761b2cbce4cc tempest-VolumesGetTest-197214973 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 10:09:20 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-1d9dbe40-c072-454d-a912-761b2cbce4cc tempest-VolumesGetTest-197214973 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c {{(pid=87234) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 10:09:20 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-1d9dbe40-c072-454d-a912-761b2cbce4cc tempest-VolumesGetTest-197214973 None] Creating direct copy from snapshot {{(pid=87234) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 10:09:20 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[65048c30-8574-41f3-aefd-a5aeea47e2dd]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:09:20 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1d9dbe40-c072-454d-a912-761b2cbce4cc tempest-VolumesGetTest-197214973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:21 devstack sudo[94347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c Jul 10 10:09:21 devstack sudo[94347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:21 devstack sudo[94347]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:21 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1d9dbe40-c072-454d-a912-761b2cbce4cc tempest-VolumesGetTest-197214973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c" returned: 0 in 0.775s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:21 devstack cinder-volume[87234]: DEBUG cinder.utils [None req-1d9dbe40-c072-454d-a912-761b2cbce4cc tempest-VolumesGetTest-197214973 None] Path /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c8dcc8c2-b3f0-493a-8408-e05013c10dcb not found in is_blk_device check {{(pid=87234) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 10:09:21 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1d9dbe40-c072-454d-a912-761b2cbce4cc tempest-VolumesGetTest-197214973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c8dcc8c2-b3f0-493a-8408-e05013c10dcb {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:21 devstack sudo[94352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c8dcc8c2-b3f0-493a-8408-e05013c10dcb Jul 10 10:09:21 devstack sudo[94352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:26 devstack sudo[94352]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1d9dbe40-c072-454d-a912-761b2cbce4cc tempest-VolumesGetTest-197214973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c8dcc8c2-b3f0-493a-8408-e05013c10dcb" returned: 0 in 4.642s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:26 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[60fd155c-fb15-4bfe-b567-69d7e40347a6]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:09:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1d9dbe40-c072-454d-a912-761b2cbce4cc tempest-VolumesGetTest-197214973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:26 devstack sudo[94370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c Jul 10 10:09:26 devstack sudo[94370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:27 devstack sudo[94370]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1d9dbe40-c072-454d-a912-761b2cbce4cc tempest-VolumesGetTest-197214973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c" returned: 0 in 0.928s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:27 devstack cinder-volume[87234]: DEBUG cinder.image.image_utils [None req-1d9dbe40-c072-454d-a912-761b2cbce4cc tempest-VolumesGetTest-197214973 None] Image conversion details: src /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c, size 1024.00 MB, duration 4.64 sec, destination /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c8dcc8c2-b3f0-493a-8408-e05013c10dcb {{(pid=87234) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 10:09:27 devstack cinder-volume[87234]: INFO cinder.image.image_utils [None req-1d9dbe40-c072-454d-a912-761b2cbce4cc tempest-VolumesGetTest-197214973 None] Converted 1024.00 MB image at 220.54 MB/s Jul 10 10:09:27 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-1d9dbe40-c072-454d-a912-761b2cbce4cc tempest-VolumesGetTest-197214973 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c8dcc8c2-b3f0-493a-8408-e05013c10dcb is being set with open permissions: ugo+rw Jul 10 10:09:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1d9dbe40-c072-454d-a912-761b2cbce4cc tempest-VolumesGetTest-197214973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c8dcc8c2-b3f0-493a-8408-e05013c10dcb {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:27 devstack sudo[94376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c8dcc8c2-b3f0-493a-8408-e05013c10dcb Jul 10 10:09:27 devstack sudo[94376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:27 devstack sudo[94376]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1d9dbe40-c072-454d-a912-761b2cbce4cc tempest-VolumesGetTest-197214973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c8dcc8c2-b3f0-493a-8408-e05013c10dcb" returned: 0 in 0.667s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:28 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-1d9dbe40-c072-454d-a912-761b2cbce4cc tempest-VolumesGetTest-197214973 None] Lock "cinder-quobyte-c8dcc8c2-b3f0-493a-8408-e05013c10dcb" released by "_copy_volume_from_snapshot" :: held 7.934s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:09:28 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-1d9dbe40-c072-454d-a912-761b2cbce4cc tempest-VolumesGetTest-197214973 None] Acquiring lock "cinder-quobyte-8c5b54f6-b0f3-41af-b0f1-feafdf4175f3" by "_delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:09:28 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-1d9dbe40-c072-454d-a912-761b2cbce4cc tempest-VolumesGetTest-197214973 None] Lock "cinder-quobyte-8c5b54f6-b0f3-41af-b0f1-feafdf4175f3" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:09:28 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-1d9dbe40-c072-454d-a912-761b2cbce4cc tempest-VolumesGetTest-197214973 None] Deleting offline snapshot 8c5b54f6-b0f3-41af-b0f1-feafdf4175f3 of volume 5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 10:09:28 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-1d9dbe40-c072-454d-a912-761b2cbce4cc tempest-VolumesGetTest-197214973 None] snapshot_file for this snap is: volume-5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c.8c5b54f6-b0f3-41af-b0f1-feafdf4175f3 {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 10:09:28 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ae9116-c330-4fdd-ac84-354731783bfa]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:09:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1d9dbe40-c072-454d-a912-761b2cbce4cc tempest-VolumesGetTest-197214973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c.8c5b54f6-b0f3-41af-b0f1-feafdf4175f3 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:28 devstack sudo[94385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c.8c5b54f6-b0f3-41af-b0f1-feafdf4175f3 Jul 10 10:09:28 devstack sudo[94385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:29 devstack sudo[94385]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:29 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1d9dbe40-c072-454d-a912-761b2cbce4cc tempest-VolumesGetTest-197214973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c.8c5b54f6-b0f3-41af-b0f1-feafdf4175f3" returned: 0 in 0.940s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:29 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-1d9dbe40-c072-454d-a912-761b2cbce4cc tempest-VolumesGetTest-197214973 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 10:09:29 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4fc6f9-aece-440a-ae08-f424f58ea15b]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:09:29 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1d9dbe40-c072-454d-a912-761b2cbce4cc tempest-VolumesGetTest-197214973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:29 devstack sudo[94414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c Jul 10 10:09:29 devstack sudo[94414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:29 devstack sudo[94414]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:29 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1d9dbe40-c072-454d-a912-761b2cbce4cc tempest-VolumesGetTest-197214973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c" returned: 0 in 0.790s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:29 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1d9dbe40-c072-454d-a912-761b2cbce4cc tempest-VolumesGetTest-197214973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c.8c5b54f6-b0f3-41af-b0f1-feafdf4175f3 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:29 devstack sudo[94421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c.8c5b54f6-b0f3-41af-b0f1-feafdf4175f3 Jul 10 10:09:29 devstack sudo[94421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:30 devstack sudo[94421]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1d9dbe40-c072-454d-a912-761b2cbce4cc tempest-VolumesGetTest-197214973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c.8c5b54f6-b0f3-41af-b0f1-feafdf4175f3" returned: 0 in 0.731s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1d9dbe40-c072-454d-a912-761b2cbce4cc tempest-VolumesGetTest-197214973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c.8c5b54f6-b0f3-41af-b0f1-feafdf4175f3 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:30 devstack sudo[94427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c.8c5b54f6-b0f3-41af-b0f1-feafdf4175f3 Jul 10 10:09:30 devstack sudo[94427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:30 devstack cinder-volume[87234]: DEBUG dbcounter [-] [87234] Writing DB stats cinder:SELECT=96,cinder:UPDATE=107,cinder:INSERT=23,cinder:DELETE=12 {{(pid=87234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 10:09:31 devstack sudo[94427]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1d9dbe40-c072-454d-a912-761b2cbce4cc tempest-VolumesGetTest-197214973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c.8c5b54f6-b0f3-41af-b0f1-feafdf4175f3" returned: 0 in 0.642s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:31 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-1d9dbe40-c072-454d-a912-761b2cbce4cc tempest-VolumesGetTest-197214973 None] Lock "cinder-quobyte-8c5b54f6-b0f3-41af-b0f1-feafdf4175f3" released by "_delete_snapshot" :: held 3.207s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:09:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-1d9dbe40-c072-454d-a912-761b2cbce4cc tempest-VolumesGetTest-197214973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.200s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:09:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f0a5f299-0245-40a0-bf5b-6291da243d2d tempest-SnapshotsActionsTest-852873252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.642s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:09:31 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1d9dbe40-c072-454d-a912-761b2cbce4cc tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (786d09d1-97e7-4f68-9fcf-721d341d7847) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8dcc8c2-b3f0-493a-8408-e05013c10dcb', 'volume_size': 1, 'source_volid': '5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c', 'source_volstatus': 'available'}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:09:31 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1d9dbe40-c072-454d-a912-761b2cbce4cc tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d818ef4-83a9-4b51-af46-61a1ae338cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:09:31 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-f0a5f299-0245-40a0-bf5b-6291da243d2d tempest-SnapshotsActionsTest-852873252 None] Creating offline snapshot c4ada49d-e840-4030-a156-464b52b6c978 of volume c136b0f5-b6de-4617-8094-382c31e31841 {{(pid=87234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 10:09:31 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-1d9dbe40-c072-454d-a912-761b2cbce4cc tempest-VolumesGetTest-197214973 None] Volume volume-c8dcc8c2-b3f0-493a-8408-e05013c10dcb (c8dcc8c2-b3f0-493a-8408-e05013c10dcb): created successfully Jul 10 10:09:31 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1d9dbe40-c072-454d-a912-761b2cbce4cc tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d818ef4-83a9-4b51-af46-61a1ae338cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:09:31 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1d9dbe40-c072-454d-a912-761b2cbce4cc tempest-VolumesGetTest-197214973 None] Flow 'volume_create_manager' (52549642-b197-4cea-81c1-f692b8751656) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:09:31 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce1587b-747e-4848-bc4f-0f2f88ffa37e]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:09:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f0a5f299-0245-40a0-bf5b-6291da243d2d tempest-SnapshotsActionsTest-852873252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.b47c4fb0-9be6-4004-ac87-3d46de908169 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:31 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-1d9dbe40-c072-454d-a912-761b2cbce4cc tempest-VolumesGetTest-197214973 None] Created volume successfully. Jul 10 10:09:31 devstack sudo[94430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.b47c4fb0-9be6-4004-ac87-3d46de908169 Jul 10 10:09:31 devstack sudo[94430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:32 devstack sudo[94430]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:32 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f0a5f299-0245-40a0-bf5b-6291da243d2d tempest-SnapshotsActionsTest-852873252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.b47c4fb0-9be6-4004-ac87-3d46de908169" returned: 0 in 0.764s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:32 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-f0a5f299-0245-40a0-bf5b-6291da243d2d tempest-SnapshotsActionsTest-852873252 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c136b0f5-b6de-4617-8094-382c31e31841(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 10:09:32 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f0a5f299-0245-40a0-bf5b-6291da243d2d tempest-SnapshotsActionsTest-852873252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.b47c4fb0-9be6-4004-ac87-3d46de908169,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.c4ada49d-e840-4030-a156-464b52b6c978 1G {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:32 devstack sudo[94435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.b47c4fb0-9be6-4004-ac87-3d46de908169,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.c4ada49d-e840-4030-a156-464b52b6c978 1G Jul 10 10:09:32 devstack sudo[94435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:32 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bc7cf09-a664-4a03-a28f-f8dfef63b5f3 tempest-VolumesGetTest-197214973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:09:32 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-2bc7cf09-a664-4a03-a28f-f8dfef63b5f3 tempest-VolumesGetTest-197214973 None] Flow 'volume_create_manager' (bd6f69bd-6ff6-46b6-8335-9c5c9f9f650a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:09:32 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-2bc7cf09-a664-4a03-a28f-f8dfef63b5f3 tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (830cc449-72ea-4318-8ad6-1014e1148c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:09:32 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-2bc7cf09-a664-4a03-a28f-f8dfef63b5f3 tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (830cc449-72ea-4318-8ad6-1014e1148c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:09:32Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2023228540',display_name='tempest-VolumesGetTest-Volume-1170013322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcabaed9-ca76-4022-a063-9b6aa4b9e3bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6e1b243e2ee4fa3bf1c3dda0bf8b5da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:09:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:09:33Z,use_quota=True,user_id='683315fe0f3a4835aed6459f8e52b1dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:09:32 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-2bc7cf09-a664-4a03-a28f-f8dfef63b5f3 tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4617bd4-c823-45f9-baee-c9ae567129a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:09:32 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-2bc7cf09-a664-4a03-a28f-f8dfef63b5f3 tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4617bd4-c823-45f9-baee-c9ae567129a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:09:32 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-2bc7cf09-a664-4a03-a28f-f8dfef63b5f3 tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9471bc39-28cb-4d1a-8acf-8d05e6ecdb3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:09:32 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-2bc7cf09-a664-4a03-a28f-f8dfef63b5f3 tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9471bc39-28cb-4d1a-8acf-8d05e6ecdb3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcabaed9-ca76-4022-a063-9b6aa4b9e3bf', 'volume_name': 'volume-fcabaed9-ca76-4022-a063-9b6aa4b9e3bf', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:09:32 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-2bc7cf09-a664-4a03-a28f-f8dfef63b5f3 tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7d1382c-ff8c-47ee-8e86-3963a6489637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:09:32 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-2bc7cf09-a664-4a03-a28f-f8dfef63b5f3 tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7d1382c-ff8c-47ee-8e86-3963a6489637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:09:32 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-2bc7cf09-a664-4a03-a28f-f8dfef63b5f3 tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbe8ec94-5e16-4325-8762-1c7d97747931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:09:32 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-2bc7cf09-a664-4a03-a28f-f8dfef63b5f3 tempest-VolumesGetTest-197214973 None] Volume fcabaed9-ca76-4022-a063-9b6aa4b9e3bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcabaed9-ca76-4022-a063-9b6aa4b9e3bf', 'volume_size': 1} Jul 10 10:09:32 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-2bc7cf09-a664-4a03-a28f-f8dfef63b5f3 tempest-VolumesGetTest-197214973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:09:33 devstack sudo[94435]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f0a5f299-0245-40a0-bf5b-6291da243d2d tempest-SnapshotsActionsTest-852873252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.b47c4fb0-9be6-4004-ac87-3d46de908169,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.c4ada49d-e840-4030-a156-464b52b6c978 1G" returned: 0 in 0.883s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f0a5f299-0245-40a0-bf5b-6291da243d2d tempest-SnapshotsActionsTest-852873252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c136b0f5-b6de-4617-8094-382c31e31841.b47c4fb0-9be6-4004-ac87-3d46de908169 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.c4ada49d-e840-4030-a156-464b52b6c978 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:33 devstack sudo[94441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c136b0f5-b6de-4617-8094-382c31e31841.b47c4fb0-9be6-4004-ac87-3d46de908169 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.c4ada49d-e840-4030-a156-464b52b6c978 Jul 10 10:09:33 devstack sudo[94441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:33 devstack sudo[94441]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f0a5f299-0245-40a0-bf5b-6291da243d2d tempest-SnapshotsActionsTest-852873252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c136b0f5-b6de-4617-8094-382c31e31841.b47c4fb0-9be6-4004-ac87-3d46de908169 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.c4ada49d-e840-4030-a156-464b52b6c978" returned: 0 in 0.708s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:33 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-f0a5f299-0245-40a0-bf5b-6291da243d2d tempest-SnapshotsActionsTest-852873252 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.c4ada49d-e840-4030-a156-464b52b6c978 is being set with open permissions: ugo+rw Jul 10 10:09:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f0a5f299-0245-40a0-bf5b-6291da243d2d tempest-SnapshotsActionsTest-852873252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.c4ada49d-e840-4030-a156-464b52b6c978 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:33 devstack sudo[94446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.c4ada49d-e840-4030-a156-464b52b6c978 Jul 10 10:09:33 devstack sudo[94446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:34 devstack sudo[94446]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:34 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f0a5f299-0245-40a0-bf5b-6291da243d2d tempest-SnapshotsActionsTest-852873252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.c4ada49d-e840-4030-a156-464b52b6c978" returned: 0 in 0.674s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:34 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f0a5f299-0245-40a0-bf5b-6291da243d2d tempest-SnapshotsActionsTest-852873252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.170s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:09:34 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-66cf0df0-89a5-4088-8b43-e80e7d7e6e21 tempest-VolumesSnapshotListTestJSON-1635654721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.728s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:09:34 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-66cf0df0-89a5-4088-8b43-e80e7d7e6e21 tempest-VolumesSnapshotListTestJSON-1635654721 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:09:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1393355932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58dc29ee-e952-417f-ad88-34a62b59cb41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da4d4335c9514707b8647e88c64b8893',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:09:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:09:21Z,use_quota=True,user_id='ac5ed5cfd8034cb2be8406d1227ebb65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:09:34 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-66cf0df0-89a5-4088-8b43-e80e7d7e6e21 tempest-VolumesSnapshotListTestJSON-1635654721 None] Creating volume 58dc29ee-e952-417f-ad88-34a62b59cb41 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:09:34 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-66cf0df0-89a5-4088-8b43-e80e7d7e6e21 tempest-VolumesSnapshotListTestJSON-1635654721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:09:34 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-66cf0df0-89a5-4088-8b43-e80e7d7e6e21 tempest-VolumesSnapshotListTestJSON-1635654721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:09:34 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-66cf0df0-89a5-4088-8b43-e80e7d7e6e21 tempest-VolumesSnapshotListTestJSON-1635654721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:09:34 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-66cf0df0-89a5-4088-8b43-e80e7d7e6e21 tempest-VolumesSnapshotListTestJSON-1635654721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:09:34 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-66cf0df0-89a5-4088-8b43-e80e7d7e6e21 tempest-VolumesSnapshotListTestJSON-1635654721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:09:34 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-66cf0df0-89a5-4088-8b43-e80e7d7e6e21 tempest-VolumesSnapshotListTestJSON-1635654721 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:09:34 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-66cf0df0-89a5-4088-8b43-e80e7d7e6e21 tempest-VolumesSnapshotListTestJSON-1635654721 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:09:34 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-66cf0df0-89a5-4088-8b43-e80e7d7e6e21 tempest-VolumesSnapshotListTestJSON-1635654721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:34 devstack sudo[94449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41 1073741824 Jul 10 10:09:34 devstack sudo[94449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:34 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-f0a5f299-0245-40a0-bf5b-6291da243d2d tempest-SnapshotsActionsTest-852873252 None] Create snapshot completed successfully Jul 10 10:09:35 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-138465ff-28cd-4c30-a90e-396d40422eb7 tempest-SnapshotsActionsTest-453962261 None] Acquiring lock "cinder-c4ada49d-e840-4030-a156-464b52b6c978-delete_snapshot" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:09:35 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-138465ff-28cd-4c30-a90e-396d40422eb7 tempest-SnapshotsActionsTest-453962261 None] Lock "cinder-c4ada49d-e840-4030-a156-464b52b6c978-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:09:35 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-138465ff-28cd-4c30-a90e-396d40422eb7 tempest-SnapshotsActionsTest-453962261 None] Acquiring lock "cinder-quobyte-c136b0f5-b6de-4617-8094-382c31e31841" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:09:35 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-138465ff-28cd-4c30-a90e-396d40422eb7 tempest-SnapshotsActionsTest-453962261 None] Lock "cinder-quobyte-c136b0f5-b6de-4617-8094-382c31e31841" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:09:35 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-138465ff-28cd-4c30-a90e-396d40422eb7 tempest-SnapshotsActionsTest-453962261 None] Acquiring lock "cinder-quobyte-c4ada49d-e840-4030-a156-464b52b6c978" by "_delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:09:35 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-138465ff-28cd-4c30-a90e-396d40422eb7 tempest-SnapshotsActionsTest-453962261 None] Lock "cinder-quobyte-c4ada49d-e840-4030-a156-464b52b6c978" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:09:35 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-138465ff-28cd-4c30-a90e-396d40422eb7 tempest-SnapshotsActionsTest-453962261 None] Deleting offline snapshot c4ada49d-e840-4030-a156-464b52b6c978 of volume c136b0f5-b6de-4617-8094-382c31e31841 {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 10:09:35 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-138465ff-28cd-4c30-a90e-396d40422eb7 tempest-SnapshotsActionsTest-453962261 None] snapshot_file for this snap is: volume-c136b0f5-b6de-4617-8094-382c31e31841.c4ada49d-e840-4030-a156-464b52b6c978 {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 10:09:35 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[c735c18a-977f-4436-8bd4-7bb4a0a14572]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:09:35 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-138465ff-28cd-4c30-a90e-396d40422eb7 tempest-SnapshotsActionsTest-453962261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.c4ada49d-e840-4030-a156-464b52b6c978 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:35 devstack sudo[94449]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:35 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-66cf0df0-89a5-4088-8b43-e80e7d7e6e21 tempest-VolumesSnapshotListTestJSON-1635654721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41 1073741824" returned: 0 in 0.983s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:35 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-66cf0df0-89a5-4088-8b43-e80e7d7e6e21 tempest-VolumesSnapshotListTestJSON-1635654721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:35 devstack sudo[94456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41 Jul 10 10:09:35 devstack sudo[94456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:35 devstack sudo[94455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.c4ada49d-e840-4030-a156-464b52b6c978 Jul 10 10:09:35 devstack sudo[94455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:36 devstack sudo[94456]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:36 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-66cf0df0-89a5-4088-8b43-e80e7d7e6e21 tempest-VolumesSnapshotListTestJSON-1635654721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41" returned: 0 in 0.710s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:36 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-66cf0df0-89a5-4088-8b43-e80e7d7e6e21 tempest-VolumesSnapshotListTestJSON-1635654721 None] <== create_volume: return (1752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:09:36 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-66cf0df0-89a5-4088-8b43-e80e7d7e6e21 tempest-VolumesSnapshotListTestJSON-1635654721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.755s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:09:36 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-2bc7cf09-a664-4a03-a28f-f8dfef63b5f3 tempest-VolumesGetTest-197214973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.319s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:09:36 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-2bc7cf09-a664-4a03-a28f-f8dfef63b5f3 tempest-VolumesGetTest-197214973 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:09:32Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2023228540',display_name='tempest-VolumesGetTest-Volume-1170013322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcabaed9-ca76-4022-a063-9b6aa4b9e3bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6e1b243e2ee4fa3bf1c3dda0bf8b5da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:09:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:09:33Z,use_quota=True,user_id='683315fe0f3a4835aed6459f8e52b1dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:09:36 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-2bc7cf09-a664-4a03-a28f-f8dfef63b5f3 tempest-VolumesGetTest-197214973 None] Creating volume fcabaed9-ca76-4022-a063-9b6aa4b9e3bf {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:09:36 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-2bc7cf09-a664-4a03-a28f-f8dfef63b5f3 tempest-VolumesGetTest-197214973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:09:36 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-2bc7cf09-a664-4a03-a28f-f8dfef63b5f3 tempest-VolumesGetTest-197214973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:09:36 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-2bc7cf09-a664-4a03-a28f-f8dfef63b5f3 tempest-VolumesGetTest-197214973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:09:36 devstack sudo[94455]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:36 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-2bc7cf09-a664-4a03-a28f-f8dfef63b5f3 tempest-VolumesGetTest-197214973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:09:36 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-2bc7cf09-a664-4a03-a28f-f8dfef63b5f3 tempest-VolumesGetTest-197214973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:09:36 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-2bc7cf09-a664-4a03-a28f-f8dfef63b5f3 tempest-VolumesGetTest-197214973 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:09:36 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-2bc7cf09-a664-4a03-a28f-f8dfef63b5f3 tempest-VolumesGetTest-197214973 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:09:36 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-2bc7cf09-a664-4a03-a28f-f8dfef63b5f3 tempest-VolumesGetTest-197214973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-fcabaed9-ca76-4022-a063-9b6aa4b9e3bf 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:36 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-138465ff-28cd-4c30-a90e-396d40422eb7 tempest-SnapshotsActionsTest-453962261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.c4ada49d-e840-4030-a156-464b52b6c978" returned: 0 in 0.852s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:36 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-138465ff-28cd-4c30-a90e-396d40422eb7 tempest-SnapshotsActionsTest-453962261 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c136b0f5-b6de-4617-8094-382c31e31841(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 10:09:36 devstack sudo[94463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-fcabaed9-ca76-4022-a063-9b6aa4b9e3bf 1073741824 Jul 10 10:09:36 devstack sudo[94463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:36 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-66cf0df0-89a5-4088-8b43-e80e7d7e6e21 tempest-VolumesSnapshotListTestJSON-1635654721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cddf41e0-fbba-40c2-82d5-252b3e86622a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58dc29ee-e952-417f-ad88-34a62b59cb41', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:09:36 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-66cf0df0-89a5-4088-8b43-e80e7d7e6e21 tempest-VolumesSnapshotListTestJSON-1635654721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b16923ab-e5ba-49e2-9f2e-0a6c4a86d3eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:09:36 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea067e3-751c-42ed-a343-2ed2686ab013]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:09:36 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-138465ff-28cd-4c30-a90e-396d40422eb7 tempest-SnapshotsActionsTest-453962261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.b47c4fb0-9be6-4004-ac87-3d46de908169 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:36 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-66cf0df0-89a5-4088-8b43-e80e7d7e6e21 tempest-VolumesSnapshotListTestJSON-1635654721 None] Volume volume-58dc29ee-e952-417f-ad88-34a62b59cb41 (58dc29ee-e952-417f-ad88-34a62b59cb41): created successfully Jul 10 10:09:36 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-66cf0df0-89a5-4088-8b43-e80e7d7e6e21 tempest-VolumesSnapshotListTestJSON-1635654721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b16923ab-e5ba-49e2-9f2e-0a6c4a86d3eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:09:36 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-66cf0df0-89a5-4088-8b43-e80e7d7e6e21 tempest-VolumesSnapshotListTestJSON-1635654721 None] Flow 'volume_create_manager' (a21f0822-00a2-4ff4-93a8-77cc25aa87d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:09:36 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-66cf0df0-89a5-4088-8b43-e80e7d7e6e21 tempest-VolumesSnapshotListTestJSON-1635654721 None] Created volume successfully. Jul 10 10:09:36 devstack sudo[94465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.b47c4fb0-9be6-4004-ac87-3d46de908169 Jul 10 10:09:36 devstack sudo[94465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:37 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-39db4c3f-2598-43b4-aeab-e9c1a050b82d tempest-VolumesSnapshotListTestJSON-1635654721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:09:37 devstack sudo[94465]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:37 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-138465ff-28cd-4c30-a90e-396d40422eb7 tempest-SnapshotsActionsTest-453962261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.b47c4fb0-9be6-4004-ac87-3d46de908169" returned: 0 in 0.929s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:37 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-138465ff-28cd-4c30-a90e-396d40422eb7 tempest-SnapshotsActionsTest-453962261 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c136b0f5-b6de-4617-8094-382c31e31841(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 10:09:37 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-138465ff-28cd-4c30-a90e-396d40422eb7 tempest-SnapshotsActionsTest-453962261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.c4ada49d-e840-4030-a156-464b52b6c978 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:37 devstack sudo[94463]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:37 devstack sudo[94475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.c4ada49d-e840-4030-a156-464b52b6c978 Jul 10 10:09:37 devstack sudo[94475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:37 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-2bc7cf09-a664-4a03-a28f-f8dfef63b5f3 tempest-VolumesGetTest-197214973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-fcabaed9-ca76-4022-a063-9b6aa4b9e3bf 1073741824" returned: 0 in 1.034s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:37 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-2bc7cf09-a664-4a03-a28f-f8dfef63b5f3 tempest-VolumesGetTest-197214973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-fcabaed9-ca76-4022-a063-9b6aa4b9e3bf {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:37 devstack sudo[94477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-fcabaed9-ca76-4022-a063-9b6aa4b9e3bf Jul 10 10:09:37 devstack sudo[94477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:38 devstack sudo[94477]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-2bc7cf09-a664-4a03-a28f-f8dfef63b5f3 tempest-VolumesGetTest-197214973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-fcabaed9-ca76-4022-a063-9b6aa4b9e3bf" returned: 0 in 0.708s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:38 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-2bc7cf09-a664-4a03-a28f-f8dfef63b5f3 tempest-VolumesGetTest-197214973 None] <== create_volume: return (1793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:09:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-2bc7cf09-a664-4a03-a28f-f8dfef63b5f3 tempest-VolumesGetTest-197214973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.798s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:09:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-39db4c3f-2598-43b4-aeab-e9c1a050b82d tempest-VolumesSnapshotListTestJSON-1635654721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.842s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:09:38 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-2bc7cf09-a664-4a03-a28f-f8dfef63b5f3 tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbe8ec94-5e16-4325-8762-1c7d97747931) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcabaed9-ca76-4022-a063-9b6aa4b9e3bf', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:09:38 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-2bc7cf09-a664-4a03-a28f-f8dfef63b5f3 tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2d93fd6-1f3f-4a2b-9620-d34e27ea335d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:09:38 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-39db4c3f-2598-43b4-aeab-e9c1a050b82d tempest-VolumesSnapshotListTestJSON-1635654721 None] Creating offline snapshot 0c44a94b-72c2-47b8-9182-f96bbb76fbdc of volume 58dc29ee-e952-417f-ad88-34a62b59cb41 {{(pid=87234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 10:09:38 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-2bc7cf09-a664-4a03-a28f-f8dfef63b5f3 tempest-VolumesGetTest-197214973 None] Volume volume-fcabaed9-ca76-4022-a063-9b6aa4b9e3bf (fcabaed9-ca76-4022-a063-9b6aa4b9e3bf): created successfully Jul 10 10:09:38 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-2bc7cf09-a664-4a03-a28f-f8dfef63b5f3 tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2d93fd6-1f3f-4a2b-9620-d34e27ea335d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:09:38 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-2bc7cf09-a664-4a03-a28f-f8dfef63b5f3 tempest-VolumesGetTest-197214973 None] Flow 'volume_create_manager' (bd6f69bd-6ff6-46b6-8335-9c5c9f9f650a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:09:38 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[34853c21-ac1f-45d7-8807-6bd13d778c89]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:09:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-39db4c3f-2598-43b4-aeab-e9c1a050b82d tempest-VolumesSnapshotListTestJSON-1635654721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:38 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-2bc7cf09-a664-4a03-a28f-f8dfef63b5f3 tempest-VolumesGetTest-197214973 None] Created volume successfully. Jul 10 10:09:38 devstack sudo[94475]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-138465ff-28cd-4c30-a90e-396d40422eb7 tempest-SnapshotsActionsTest-453962261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.c4ada49d-e840-4030-a156-464b52b6c978" returned: 0 in 0.938s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-138465ff-28cd-4c30-a90e-396d40422eb7 tempest-SnapshotsActionsTest-453962261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.c4ada49d-e840-4030-a156-464b52b6c978 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:38 devstack sudo[94487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.c4ada49d-e840-4030-a156-464b52b6c978 Jul 10 10:09:38 devstack sudo[94487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:38 devstack sudo[94486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41 Jul 10 10:09:38 devstack sudo[94486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:38 devstack sudo[94487]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-138465ff-28cd-4c30-a90e-396d40422eb7 tempest-SnapshotsActionsTest-453962261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.c4ada49d-e840-4030-a156-464b52b6c978" returned: 0 in 0.704s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:38 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-138465ff-28cd-4c30-a90e-396d40422eb7 tempest-SnapshotsActionsTest-453962261 None] Lock "cinder-quobyte-c4ada49d-e840-4030-a156-464b52b6c978" released by "_delete_snapshot" :: held 3.569s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:09:38 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-138465ff-28cd-4c30-a90e-396d40422eb7 tempest-SnapshotsActionsTest-453962261 None] Lock "cinder-quobyte-c136b0f5-b6de-4617-8094-382c31e31841" released by "delete_snapshot" :: held 3.608s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:09:38 devstack sudo[94486]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-39db4c3f-2598-43b4-aeab-e9c1a050b82d tempest-VolumesSnapshotListTestJSON-1635654721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41" returned: 0 in 0.839s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-39db4c3f-2598-43b4-aeab-e9c1a050b82d tempest-VolumesSnapshotListTestJSON-1635654721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.0c44a94b-72c2-47b8-9182-f96bbb76fbdc 1G {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:38 devstack sudo[94496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.0c44a94b-72c2-47b8-9182-f96bbb76fbdc 1G Jul 10 10:09:38 devstack sudo[94496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:38 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-138465ff-28cd-4c30-a90e-396d40422eb7 tempest-SnapshotsActionsTest-453962261 None] Created reservations ['199bdade-a0a8-45c2-94ac-7a1a0bb89310', '4808111a-25d1-4a64-aba4-2ab4720cda9b', '485c8aaa-db9a-49f1-8515-3ae3d7e9a7be', '381e156f-f5c4-4fa3-9e2f-0454edfa3a93'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:09:39 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-138465ff-28cd-4c30-a90e-396d40422eb7 tempest-SnapshotsActionsTest-453962261 None] Delete snapshot completed successfully. Jul 10 10:09:39 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-138465ff-28cd-4c30-a90e-396d40422eb7 tempest-SnapshotsActionsTest-453962261 None] Lock "cinder-c4ada49d-e840-4030-a156-464b52b6c978-delete_snapshot" released by "delete_snapshot" :: held 3.773s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:09:39 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-ce696d34-5a62-4521-8130-c2ebb64a5261 tempest-VolumesGetTest-197214973 None] Acquiring lock "cinder-fcabaed9-ca76-4022-a063-9b6aa4b9e3bf-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:09:39 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-ce696d34-5a62-4521-8130-c2ebb64a5261 tempest-VolumesGetTest-197214973 None] Lock "cinder-fcabaed9-ca76-4022-a063-9b6aa4b9e3bf-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:09:39 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-ce696d34-5a62-4521-8130-c2ebb64a5261 tempest-VolumesGetTest-197214973 None] Acquiring lock "cinder-quobyte-fcabaed9-ca76-4022-a063-9b6aa4b9e3bf" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:09:39 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-ce696d34-5a62-4521-8130-c2ebb64a5261 tempest-VolumesGetTest-197214973 None] Lock "cinder-quobyte-fcabaed9-ca76-4022-a063-9b6aa4b9e3bf" acquired by "delete_volume" :: waited 0.027s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:09:39 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e6a2fc-c6be-4633-8b91-87235c013554]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:09:39 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ce696d34-5a62-4521-8130-c2ebb64a5261 tempest-VolumesGetTest-197214973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-fcabaed9-ca76-4022-a063-9b6aa4b9e3bf {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:39 devstack sudo[94498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-fcabaed9-ca76-4022-a063-9b6aa4b9e3bf Jul 10 10:09:39 devstack sudo[94498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:39 devstack sudo[94496]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:39 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-39db4c3f-2598-43b4-aeab-e9c1a050b82d tempest-VolumesSnapshotListTestJSON-1635654721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.0c44a94b-72c2-47b8-9182-f96bbb76fbdc 1G" returned: 0 in 0.893s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:39 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-39db4c3f-2598-43b4-aeab-e9c1a050b82d tempest-VolumesSnapshotListTestJSON-1635654721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58dc29ee-e952-417f-ad88-34a62b59cb41 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.0c44a94b-72c2-47b8-9182-f96bbb76fbdc {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:39 devstack sudo[94504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58dc29ee-e952-417f-ad88-34a62b59cb41 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.0c44a94b-72c2-47b8-9182-f96bbb76fbdc Jul 10 10:09:39 devstack sudo[94504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:39 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-b4f50d84-a952-4bee-88b0-5486b19e6458 tempest-SnapshotsActionsTest-852873252 None] Acquiring lock "cinder-b47c4fb0-9be6-4004-ac87-3d46de908169-delete_snapshot" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:09:39 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-b4f50d84-a952-4bee-88b0-5486b19e6458 tempest-SnapshotsActionsTest-852873252 None] Lock "cinder-b47c4fb0-9be6-4004-ac87-3d46de908169-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:09:39 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-b4f50d84-a952-4bee-88b0-5486b19e6458 tempest-SnapshotsActionsTest-852873252 None] Acquiring lock "cinder-quobyte-c136b0f5-b6de-4617-8094-382c31e31841" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:09:39 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-b4f50d84-a952-4bee-88b0-5486b19e6458 tempest-SnapshotsActionsTest-852873252 None] Lock "cinder-quobyte-c136b0f5-b6de-4617-8094-382c31e31841" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:09:39 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-b4f50d84-a952-4bee-88b0-5486b19e6458 tempest-SnapshotsActionsTest-852873252 None] Acquiring lock "cinder-quobyte-b47c4fb0-9be6-4004-ac87-3d46de908169" by "_delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:09:39 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-b4f50d84-a952-4bee-88b0-5486b19e6458 tempest-SnapshotsActionsTest-852873252 None] Lock "cinder-quobyte-b47c4fb0-9be6-4004-ac87-3d46de908169" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:09:39 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-b4f50d84-a952-4bee-88b0-5486b19e6458 tempest-SnapshotsActionsTest-852873252 None] Deleting offline snapshot b47c4fb0-9be6-4004-ac87-3d46de908169 of volume c136b0f5-b6de-4617-8094-382c31e31841 {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 10:09:40 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-b4f50d84-a952-4bee-88b0-5486b19e6458 tempest-SnapshotsActionsTest-852873252 None] snapshot_file for this snap is: volume-c136b0f5-b6de-4617-8094-382c31e31841.b47c4fb0-9be6-4004-ac87-3d46de908169 {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 10:09:40 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b037f7-c2a3-4d52-9068-f367d030635d]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:09:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-b4f50d84-a952-4bee-88b0-5486b19e6458 tempest-SnapshotsActionsTest-852873252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.b47c4fb0-9be6-4004-ac87-3d46de908169 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:40 devstack sudo[94506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.b47c4fb0-9be6-4004-ac87-3d46de908169 Jul 10 10:09:40 devstack sudo[94506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:40 devstack sudo[94498]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ce696d34-5a62-4521-8130-c2ebb64a5261 tempest-VolumesGetTest-197214973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-fcabaed9-ca76-4022-a063-9b6aa4b9e3bf" returned: 0 in 0.872s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ce696d34-5a62-4521-8130-c2ebb64a5261 tempest-VolumesGetTest-197214973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-fcabaed9-ca76-4022-a063-9b6aa4b9e3bf {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:40 devstack sudo[94511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-fcabaed9-ca76-4022-a063-9b6aa4b9e3bf Jul 10 10:09:40 devstack sudo[94511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:40 devstack sudo[94504]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-39db4c3f-2598-43b4-aeab-e9c1a050b82d tempest-VolumesSnapshotListTestJSON-1635654721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58dc29ee-e952-417f-ad88-34a62b59cb41 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.0c44a94b-72c2-47b8-9182-f96bbb76fbdc" returned: 0 in 0.777s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:40 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-39db4c3f-2598-43b4-aeab-e9c1a050b82d tempest-VolumesSnapshotListTestJSON-1635654721 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.0c44a94b-72c2-47b8-9182-f96bbb76fbdc is being set with open permissions: ugo+rw Jul 10 10:09:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-39db4c3f-2598-43b4-aeab-e9c1a050b82d tempest-VolumesSnapshotListTestJSON-1635654721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.0c44a94b-72c2-47b8-9182-f96bbb76fbdc {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:40 devstack sudo[94516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.0c44a94b-72c2-47b8-9182-f96bbb76fbdc Jul 10 10:09:40 devstack sudo[94516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:40 devstack sudo[94506]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-b4f50d84-a952-4bee-88b0-5486b19e6458 tempest-SnapshotsActionsTest-852873252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.b47c4fb0-9be6-4004-ac87-3d46de908169" returned: 0 in 0.820s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:40 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-b4f50d84-a952-4bee-88b0-5486b19e6458 tempest-SnapshotsActionsTest-852873252 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c136b0f5-b6de-4617-8094-382c31e31841(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 10:09:40 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea60c44-784c-4312-98b3-fe474ed47285]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:09:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-b4f50d84-a952-4bee-88b0-5486b19e6458 tempest-SnapshotsActionsTest-852873252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:40 devstack sudo[94511]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ce696d34-5a62-4521-8130-c2ebb64a5261 tempest-VolumesGetTest-197214973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-fcabaed9-ca76-4022-a063-9b6aa4b9e3bf" returned: 0 in 0.734s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:41 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-ce696d34-5a62-4521-8130-c2ebb64a5261 tempest-VolumesGetTest-197214973 None] Lock "cinder-quobyte-fcabaed9-ca76-4022-a063-9b6aa4b9e3bf" released by "delete_volume" :: held 1.666s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:09:41 devstack cinder-volume[87234]: DEBUG dbcounter [-] [87234] Writing DB stats cinder:UPDATE=135,cinder:SELECT=90,cinder:INSERT=38,cinder:DELETE=12 {{(pid=87234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 10:09:41 devstack sudo[94522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841 Jul 10 10:09:41 devstack sudo[94522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:41 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-ce696d34-5a62-4521-8130-c2ebb64a5261 tempest-VolumesGetTest-197214973 None] Created reservations ['78241b3f-9332-4c66-b05d-8f04b44ae8dc', '3ea92271-44d2-4ae6-b4b1-1e74afed4676', '6de218aa-545c-41f4-b951-6ebd13b3923b', 'ffcb6ac7-09d7-4a0e-b45b-32a6aeb763a5'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:09:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-ce696d34-5a62-4521-8130-c2ebb64a5261 tempest-VolumesGetTest-197214973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:09:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-ce696d34-5a62-4521-8130-c2ebb64a5261 tempest-VolumesGetTest-197214973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:09:41 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-ce696d34-5a62-4521-8130-c2ebb64a5261 tempest-VolumesGetTest-197214973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:09:41 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-ce696d34-5a62-4521-8130-c2ebb64a5261 tempest-VolumesGetTest-197214973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:09:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-ce696d34-5a62-4521-8130-c2ebb64a5261 tempest-VolumesGetTest-197214973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:09:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ce696d34-5a62-4521-8130-c2ebb64a5261 tempest-VolumesGetTest-197214973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:41 devstack sudo[94524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:09:41 devstack sudo[94524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:41 devstack sudo[94516]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-39db4c3f-2598-43b4-aeab-e9c1a050b82d tempest-VolumesSnapshotListTestJSON-1635654721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.0c44a94b-72c2-47b8-9182-f96bbb76fbdc" returned: 0 in 0.708s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-39db4c3f-2598-43b4-aeab-e9c1a050b82d tempest-VolumesSnapshotListTestJSON-1635654721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:41 devstack sudo[94527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.info Jul 10 10:09:41 devstack sudo[94527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:41 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-aba437cb-71bb-4fab-8c29-a76dcc51d358 tempest-VolumesGetTest-197214973 None] Acquiring lock "cinder-c8dcc8c2-b3f0-493a-8408-e05013c10dcb-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:09:41 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-aba437cb-71bb-4fab-8c29-a76dcc51d358 tempest-VolumesGetTest-197214973 None] Lock "cinder-c8dcc8c2-b3f0-493a-8408-e05013c10dcb-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:09:41 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-aba437cb-71bb-4fab-8c29-a76dcc51d358 tempest-VolumesGetTest-197214973 None] Acquiring lock "cinder-quobyte-c8dcc8c2-b3f0-493a-8408-e05013c10dcb" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:09:41 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-aba437cb-71bb-4fab-8c29-a76dcc51d358 tempest-VolumesGetTest-197214973 None] Lock "cinder-quobyte-c8dcc8c2-b3f0-493a-8408-e05013c10dcb" acquired by "delete_volume" :: waited 0.025s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:09:41 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aef89e7-b1d3-4c72-9aa4-fe5283fcba92]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:09:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-aba437cb-71bb-4fab-8c29-a76dcc51d358 tempest-VolumesGetTest-197214973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c8dcc8c2-b3f0-493a-8408-e05013c10dcb {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:41 devstack sudo[94522]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-b4f50d84-a952-4bee-88b0-5486b19e6458 tempest-SnapshotsActionsTest-852873252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841" returned: 0 in 0.951s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-b4f50d84-a952-4bee-88b0-5486b19e6458 tempest-SnapshotsActionsTest-852873252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.b47c4fb0-9be6-4004-ac87-3d46de908169 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:41 devstack sudo[94534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.b47c4fb0-9be6-4004-ac87-3d46de908169 Jul 10 10:09:41 devstack sudo[94534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:41 devstack sudo[94532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c8dcc8c2-b3f0-493a-8408-e05013c10dcb Jul 10 10:09:41 devstack sudo[94532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:41 devstack sudo[94524]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ce696d34-5a62-4521-8130-c2ebb64a5261 tempest-VolumesGetTest-197214973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.776s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:41 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-ce696d34-5a62-4521-8130-c2ebb64a5261 tempest-VolumesGetTest-197214973 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:09:41 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-ce696d34-5a62-4521-8130-c2ebb64a5261 tempest-VolumesGetTest-197214973 None] Deleted volume successfully. Jul 10 10:09:41 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-ce696d34-5a62-4521-8130-c2ebb64a5261 tempest-VolumesGetTest-197214973 None] Lock "cinder-fcabaed9-ca76-4022-a063-9b6aa4b9e3bf-delete_volume" released by "delete_volume" :: held 2.670s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:09:42 devstack sudo[94527]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-39db4c3f-2598-43b4-aeab-e9c1a050b82d tempest-VolumesSnapshotListTestJSON-1635654721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.info" returned: 0 in 0.719s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:42 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-39db4c3f-2598-43b4-aeab-e9c1a050b82d tempest-VolumesSnapshotListTestJSON-1635654721 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.info is being set with open permissions: ugo+rw Jul 10 10:09:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-39db4c3f-2598-43b4-aeab-e9c1a050b82d tempest-VolumesSnapshotListTestJSON-1635654721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:42 devstack cinder-volume[87234]: DEBUG oslo_service.periodic_task [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 10:09:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:09:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:09:42 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:09:42 devstack sudo[94538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.info Jul 10 10:09:42 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:09:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:09:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:42 devstack sudo[94538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:42 devstack sudo[94540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:09:42 devstack sudo[94540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:42 devstack sudo[94532]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-aba437cb-71bb-4fab-8c29-a76dcc51d358 tempest-VolumesGetTest-197214973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c8dcc8c2-b3f0-493a-8408-e05013c10dcb" returned: 0 in 1.126s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-aba437cb-71bb-4fab-8c29-a76dcc51d358 tempest-VolumesGetTest-197214973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c8dcc8c2-b3f0-493a-8408-e05013c10dcb {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:42 devstack sudo[94534]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-b4f50d84-a952-4bee-88b0-5486b19e6458 tempest-SnapshotsActionsTest-852873252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.b47c4fb0-9be6-4004-ac87-3d46de908169" returned: 0 in 1.108s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-b4f50d84-a952-4bee-88b0-5486b19e6458 tempest-SnapshotsActionsTest-852873252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.b47c4fb0-9be6-4004-ac87-3d46de908169 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:42 devstack sudo[94549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c8dcc8c2-b3f0-493a-8408-e05013c10dcb Jul 10 10:09:42 devstack sudo[94549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:43 devstack sudo[94551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.b47c4fb0-9be6-4004-ac87-3d46de908169 Jul 10 10:09:43 devstack sudo[94551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:43 devstack sudo[94540]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.938s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:43 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:09:43 devstack cinder-volume[87234]: DEBUG oslo_service.periodic_task [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Running periodic task VolumeManager._thread_info {{(pid=87234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 10:09:43 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] thread count: 8 {{(pid=87234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 10:09:43 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] thread info: [<_MainThread(MainThread, started 131600773742720)>, , , , , , , ] {{(pid=87234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 10:09:43 devstack sudo[94538]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-39db4c3f-2598-43b4-aeab-e9c1a050b82d tempest-VolumesSnapshotListTestJSON-1635654721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.info" returned: 0 in 1.193s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-39db4c3f-2598-43b4-aeab-e9c1a050b82d tempest-VolumesSnapshotListTestJSON-1635654721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.268s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:09:43 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-39db4c3f-2598-43b4-aeab-e9c1a050b82d tempest-VolumesSnapshotListTestJSON-1635654721 None] Create snapshot completed successfully Jul 10 10:09:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-8f0dfd80-9db1-4e74-b650-20536ee19de5 tempest-VolumesSnapshotListTestJSON-1635654721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:09:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-8f0dfd80-9db1-4e74-b650-20536ee19de5 tempest-VolumesSnapshotListTestJSON-1635654721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:09:43 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-8f0dfd80-9db1-4e74-b650-20536ee19de5 tempest-VolumesSnapshotListTestJSON-1635654721 None] Creating offline snapshot 8c80c8d9-0289-4568-8b5f-5cfd44672af7 of volume 58dc29ee-e952-417f-ad88-34a62b59cb41 {{(pid=87234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 10:09:43 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f328854-cac0-4254-b483-4f3a15db0174]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:09:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-8f0dfd80-9db1-4e74-b650-20536ee19de5 tempest-VolumesSnapshotListTestJSON-1635654721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.0c44a94b-72c2-47b8-9182-f96bbb76fbdc {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:43 devstack sudo[94555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.0c44a94b-72c2-47b8-9182-f96bbb76fbdc Jul 10 10:09:43 devstack sudo[94555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:43 devstack sudo[94549]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-aba437cb-71bb-4fab-8c29-a76dcc51d358 tempest-VolumesGetTest-197214973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c8dcc8c2-b3f0-493a-8408-e05013c10dcb" returned: 0 in 1.059s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:43 devstack sudo[94551]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-b4f50d84-a952-4bee-88b0-5486b19e6458 tempest-SnapshotsActionsTest-852873252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841.b47c4fb0-9be6-4004-ac87-3d46de908169" returned: 0 in 1.038s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:44 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-aba437cb-71bb-4fab-8c29-a76dcc51d358 tempest-VolumesGetTest-197214973 None] Lock "cinder-quobyte-c8dcc8c2-b3f0-493a-8408-e05013c10dcb" released by "delete_volume" :: held 2.246s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:09:44 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-b4f50d84-a952-4bee-88b0-5486b19e6458 tempest-SnapshotsActionsTest-852873252 None] Lock "cinder-quobyte-b47c4fb0-9be6-4004-ac87-3d46de908169" released by "_delete_snapshot" :: held 4.061s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:09:44 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-b4f50d84-a952-4bee-88b0-5486b19e6458 tempest-SnapshotsActionsTest-852873252 None] Lock "cinder-quobyte-c136b0f5-b6de-4617-8094-382c31e31841" released by "delete_snapshot" :: held 4.097s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:09:44 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-aba437cb-71bb-4fab-8c29-a76dcc51d358 tempest-VolumesGetTest-197214973 None] Created reservations ['cffdb57f-2760-4ec0-a1d9-2fb35f49b0e6', '9b3741e8-ee1f-47d9-9015-c940634805f5', 'c07ff2bd-9b45-4fd9-bfc4-4dc9cf548141', 'b2635494-ee9c-44ed-843b-bf703a31c538'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:09:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-aba437cb-71bb-4fab-8c29-a76dcc51d358 tempest-VolumesGetTest-197214973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:09:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-aba437cb-71bb-4fab-8c29-a76dcc51d358 tempest-VolumesGetTest-197214973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:09:44 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-aba437cb-71bb-4fab-8c29-a76dcc51d358 tempest-VolumesGetTest-197214973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:09:44 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-aba437cb-71bb-4fab-8c29-a76dcc51d358 tempest-VolumesGetTest-197214973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:09:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-aba437cb-71bb-4fab-8c29-a76dcc51d358 tempest-VolumesGetTest-197214973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:09:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-aba437cb-71bb-4fab-8c29-a76dcc51d358 tempest-VolumesGetTest-197214973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:44 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-b4f50d84-a952-4bee-88b0-5486b19e6458 tempest-SnapshotsActionsTest-852873252 None] Created reservations ['191af057-737b-4506-9efc-c571871c4bc5', '136fa432-f54c-46dd-ba51-b1dc9d1aae63', '30caa5f1-f697-4ff3-b1b4-a0e092631fdf', '538f96f5-7778-42a9-81b9-1b9c03a4104e'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:09:44 devstack sudo[94559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:09:44 devstack sudo[94559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:44 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-b4f50d84-a952-4bee-88b0-5486b19e6458 tempest-SnapshotsActionsTest-852873252 None] Delete snapshot completed successfully. Jul 10 10:09:44 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-b4f50d84-a952-4bee-88b0-5486b19e6458 tempest-SnapshotsActionsTest-852873252 None] Lock "cinder-b47c4fb0-9be6-4004-ac87-3d46de908169-delete_snapshot" released by "delete_snapshot" :: held 4.406s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:09:44 devstack sudo[94555]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-8f0dfd80-9db1-4e74-b650-20536ee19de5 tempest-VolumesSnapshotListTestJSON-1635654721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.0c44a94b-72c2-47b8-9182-f96bbb76fbdc" returned: 0 in 1.006s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:44 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-8f0dfd80-9db1-4e74-b650-20536ee19de5 tempest-VolumesSnapshotListTestJSON-1635654721 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58dc29ee-e952-417f-ad88-34a62b59cb41(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 10:09:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-8f0dfd80-9db1-4e74-b650-20536ee19de5 tempest-VolumesSnapshotListTestJSON-1635654721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.0c44a94b-72c2-47b8-9182-f96bbb76fbdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.8c80c8d9-0289-4568-8b5f-5cfd44672af7 1G {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:44 devstack sudo[94578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.0c44a94b-72c2-47b8-9182-f96bbb76fbdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.8c80c8d9-0289-4568-8b5f-5cfd44672af7 1G Jul 10 10:09:44 devstack sudo[94578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:45 devstack sudo[94559]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-aba437cb-71bb-4fab-8c29-a76dcc51d358 tempest-VolumesGetTest-197214973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.883s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:45 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-aba437cb-71bb-4fab-8c29-a76dcc51d358 tempest-VolumesGetTest-197214973 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:09:45 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-aba437cb-71bb-4fab-8c29-a76dcc51d358 tempest-VolumesGetTest-197214973 None] Deleted volume successfully. Jul 10 10:09:45 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-e2eabf82-8bc2-41af-957b-2802b9768f4b tempest-VolumesGetTest-197214973 None] Acquiring lock "cinder-5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:09:45 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-e2eabf82-8bc2-41af-957b-2802b9768f4b tempest-VolumesGetTest-197214973 None] Lock "cinder-5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:09:45 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-aba437cb-71bb-4fab-8c29-a76dcc51d358 tempest-VolumesGetTest-197214973 None] Lock "cinder-c8dcc8c2-b3f0-493a-8408-e05013c10dcb-delete_volume" released by "delete_volume" :: held 3.549s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:09:45 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-e2eabf82-8bc2-41af-957b-2802b9768f4b tempest-VolumesGetTest-197214973 None] Acquiring lock "cinder-quobyte-5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:09:45 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-e2eabf82-8bc2-41af-957b-2802b9768f4b tempest-VolumesGetTest-197214973 None] Lock "cinder-quobyte-5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c" acquired by "delete_volume" :: waited 0.016s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:09:45 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f8af2d-a855-4b22-ad2c-0f21abf52d02]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:09:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e2eabf82-8bc2-41af-957b-2802b9768f4b tempest-VolumesGetTest-197214973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:45 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-5794ba8a-65fd-4909-9979-183913e14af3 tempest-SnapshotsActionsTest-852873252 None] Acquiring lock "cinder-c136b0f5-b6de-4617-8094-382c31e31841-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:09:45 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-5794ba8a-65fd-4909-9979-183913e14af3 tempest-SnapshotsActionsTest-852873252 None] Lock "cinder-c136b0f5-b6de-4617-8094-382c31e31841-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:09:45 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-5794ba8a-65fd-4909-9979-183913e14af3 tempest-SnapshotsActionsTest-852873252 None] Acquiring lock "cinder-quobyte-c136b0f5-b6de-4617-8094-382c31e31841" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:09:45 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-5794ba8a-65fd-4909-9979-183913e14af3 tempest-SnapshotsActionsTest-852873252 None] Lock "cinder-quobyte-c136b0f5-b6de-4617-8094-382c31e31841" acquired by "delete_volume" :: waited 0.035s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:09:45 devstack sudo[94584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c Jul 10 10:09:45 devstack sudo[94584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:45 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[967395ce-83f3-4b4a-be8c-3e9dcc79b5a9]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:09:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5794ba8a-65fd-4909-9979-183913e14af3 tempest-SnapshotsActionsTest-852873252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:45 devstack sudo[94590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841 Jul 10 10:09:45 devstack sudo[94590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:45 devstack sudo[94578]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-8f0dfd80-9db1-4e74-b650-20536ee19de5 tempest-VolumesSnapshotListTestJSON-1635654721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.0c44a94b-72c2-47b8-9182-f96bbb76fbdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.8c80c8d9-0289-4568-8b5f-5cfd44672af7 1G" returned: 0 in 1.008s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-8f0dfd80-9db1-4e74-b650-20536ee19de5 tempest-VolumesSnapshotListTestJSON-1635654721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58dc29ee-e952-417f-ad88-34a62b59cb41.0c44a94b-72c2-47b8-9182-f96bbb76fbdc -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.8c80c8d9-0289-4568-8b5f-5cfd44672af7 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:45 devstack sudo[94592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58dc29ee-e952-417f-ad88-34a62b59cb41.0c44a94b-72c2-47b8-9182-f96bbb76fbdc -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.8c80c8d9-0289-4568-8b5f-5cfd44672af7 Jul 10 10:09:45 devstack sudo[94592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:46 devstack sudo[94584]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e2eabf82-8bc2-41af-957b-2802b9768f4b tempest-VolumesGetTest-197214973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c" returned: 0 in 0.888s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e2eabf82-8bc2-41af-957b-2802b9768f4b tempest-VolumesGetTest-197214973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:46 devstack sudo[94599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c Jul 10 10:09:46 devstack sudo[94599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:46 devstack sudo[94590]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5794ba8a-65fd-4909-9979-183913e14af3 tempest-SnapshotsActionsTest-852873252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841" returned: 0 in 0.884s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5794ba8a-65fd-4909-9979-183913e14af3 tempest-SnapshotsActionsTest-852873252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:46 devstack sudo[94603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841 Jul 10 10:09:46 devstack sudo[94603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:46 devstack sudo[94592]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-8f0dfd80-9db1-4e74-b650-20536ee19de5 tempest-VolumesSnapshotListTestJSON-1635654721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58dc29ee-e952-417f-ad88-34a62b59cb41.0c44a94b-72c2-47b8-9182-f96bbb76fbdc -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.8c80c8d9-0289-4568-8b5f-5cfd44672af7" returned: 0 in 0.792s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:46 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-8f0dfd80-9db1-4e74-b650-20536ee19de5 tempest-VolumesSnapshotListTestJSON-1635654721 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.8c80c8d9-0289-4568-8b5f-5cfd44672af7 is being set with open permissions: ugo+rw Jul 10 10:09:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-8f0dfd80-9db1-4e74-b650-20536ee19de5 tempest-VolumesSnapshotListTestJSON-1635654721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.8c80c8d9-0289-4568-8b5f-5cfd44672af7 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:46 devstack sudo[94612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.8c80c8d9-0289-4568-8b5f-5cfd44672af7 Jul 10 10:09:46 devstack sudo[94612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:46 devstack sudo[94599]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e2eabf82-8bc2-41af-957b-2802b9768f4b tempest-VolumesGetTest-197214973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c" returned: 0 in 0.734s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:46 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-e2eabf82-8bc2-41af-957b-2802b9768f4b tempest-VolumesGetTest-197214973 None] Lock "cinder-quobyte-5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c" released by "delete_volume" :: held 1.695s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:09:47 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-e2eabf82-8bc2-41af-957b-2802b9768f4b tempest-VolumesGetTest-197214973 None] Created reservations ['fbea4ffb-0cc3-47b6-abdd-939acf0508dc', '7317dd76-e346-42ab-b489-33b2a24d075c', '37f4c3c2-ed8a-4c3e-850f-547bc29f2928', '99391173-6263-44be-853e-833ad76164d8'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:09:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-e2eabf82-8bc2-41af-957b-2802b9768f4b tempest-VolumesGetTest-197214973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:09:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-e2eabf82-8bc2-41af-957b-2802b9768f4b tempest-VolumesGetTest-197214973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:09:47 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-e2eabf82-8bc2-41af-957b-2802b9768f4b tempest-VolumesGetTest-197214973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:09:47 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-e2eabf82-8bc2-41af-957b-2802b9768f4b tempest-VolumesGetTest-197214973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:09:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-e2eabf82-8bc2-41af-957b-2802b9768f4b tempest-VolumesGetTest-197214973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:09:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e2eabf82-8bc2-41af-957b-2802b9768f4b tempest-VolumesGetTest-197214973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:47 devstack sudo[94616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:09:47 devstack sudo[94616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:47 devstack sudo[94603]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5794ba8a-65fd-4909-9979-183913e14af3 tempest-SnapshotsActionsTest-852873252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c136b0f5-b6de-4617-8094-382c31e31841" returned: 0 in 0.746s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:47 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-5794ba8a-65fd-4909-9979-183913e14af3 tempest-SnapshotsActionsTest-852873252 None] Lock "cinder-quobyte-c136b0f5-b6de-4617-8094-382c31e31841" released by "delete_volume" :: held 1.703s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:09:47 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-5794ba8a-65fd-4909-9979-183913e14af3 tempest-SnapshotsActionsTest-852873252 None] Created reservations ['55f49061-4263-4e05-97e4-230b8a27f56d', 'd7aa3a19-f6d4-47a3-aaaa-fac7ad3c21be', '9914eda9-85eb-4b7e-8c31-38c0cb4e435b', '7bc2c10e-5aa3-4915-8873-f045e6cbdd8e'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:09:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-5794ba8a-65fd-4909-9979-183913e14af3 tempest-SnapshotsActionsTest-852873252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:09:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-5794ba8a-65fd-4909-9979-183913e14af3 tempest-SnapshotsActionsTest-852873252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:09:47 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-5794ba8a-65fd-4909-9979-183913e14af3 tempest-SnapshotsActionsTest-852873252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:09:47 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-5794ba8a-65fd-4909-9979-183913e14af3 tempest-SnapshotsActionsTest-852873252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:09:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-5794ba8a-65fd-4909-9979-183913e14af3 tempest-SnapshotsActionsTest-852873252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:09:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5794ba8a-65fd-4909-9979-183913e14af3 tempest-SnapshotsActionsTest-852873252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:47 devstack sudo[94612]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-8f0dfd80-9db1-4e74-b650-20536ee19de5 tempest-VolumesSnapshotListTestJSON-1635654721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.8c80c8d9-0289-4568-8b5f-5cfd44672af7" returned: 0 in 0.697s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:47 devstack sudo[94619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:09:47 devstack sudo[94619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-8f0dfd80-9db1-4e74-b650-20536ee19de5 tempest-VolumesSnapshotListTestJSON-1635654721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.634s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:09:47 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-8f0dfd80-9db1-4e74-b650-20536ee19de5 tempest-VolumesSnapshotListTestJSON-1635654721 None] Create snapshot completed successfully Jul 10 10:09:48 devstack sudo[94616]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e2eabf82-8bc2-41af-957b-2802b9768f4b tempest-VolumesGetTest-197214973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.922s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:48 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-e2eabf82-8bc2-41af-957b-2802b9768f4b tempest-VolumesGetTest-197214973 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:09:48 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-e2eabf82-8bc2-41af-957b-2802b9768f4b tempest-VolumesGetTest-197214973 None] Deleted volume successfully. Jul 10 10:09:48 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-e2eabf82-8bc2-41af-957b-2802b9768f4b tempest-VolumesGetTest-197214973 None] Lock "cinder-5ab7fee0-d78d-4dbe-a18f-b83cc52bc65c-delete_volume" released by "delete_volume" :: held 2.905s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:09:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-47daaecc-0901-49bf-a7d2-7f47e5894c7e tempest-VolumesSnapshotListTestJSON-1635654721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:09:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-47daaecc-0901-49bf-a7d2-7f47e5894c7e tempest-VolumesSnapshotListTestJSON-1635654721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:09:48 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-47daaecc-0901-49bf-a7d2-7f47e5894c7e tempest-VolumesSnapshotListTestJSON-1635654721 None] Creating offline snapshot 5f7f8751-6092-4fb8-a41c-a9315c38560d of volume 58dc29ee-e952-417f-ad88-34a62b59cb41 {{(pid=87234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 10:09:48 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[56bb7af7-ed3c-4894-9f3f-71b525cd0939]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:09:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-47daaecc-0901-49bf-a7d2-7f47e5894c7e tempest-VolumesSnapshotListTestJSON-1635654721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.8c80c8d9-0289-4568-8b5f-5cfd44672af7 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:48 devstack sudo[94619]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5794ba8a-65fd-4909-9979-183913e14af3 tempest-SnapshotsActionsTest-852873252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 1.142s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:48 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-5794ba8a-65fd-4909-9979-183913e14af3 tempest-SnapshotsActionsTest-852873252 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:09:48 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-5794ba8a-65fd-4909-9979-183913e14af3 tempest-SnapshotsActionsTest-852873252 None] Deleted volume successfully. Jul 10 10:09:48 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-5794ba8a-65fd-4909-9979-183913e14af3 tempest-SnapshotsActionsTest-852873252 None] Lock "cinder-c136b0f5-b6de-4617-8094-382c31e31841-delete_volume" released by "delete_volume" :: held 3.087s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:09:48 devstack sudo[94637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.8c80c8d9-0289-4568-8b5f-5cfd44672af7 Jul 10 10:09:48 devstack sudo[94637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:49 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0ca6db5-a72a-477a-b86d-010447d02c08 tempest-VolumesGetTest-197214973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:09:49 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f0ca6db5-a72a-477a-b86d-010447d02c08 tempest-VolumesGetTest-197214973 None] Flow 'volume_create_manager' (85004d88-2a4a-4ea0-a62d-fbed65137a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:09:49 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f0ca6db5-a72a-477a-b86d-010447d02c08 tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15826031-7038-4501-a780-c5ab6a4b2f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:09:49 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f0ca6db5-a72a-477a-b86d-010447d02c08 tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15826031-7038-4501-a780-c5ab6a4b2f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:09:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1562699929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ddaa956-2d32-4c03-9ea1-4f27b4671e18,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b6e1b243e2ee4fa3bf1c3dda0bf8b5da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:09:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:09:49Z,use_quota=True,user_id='683315fe0f3a4835aed6459f8e52b1dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:09:49 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f0ca6db5-a72a-477a-b86d-010447d02c08 tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21d7883a-da69-4c25-9373-ac2e3643f2ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:09:49 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f0ca6db5-a72a-477a-b86d-010447d02c08 tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21d7883a-da69-4c25-9373-ac2e3643f2ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:09:49 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f0ca6db5-a72a-477a-b86d-010447d02c08 tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e6c2d3c-e517-4339-ba56-a1b3d5bda631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:09:49 devstack cinder-volume[87234]: DEBUG cinder.image.glance [None req-f0ca6db5-a72a-477a-b86d-010447d02c08 tempest-VolumesGetTest-197214973 None] Creating Keystone auth plugin from conf {{(pid=87234) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 10:09:49 devstack sudo[94637]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-47daaecc-0901-49bf-a7d2-7f47e5894c7e tempest-VolumesSnapshotListTestJSON-1635654721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.8c80c8d9-0289-4568-8b5f-5cfd44672af7" returned: 0 in 1.311s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:49 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-47daaecc-0901-49bf-a7d2-7f47e5894c7e tempest-VolumesSnapshotListTestJSON-1635654721 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58dc29ee-e952-417f-ad88-34a62b59cb41(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 10:09:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-47daaecc-0901-49bf-a7d2-7f47e5894c7e tempest-VolumesSnapshotListTestJSON-1635654721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.8c80c8d9-0289-4568-8b5f-5cfd44672af7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.5f7f8751-6092-4fb8-a41c-a9315c38560d 1G {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:49 devstack sudo[94675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.8c80c8d9-0289-4568-8b5f-5cfd44672af7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.5f7f8751-6092-4fb8-a41c-a9315c38560d 1G Jul 10 10:09:49 devstack sudo[94675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:50 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f0ca6db5-a72a-477a-b86d-010447d02c08 tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e6c2d3c-e517-4339-ba56-a1b3d5bda631) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0ddaa956-2d32-4c03-9ea1-4f27b4671e18', 'volume_name': 'volume-0ddaa956-2d32-4c03-9ea1-4f27b4671e18', 'volume_size': 1, 'image_id': '57b49355-8d23-4892-9d66-30ed6d4bc3c1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/57b49355-8d23-4892-9d66-30ed6d4bc3c1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd8e6341302c8449397efca0eea68956a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '57b49355-8d23-4892-9d66-30ed6d4bc3c1', 'created_at': datetime.datetime(2026, 7, 10, 7, 56, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 7, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/57b49355-8d23-4892-9d66-30ed6d4bc3c1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:09:50 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f0ca6db5-a72a-477a-b86d-010447d02c08 tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d9e133e-67d6-48ba-8169-ca461ad5ffd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:09:50 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f0ca6db5-a72a-477a-b86d-010447d02c08 tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d9e133e-67d6-48ba-8169-ca461ad5ffd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:09:50 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f0ca6db5-a72a-477a-b86d-010447d02c08 tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (293338ab-423d-4559-834b-65b6c2754083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:09:50 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-f0ca6db5-a72a-477a-b86d-010447d02c08 tempest-VolumesGetTest-197214973 None] Volume 0ddaa956-2d32-4c03-9ea1-4f27b4671e18: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0ddaa956-2d32-4c03-9ea1-4f27b4671e18', 'volume_size': 1, 'image_id': '57b49355-8d23-4892-9d66-30ed6d4bc3c1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/57b49355-8d23-4892-9d66-30ed6d4bc3c1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd8e6341302c8449397efca0eea68956a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '57b49355-8d23-4892-9d66-30ed6d4bc3c1', 'created_at': datetime.datetime(2026, 7, 10, 7, 56, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 7, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/57b49355-8d23-4892-9d66-30ed6d4bc3c1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 10 10:09:50 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0ca6db5-a72a-477a-b86d-010447d02c08 tempest-VolumesGetTest-197214973 None] Trying to clone 0ddaa956-2d32-4c03-9ea1-4f27b4671e18 from image 57b49355-8d23-4892-9d66-30ed6d4bc3c1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/57b49355-8d23-4892-9d66-30ed6d4bc3c1', 'metadata': {}}]). {{(pid=87234) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 10:09:51 devstack cinder-volume[87234]: DEBUG cinder.image.image_utils [None req-f0ca6db5-a72a-477a-b86d-010447d02c08 tempest-VolumesGetTest-197214973 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_57b49355-8d23-4892-9d66-30ed6d4bc3c1_801r8fa6devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87234) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 10:09:51 devstack cinder-volume[87234]: INFO cinder.image.image_utils [None req-f0ca6db5-a72a-477a-b86d-010447d02c08 tempest-VolumesGetTest-197214973 None] Image download 20.69 MB at 20.69 MB/s Jul 10 10:09:51 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[02cdd3eb-11a2-49d9-b6a7-94b124f545c8]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:09:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f0ca6db5-a72a-477a-b86d-010447d02c08 tempest-VolumesGetTest-197214973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57b49355-8d23-4892-9d66-30ed6d4bc3c1_801r8fa6devstack@QuobyteHD {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:51 devstack sudo[94675]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-47daaecc-0901-49bf-a7d2-7f47e5894c7e tempest-VolumesSnapshotListTestJSON-1635654721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.8c80c8d9-0289-4568-8b5f-5cfd44672af7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.5f7f8751-6092-4fb8-a41c-a9315c38560d 1G" returned: 0 in 1.403s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-47daaecc-0901-49bf-a7d2-7f47e5894c7e tempest-VolumesSnapshotListTestJSON-1635654721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58dc29ee-e952-417f-ad88-34a62b59cb41.8c80c8d9-0289-4568-8b5f-5cfd44672af7 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.5f7f8751-6092-4fb8-a41c-a9315c38560d {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:51 devstack sudo[94722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58dc29ee-e952-417f-ad88-34a62b59cb41.8c80c8d9-0289-4568-8b5f-5cfd44672af7 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.5f7f8751-6092-4fb8-a41c-a9315c38560d Jul 10 10:09:51 devstack sudo[94722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:51 devstack sudo[94721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57b49355-8d23-4892-9d66-30ed6d4bc3c1_801r8fa6devstack@QuobyteHD Jul 10 10:09:51 devstack sudo[94721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:52 devstack sudo[94721]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f0ca6db5-a72a-477a-b86d-010447d02c08 tempest-VolumesGetTest-197214973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57b49355-8d23-4892-9d66-30ed6d4bc3c1_801r8fa6devstack@QuobyteHD" returned: 0 in 1.107s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:52 devstack cinder-volume[87234]: DEBUG cinder.image.image_utils [None req-f0ca6db5-a72a-477a-b86d-010447d02c08 tempest-VolumesGetTest-197214973 None] Temporary image 57b49355-8d23-4892-9d66-30ed6d4bc3c1 is fetched for user 683315fe0f3a4835aed6459f8e52b1dd. {{(pid=87234) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 10:09:52 devstack sudo[94722]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-47daaecc-0901-49bf-a7d2-7f47e5894c7e tempest-VolumesSnapshotListTestJSON-1635654721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58dc29ee-e952-417f-ad88-34a62b59cb41.8c80c8d9-0289-4568-8b5f-5cfd44672af7 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.5f7f8751-6092-4fb8-a41c-a9315c38560d" returned: 0 in 1.284s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:52 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-47daaecc-0901-49bf-a7d2-7f47e5894c7e tempest-VolumesSnapshotListTestJSON-1635654721 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.5f7f8751-6092-4fb8-a41c-a9315c38560d is being set with open permissions: ugo+rw Jul 10 10:09:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-47daaecc-0901-49bf-a7d2-7f47e5894c7e tempest-VolumesSnapshotListTestJSON-1635654721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.5f7f8751-6092-4fb8-a41c-a9315c38560d {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:52 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[2350c954-d002-4c53-8035-d22d4e239efb]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:09:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f0ca6db5-a72a-477a-b86d-010447d02c08 tempest-VolumesGetTest-197214973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57b49355-8d23-4892-9d66-30ed6d4bc3c1_801r8fa6devstack@QuobyteHD {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:52 devstack sudo[94734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.5f7f8751-6092-4fb8-a41c-a9315c38560d Jul 10 10:09:52 devstack sudo[94734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:52 devstack sudo[94735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57b49355-8d23-4892-9d66-30ed6d4bc3c1_801r8fa6devstack@QuobyteHD Jul 10 10:09:52 devstack sudo[94735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:53 devstack sudo[94734]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-47daaecc-0901-49bf-a7d2-7f47e5894c7e tempest-VolumesSnapshotListTestJSON-1635654721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.5f7f8751-6092-4fb8-a41c-a9315c38560d" returned: 0 in 0.904s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-47daaecc-0901-49bf-a7d2-7f47e5894c7e tempest-VolumesSnapshotListTestJSON-1635654721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.209s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:09:53 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-47daaecc-0901-49bf-a7d2-7f47e5894c7e tempest-VolumesSnapshotListTestJSON-1635654721 None] Create snapshot completed successfully Jul 10 10:09:53 devstack sudo[94735]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f0ca6db5-a72a-477a-b86d-010447d02c08 tempest-VolumesGetTest-197214973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57b49355-8d23-4892-9d66-30ed6d4bc3c1_801r8fa6devstack@QuobyteHD" returned: 0 in 1.341s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f0ca6db5-a72a-477a-b86d-010447d02c08 tempest-VolumesGetTest-197214973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:09:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f0ca6db5-a72a-477a-b86d-010447d02c08 tempest-VolumesGetTest-197214973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:09:53 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f0ca6db5-a72a-477a-b86d-010447d02c08 tempest-VolumesGetTest-197214973 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:09:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1562699929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ddaa956-2d32-4c03-9ea1-4f27b4671e18,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b6e1b243e2ee4fa3bf1c3dda0bf8b5da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:09:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:09:49Z,use_quota=True,user_id='683315fe0f3a4835aed6459f8e52b1dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:09:53 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-f0ca6db5-a72a-477a-b86d-010447d02c08 tempest-VolumesGetTest-197214973 None] Creating volume 0ddaa956-2d32-4c03-9ea1-4f27b4671e18 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:09:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f0ca6db5-a72a-477a-b86d-010447d02c08 tempest-VolumesGetTest-197214973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:09:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f0ca6db5-a72a-477a-b86d-010447d02c08 tempest-VolumesGetTest-197214973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:09:53 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f0ca6db5-a72a-477a-b86d-010447d02c08 tempest-VolumesGetTest-197214973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:09:53 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f0ca6db5-a72a-477a-b86d-010447d02c08 tempest-VolumesGetTest-197214973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:09:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f0ca6db5-a72a-477a-b86d-010447d02c08 tempest-VolumesGetTest-197214973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:09:53 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f0ca6db5-a72a-477a-b86d-010447d02c08 tempest-VolumesGetTest-197214973 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:09:53 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-f0ca6db5-a72a-477a-b86d-010447d02c08 tempest-VolumesGetTest-197214973 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:09:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f0ca6db5-a72a-477a-b86d-010447d02c08 tempest-VolumesGetTest-197214973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0ddaa956-2d32-4c03-9ea1-4f27b4671e18 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:53 devstack sudo[94743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0ddaa956-2d32-4c03-9ea1-4f27b4671e18 1073741824 Jul 10 10:09:53 devstack sudo[94743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:55 devstack sudo[94743]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:55 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f0ca6db5-a72a-477a-b86d-010447d02c08 tempest-VolumesGetTest-197214973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0ddaa956-2d32-4c03-9ea1-4f27b4671e18 1073741824" returned: 0 in 1.367s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:55 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f0ca6db5-a72a-477a-b86d-010447d02c08 tempest-VolumesGetTest-197214973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0ddaa956-2d32-4c03-9ea1-4f27b4671e18 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:55 devstack sudo[94760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0ddaa956-2d32-4c03-9ea1-4f27b4671e18 Jul 10 10:09:55 devstack sudo[94760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:56 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-1a870472-9cdf-42eb-9d04-4c6933edf228 tempest-VolumesSnapshotListTestJSON-1635654721 None] Acquiring lock "cinder-5f7f8751-6092-4fb8-a41c-a9315c38560d-delete_snapshot" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:09:56 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-1a870472-9cdf-42eb-9d04-4c6933edf228 tempest-VolumesSnapshotListTestJSON-1635654721 None] Lock "cinder-5f7f8751-6092-4fb8-a41c-a9315c38560d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:09:56 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-1a870472-9cdf-42eb-9d04-4c6933edf228 tempest-VolumesSnapshotListTestJSON-1635654721 None] Acquiring lock "cinder-quobyte-58dc29ee-e952-417f-ad88-34a62b59cb41" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:09:56 devstack sudo[94760]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f0ca6db5-a72a-477a-b86d-010447d02c08 tempest-VolumesGetTest-197214973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0ddaa956-2d32-4c03-9ea1-4f27b4671e18" returned: 0 in 1.084s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:56 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f0ca6db5-a72a-477a-b86d-010447d02c08 tempest-VolumesGetTest-197214973 None] <== create_volume: return (2535ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:09:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f0ca6db5-a72a-477a-b86d-010447d02c08 tempest-VolumesGetTest-197214973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.538s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:09:56 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-1a870472-9cdf-42eb-9d04-4c6933edf228 tempest-VolumesSnapshotListTestJSON-1635654721 None] Lock "cinder-quobyte-58dc29ee-e952-417f-ad88-34a62b59cb41" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:09:56 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-1a870472-9cdf-42eb-9d04-4c6933edf228 tempest-VolumesSnapshotListTestJSON-1635654721 None] Acquiring lock "cinder-quobyte-5f7f8751-6092-4fb8-a41c-a9315c38560d" by "_delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:09:56 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-1a870472-9cdf-42eb-9d04-4c6933edf228 tempest-VolumesSnapshotListTestJSON-1635654721 None] Lock "cinder-quobyte-5f7f8751-6092-4fb8-a41c-a9315c38560d" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:09:56 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-1a870472-9cdf-42eb-9d04-4c6933edf228 tempest-VolumesSnapshotListTestJSON-1635654721 None] Deleting offline snapshot 5f7f8751-6092-4fb8-a41c-a9315c38560d of volume 58dc29ee-e952-417f-ad88-34a62b59cb41 {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 10:09:56 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-1a870472-9cdf-42eb-9d04-4c6933edf228 tempest-VolumesSnapshotListTestJSON-1635654721 None] snapshot_file for this snap is: volume-58dc29ee-e952-417f-ad88-34a62b59cb41.5f7f8751-6092-4fb8-a41c-a9315c38560d {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 10:09:56 devstack cinder-volume[87234]: DEBUG cinder.volume.volume_utils [None req-f0ca6db5-a72a-477a-b86d-010447d02c08 tempest-VolumesGetTest-197214973 None] Attempting download of 57b49355-8d23-4892-9d66-30ed6d4bc3c1 ((None, [{'url': 'file:///opt/stack/data/glance/images/57b49355-8d23-4892-9d66-30ed6d4bc3c1', 'metadata': {}}])) to volume 0ddaa956-2d32-4c03-9ea1-4f27b4671e18. {{(pid=87234) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 10:09:56 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[d480384d-f952-4cc1-91b1-346f923494d6]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:09:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1a870472-9cdf-42eb-9d04-4c6933edf228 tempest-VolumesSnapshotListTestJSON-1635654721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.5f7f8751-6092-4fb8-a41c-a9315c38560d {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:56 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[898842af-73f5-4d17-b195-a79183d4d2da]: (4, 'raw') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:09:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f0ca6db5-a72a-477a-b86d-010447d02c08 tempest-VolumesGetTest-197214973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_57b49355-8d23-4892-9d66-30ed6d4bc3c1_buli3hiy {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:56 devstack sudo[94764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.5f7f8751-6092-4fb8-a41c-a9315c38560d Jul 10 10:09:56 devstack sudo[94764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:56 devstack sudo[94765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_57b49355-8d23-4892-9d66-30ed6d4bc3c1_buli3hiy Jul 10 10:09:56 devstack sudo[94765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:57 devstack sudo[94764]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:57 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1a870472-9cdf-42eb-9d04-4c6933edf228 tempest-VolumesSnapshotListTestJSON-1635654721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.5f7f8751-6092-4fb8-a41c-a9315c38560d" returned: 0 in 1.105s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:57 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-1a870472-9cdf-42eb-9d04-4c6933edf228 tempest-VolumesSnapshotListTestJSON-1635654721 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58dc29ee-e952-417f-ad88-34a62b59cb41(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 10:09:57 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d7c0c35-6f4c-42c5-a17f-3a7d4edfc13b]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:09:57 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1a870472-9cdf-42eb-9d04-4c6933edf228 tempest-VolumesSnapshotListTestJSON-1635654721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.8c80c8d9-0289-4568-8b5f-5cfd44672af7 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:57 devstack sudo[94772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.8c80c8d9-0289-4568-8b5f-5cfd44672af7 Jul 10 10:09:57 devstack sudo[94772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:58 devstack sudo[94765]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f0ca6db5-a72a-477a-b86d-010447d02c08 tempest-VolumesGetTest-197214973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_57b49355-8d23-4892-9d66-30ed6d4bc3c1_buli3hiy" returned: 0 in 1.521s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f0ca6db5-a72a-477a-b86d-010447d02c08 tempest-VolumesGetTest-197214973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_57b49355-8d23-4892-9d66-30ed6d4bc3c1_buli3hiy {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:58 devstack sudo[94776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_57b49355-8d23-4892-9d66-30ed6d4bc3c1_buli3hiy Jul 10 10:09:58 devstack sudo[94776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:58 devstack sudo[94772]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1a870472-9cdf-42eb-9d04-4c6933edf228 tempest-VolumesSnapshotListTestJSON-1635654721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.8c80c8d9-0289-4568-8b5f-5cfd44672af7" returned: 0 in 1.040s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:58 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-1a870472-9cdf-42eb-9d04-4c6933edf228 tempest-VolumesSnapshotListTestJSON-1635654721 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58dc29ee-e952-417f-ad88-34a62b59cb41(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 10:09:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1a870472-9cdf-42eb-9d04-4c6933edf228 tempest-VolumesSnapshotListTestJSON-1635654721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.5f7f8751-6092-4fb8-a41c-a9315c38560d {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:58 devstack sudo[94782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.5f7f8751-6092-4fb8-a41c-a9315c38560d Jul 10 10:09:58 devstack sudo[94782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:58 devstack sudo[94776]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f0ca6db5-a72a-477a-b86d-010447d02c08 tempest-VolumesGetTest-197214973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_57b49355-8d23-4892-9d66-30ed6d4bc3c1_buli3hiy" returned: 1 in 0.831s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f0ca6db5-a72a-477a-b86d-010447d02c08 tempest-VolumesGetTest-197214973 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_57b49355-8d23-4892-9d66-30ed6d4bc3c1_buli3hiy' failed. Not Retrying. {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 10:09:58 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[5740ab81-c564-443f-b9d5-415be8a01d30]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:09:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f0ca6db5-a72a-477a-b86d-010447d02c08 tempest-VolumesGetTest-197214973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57b49355-8d23-4892-9d66-30ed6d4bc3c1_801r8fa6devstack@QuobyteHD {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:59 devstack sudo[94786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57b49355-8d23-4892-9d66-30ed6d4bc3c1_801r8fa6devstack@QuobyteHD Jul 10 10:09:59 devstack sudo[94786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:59 devstack sudo[94782]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:59 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1a870472-9cdf-42eb-9d04-4c6933edf228 tempest-VolumesSnapshotListTestJSON-1635654721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.5f7f8751-6092-4fb8-a41c-a9315c38560d" returned: 0 in 0.986s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:59 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1a870472-9cdf-42eb-9d04-4c6933edf228 tempest-VolumesSnapshotListTestJSON-1635654721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.5f7f8751-6092-4fb8-a41c-a9315c38560d {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:59 devstack sudo[94792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.5f7f8751-6092-4fb8-a41c-a9315c38560d Jul 10 10:09:59 devstack sudo[94792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:09:59 devstack sudo[94786]: pam_unix(sudo:session): session closed for user root Jul 10 10:09:59 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f0ca6db5-a72a-477a-b86d-010447d02c08 tempest-VolumesGetTest-197214973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57b49355-8d23-4892-9d66-30ed6d4bc3c1_801r8fa6devstack@QuobyteHD" returned: 0 in 0.803s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:09:59 devstack cinder-volume[87234]: DEBUG cinder.image.image_utils [None req-f0ca6db5-a72a-477a-b86d-010447d02c08 tempest-VolumesGetTest-197214973 None] 57b49355-8d23-4892-9d66-30ed6d4bc3c1 was qcow2, converting to raw {{(pid=87234) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 10:09:59 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f0ca6db5-a72a-477a-b86d-010447d02c08 tempest-VolumesGetTest-197214973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_57b49355-8d23-4892-9d66-30ed6d4bc3c1_801r8fa6devstack@QuobyteHD /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0ddaa956-2d32-4c03-9ea1-4f27b4671e18 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:09:59 devstack sudo[94796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_57b49355-8d23-4892-9d66-30ed6d4bc3c1_801r8fa6devstack@QuobyteHD /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0ddaa956-2d32-4c03-9ea1-4f27b4671e18 Jul 10 10:09:59 devstack sudo[94796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:10:00 devstack sudo[94792]: pam_unix(sudo:session): session closed for user root Jul 10 10:10:00 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1a870472-9cdf-42eb-9d04-4c6933edf228 tempest-VolumesSnapshotListTestJSON-1635654721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.5f7f8751-6092-4fb8-a41c-a9315c38560d" returned: 0 in 0.796s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:10:00 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-1a870472-9cdf-42eb-9d04-4c6933edf228 tempest-VolumesSnapshotListTestJSON-1635654721 None] Lock "cinder-quobyte-5f7f8751-6092-4fb8-a41c-a9315c38560d" released by "_delete_snapshot" :: held 4.104s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:10:00 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-1a870472-9cdf-42eb-9d04-4c6933edf228 tempest-VolumesSnapshotListTestJSON-1635654721 None] Lock "cinder-quobyte-58dc29ee-e952-417f-ad88-34a62b59cb41" released by "delete_snapshot" :: held 4.142s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:10:00 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-1a870472-9cdf-42eb-9d04-4c6933edf228 tempest-VolumesSnapshotListTestJSON-1635654721 None] Created reservations ['8cee350a-66e0-4824-a9d5-73d17f07ab58', '5063bbba-fcef-4717-a9c6-c52c73035a6e', 'f091ad0c-08b0-4276-a8f8-5d3ea3c02f5d', '57f24aee-d446-4576-a4b8-ef616080ccd2'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:10:00 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-1a870472-9cdf-42eb-9d04-4c6933edf228 tempest-VolumesSnapshotListTestJSON-1635654721 None] Delete snapshot completed successfully. Jul 10 10:10:00 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-1a870472-9cdf-42eb-9d04-4c6933edf228 tempest-VolumesSnapshotListTestJSON-1635654721 None] Lock "cinder-5f7f8751-6092-4fb8-a41c-a9315c38560d-delete_snapshot" released by "delete_snapshot" :: held 4.383s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:10:01 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-ea459908-bef5-4db8-8590-4bd625857edf tempest-VolumesSnapshotListTestJSON-1635654721 None] Acquiring lock "cinder-8c80c8d9-0289-4568-8b5f-5cfd44672af7-delete_snapshot" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:10:01 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-ea459908-bef5-4db8-8590-4bd625857edf tempest-VolumesSnapshotListTestJSON-1635654721 None] Lock "cinder-8c80c8d9-0289-4568-8b5f-5cfd44672af7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:10:01 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-ea459908-bef5-4db8-8590-4bd625857edf tempest-VolumesSnapshotListTestJSON-1635654721 None] Acquiring lock "cinder-quobyte-58dc29ee-e952-417f-ad88-34a62b59cb41" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:10:01 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-ea459908-bef5-4db8-8590-4bd625857edf tempest-VolumesSnapshotListTestJSON-1635654721 None] Lock "cinder-quobyte-58dc29ee-e952-417f-ad88-34a62b59cb41" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:10:01 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-ea459908-bef5-4db8-8590-4bd625857edf tempest-VolumesSnapshotListTestJSON-1635654721 None] Acquiring lock "cinder-quobyte-8c80c8d9-0289-4568-8b5f-5cfd44672af7" by "_delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:10:01 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-ea459908-bef5-4db8-8590-4bd625857edf tempest-VolumesSnapshotListTestJSON-1635654721 None] Lock "cinder-quobyte-8c80c8d9-0289-4568-8b5f-5cfd44672af7" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:10:01 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-ea459908-bef5-4db8-8590-4bd625857edf tempest-VolumesSnapshotListTestJSON-1635654721 None] Deleting offline snapshot 8c80c8d9-0289-4568-8b5f-5cfd44672af7 of volume 58dc29ee-e952-417f-ad88-34a62b59cb41 {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 10:10:01 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-ea459908-bef5-4db8-8590-4bd625857edf tempest-VolumesSnapshotListTestJSON-1635654721 None] snapshot_file for this snap is: volume-58dc29ee-e952-417f-ad88-34a62b59cb41.8c80c8d9-0289-4568-8b5f-5cfd44672af7 {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 10:10:01 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b528ee-45a7-40d2-9e3b-27b4694d3eba]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:10:01 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ea459908-bef5-4db8-8590-4bd625857edf tempest-VolumesSnapshotListTestJSON-1635654721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.8c80c8d9-0289-4568-8b5f-5cfd44672af7 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:10:01 devstack sudo[94808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.8c80c8d9-0289-4568-8b5f-5cfd44672af7 Jul 10 10:10:01 devstack sudo[94808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:10:02 devstack sudo[94796]: pam_unix(sudo:session): session closed for user root Jul 10 10:10:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f0ca6db5-a72a-477a-b86d-010447d02c08 tempest-VolumesGetTest-197214973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_57b49355-8d23-4892-9d66-30ed6d4bc3c1_801r8fa6devstack@QuobyteHD /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0ddaa956-2d32-4c03-9ea1-4f27b4671e18" returned: 0 in 2.499s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:10:02 devstack cinder-volume[87234]: DEBUG cinder.image.image_utils [None req-f0ca6db5-a72a-477a-b86d-010447d02c08 tempest-VolumesGetTest-197214973 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_57b49355-8d23-4892-9d66-30ed6d4bc3c1_801r8fa6devstack@QuobyteHD, size 112.00 MB, duration 2.50 sec, destination /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0ddaa956-2d32-4c03-9ea1-4f27b4671e18 {{(pid=87234) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 10:10:02 devstack cinder-volume[87234]: INFO cinder.image.image_utils [None req-f0ca6db5-a72a-477a-b86d-010447d02c08 tempest-VolumesGetTest-197214973 None] Converted 112.00 MB image at 44.78 MB/s Jul 10 10:10:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f0ca6db5-a72a-477a-b86d-010447d02c08 tempest-VolumesGetTest-197214973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0ddaa956-2d32-4c03-9ea1-4f27b4671e18 1G {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:10:02 devstack sudo[94810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0ddaa956-2d32-4c03-9ea1-4f27b4671e18 1G Jul 10 10:10:02 devstack sudo[94810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:10:02 devstack sudo[94808]: pam_unix(sudo:session): session closed for user root Jul 10 10:10:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ea459908-bef5-4db8-8590-4bd625857edf tempest-VolumesSnapshotListTestJSON-1635654721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.8c80c8d9-0289-4568-8b5f-5cfd44672af7" returned: 0 in 1.142s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:10:02 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-ea459908-bef5-4db8-8590-4bd625857edf tempest-VolumesSnapshotListTestJSON-1635654721 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58dc29ee-e952-417f-ad88-34a62b59cb41(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 10:10:03 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e05426-4606-4fda-bd14-d4a180eb6887]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:10:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ea459908-bef5-4db8-8590-4bd625857edf tempest-VolumesSnapshotListTestJSON-1635654721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.0c44a94b-72c2-47b8-9182-f96bbb76fbdc {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:10:03 devstack sudo[94815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.0c44a94b-72c2-47b8-9182-f96bbb76fbdc Jul 10 10:10:03 devstack sudo[94815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:10:03 devstack sudo[94810]: pam_unix(sudo:session): session closed for user root Jul 10 10:10:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f0ca6db5-a72a-477a-b86d-010447d02c08 tempest-VolumesGetTest-197214973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0ddaa956-2d32-4c03-9ea1-4f27b4671e18 1G" returned: 0 in 1.076s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:10:03 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[88bdd279-192c-4841-b1fd-224f5e3ea068]: (4, 'raw') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:10:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f0ca6db5-a72a-477a-b86d-010447d02c08 tempest-VolumesGetTest-197214973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0ddaa956-2d32-4c03-9ea1-4f27b4671e18 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:10:03 devstack sudo[94823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0ddaa956-2d32-4c03-9ea1-4f27b4671e18 Jul 10 10:10:03 devstack sudo[94823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:10:04 devstack sudo[94815]: pam_unix(sudo:session): session closed for user root Jul 10 10:10:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ea459908-bef5-4db8-8590-4bd625857edf tempest-VolumesSnapshotListTestJSON-1635654721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.0c44a94b-72c2-47b8-9182-f96bbb76fbdc" returned: 0 in 1.104s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:10:04 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-ea459908-bef5-4db8-8590-4bd625857edf tempest-VolumesSnapshotListTestJSON-1635654721 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58dc29ee-e952-417f-ad88-34a62b59cb41(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 10:10:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ea459908-bef5-4db8-8590-4bd625857edf tempest-VolumesSnapshotListTestJSON-1635654721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.8c80c8d9-0289-4568-8b5f-5cfd44672af7 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:10:04 devstack sudo[94848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.8c80c8d9-0289-4568-8b5f-5cfd44672af7 Jul 10 10:10:04 devstack sudo[94848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:10:04 devstack sudo[94823]: pam_unix(sudo:session): session closed for user root Jul 10 10:10:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f0ca6db5-a72a-477a-b86d-010447d02c08 tempest-VolumesGetTest-197214973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0ddaa956-2d32-4c03-9ea1-4f27b4671e18" returned: 0 in 1.044s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:10:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f0ca6db5-a72a-477a-b86d-010447d02c08 tempest-VolumesGetTest-197214973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0ddaa956-2d32-4c03-9ea1-4f27b4671e18 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:10:04 devstack sudo[94852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0ddaa956-2d32-4c03-9ea1-4f27b4671e18 Jul 10 10:10:04 devstack sudo[94852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:10:04 devstack sudo[94848]: pam_unix(sudo:session): session closed for user root Jul 10 10:10:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ea459908-bef5-4db8-8590-4bd625857edf tempest-VolumesSnapshotListTestJSON-1635654721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.8c80c8d9-0289-4568-8b5f-5cfd44672af7" returned: 0 in 0.842s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:10:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ea459908-bef5-4db8-8590-4bd625857edf tempest-VolumesSnapshotListTestJSON-1635654721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.8c80c8d9-0289-4568-8b5f-5cfd44672af7 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:10:04 devstack sudo[94857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.8c80c8d9-0289-4568-8b5f-5cfd44672af7 Jul 10 10:10:04 devstack sudo[94857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:10:05 devstack sudo[94852]: pam_unix(sudo:session): session closed for user root Jul 10 10:10:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f0ca6db5-a72a-477a-b86d-010447d02c08 tempest-VolumesGetTest-197214973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0ddaa956-2d32-4c03-9ea1-4f27b4671e18" returned: 1 in 0.842s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:10:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f0ca6db5-a72a-477a-b86d-010447d02c08 tempest-VolumesGetTest-197214973 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0ddaa956-2d32-4c03-9ea1-4f27b4671e18' failed. Not Retrying. {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 10:10:05 devstack cinder-volume[87234]: DEBUG cinder.volume.volume_utils [None req-f0ca6db5-a72a-477a-b86d-010447d02c08 tempest-VolumesGetTest-197214973 None] Downloaded image 57b49355-8d23-4892-9d66-30ed6d4bc3c1 ((None, [{'url': 'file:///opt/stack/data/glance/images/57b49355-8d23-4892-9d66-30ed6d4bc3c1', 'metadata': {}}])) to volume 0ddaa956-2d32-4c03-9ea1-4f27b4671e18 successfully. {{(pid=87234) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 10:10:05 devstack cinder-volume[87234]: DEBUG cinder.image.image_utils [None req-f0ca6db5-a72a-477a-b86d-010447d02c08 tempest-VolumesGetTest-197214973 None] Temporary image 57b49355-8d23-4892-9d66-30ed6d4bc3c1 for user 683315fe0f3a4835aed6459f8e52b1dd is deleted. {{(pid=87234) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 10:10:05 devstack cinder-volume[87234]: DEBUG cinder.volume.volume_utils [None req-f0ca6db5-a72a-477a-b86d-010447d02c08 tempest-VolumesGetTest-197214973 None] Marking volume 0ddaa956-2d32-4c03-9ea1-4f27b4671e18 as bootable. {{(pid=87234) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 10:10:05 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0ca6db5-a72a-477a-b86d-010447d02c08 tempest-VolumesGetTest-197214973 None] Copying metadata from image 57b49355-8d23-4892-9d66-30ed6d4bc3c1 to 0ddaa956-2d32-4c03-9ea1-4f27b4671e18. {{(pid=87234) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 10:10:05 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0ca6db5-a72a-477a-b86d-010447d02c08 tempest-VolumesGetTest-197214973 None] Creating volume glance metadata for volume 0ddaa956-2d32-4c03-9ea1-4f27b4671e18 backed by image 57b49355-8d23-4892-9d66-30ed6d4bc3c1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '57b49355-8d23-4892-9d66-30ed6d4bc3c1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87234) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 10:10:05 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f0ca6db5-a72a-477a-b86d-010447d02c08 tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (293338ab-423d-4559-834b-65b6c2754083) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ddaa956-2d32-4c03-9ea1-4f27b4671e18', 'volume_size': 1, 'image_id': '57b49355-8d23-4892-9d66-30ed6d4bc3c1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/57b49355-8d23-4892-9d66-30ed6d4bc3c1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd8e6341302c8449397efca0eea68956a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '57b49355-8d23-4892-9d66-30ed6d4bc3c1', 'created_at': datetime.datetime(2026, 7, 10, 7, 56, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 7, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/57b49355-8d23-4892-9d66-30ed6d4bc3c1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:10:05 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f0ca6db5-a72a-477a-b86d-010447d02c08 tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b214d85d-c1e6-4f91-a5e2-ef096e06aa4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:10:05 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-f0ca6db5-a72a-477a-b86d-010447d02c08 tempest-VolumesGetTest-197214973 None] Volume volume-0ddaa956-2d32-4c03-9ea1-4f27b4671e18 (0ddaa956-2d32-4c03-9ea1-4f27b4671e18): created successfully Jul 10 10:10:05 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f0ca6db5-a72a-477a-b86d-010447d02c08 tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b214d85d-c1e6-4f91-a5e2-ef096e06aa4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:10:05 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f0ca6db5-a72a-477a-b86d-010447d02c08 tempest-VolumesGetTest-197214973 None] Flow 'volume_create_manager' (85004d88-2a4a-4ea0-a62d-fbed65137a4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:10:05 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-f0ca6db5-a72a-477a-b86d-010447d02c08 tempest-VolumesGetTest-197214973 None] Created volume successfully. Jul 10 10:10:05 devstack sudo[94857]: pam_unix(sudo:session): session closed for user root Jul 10 10:10:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ea459908-bef5-4db8-8590-4bd625857edf tempest-VolumesSnapshotListTestJSON-1635654721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.8c80c8d9-0289-4568-8b5f-5cfd44672af7" returned: 0 in 0.745s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:10:05 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-ea459908-bef5-4db8-8590-4bd625857edf tempest-VolumesSnapshotListTestJSON-1635654721 None] Lock "cinder-quobyte-8c80c8d9-0289-4568-8b5f-5cfd44672af7" released by "_delete_snapshot" :: held 4.011s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:10:05 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-ea459908-bef5-4db8-8590-4bd625857edf tempest-VolumesSnapshotListTestJSON-1635654721 None] Lock "cinder-quobyte-58dc29ee-e952-417f-ad88-34a62b59cb41" released by "delete_snapshot" :: held 4.054s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:10:05 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-ea459908-bef5-4db8-8590-4bd625857edf tempest-VolumesSnapshotListTestJSON-1635654721 None] Created reservations ['92c887d2-a3ef-43ba-91c8-43a56013f310', 'b6982887-b9a5-41c6-9edb-3fd553c84bf1', 'd22fd732-a381-4e48-83b0-a48875429f45', '7dc11c7e-b1e5-435d-9bea-568fb74cef17'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:10:05 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-ea459908-bef5-4db8-8590-4bd625857edf tempest-VolumesSnapshotListTestJSON-1635654721 None] Delete snapshot completed successfully. Jul 10 10:10:05 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-ea459908-bef5-4db8-8590-4bd625857edf tempest-VolumesSnapshotListTestJSON-1635654721 None] Lock "cinder-8c80c8d9-0289-4568-8b5f-5cfd44672af7-delete_snapshot" released by "delete_snapshot" :: held 4.240s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:10:05 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-4d3331a4-5f22-4834-a6f2-417c8ec598ea tempest-VolumesSnapshotListTestJSON-1635654721 None] Acquiring lock "cinder-0c44a94b-72c2-47b8-9182-f96bbb76fbdc-delete_snapshot" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:10:05 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-4d3331a4-5f22-4834-a6f2-417c8ec598ea tempest-VolumesSnapshotListTestJSON-1635654721 None] Lock "cinder-0c44a94b-72c2-47b8-9182-f96bbb76fbdc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:10:05 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-4d3331a4-5f22-4834-a6f2-417c8ec598ea tempest-VolumesSnapshotListTestJSON-1635654721 None] Acquiring lock "cinder-quobyte-58dc29ee-e952-417f-ad88-34a62b59cb41" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:10:06 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-4d3331a4-5f22-4834-a6f2-417c8ec598ea tempest-VolumesSnapshotListTestJSON-1635654721 None] Lock "cinder-quobyte-58dc29ee-e952-417f-ad88-34a62b59cb41" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:10:06 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-4d3331a4-5f22-4834-a6f2-417c8ec598ea tempest-VolumesSnapshotListTestJSON-1635654721 None] Acquiring lock "cinder-quobyte-0c44a94b-72c2-47b8-9182-f96bbb76fbdc" by "_delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:10:06 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-4d3331a4-5f22-4834-a6f2-417c8ec598ea tempest-VolumesSnapshotListTestJSON-1635654721 None] Lock "cinder-quobyte-0c44a94b-72c2-47b8-9182-f96bbb76fbdc" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:10:06 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-4d3331a4-5f22-4834-a6f2-417c8ec598ea tempest-VolumesSnapshotListTestJSON-1635654721 None] Deleting offline snapshot 0c44a94b-72c2-47b8-9182-f96bbb76fbdc of volume 58dc29ee-e952-417f-ad88-34a62b59cb41 {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 10:10:06 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-4d3331a4-5f22-4834-a6f2-417c8ec598ea tempest-VolumesSnapshotListTestJSON-1635654721 None] snapshot_file for this snap is: volume-58dc29ee-e952-417f-ad88-34a62b59cb41.0c44a94b-72c2-47b8-9182-f96bbb76fbdc {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 10:10:06 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[5832514f-24e5-498f-ba56-a25929783ad5]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:10:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4d3331a4-5f22-4834-a6f2-417c8ec598ea tempest-VolumesSnapshotListTestJSON-1635654721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.0c44a94b-72c2-47b8-9182-f96bbb76fbdc {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:10:06 devstack sudo[94863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.0c44a94b-72c2-47b8-9182-f96bbb76fbdc Jul 10 10:10:06 devstack sudo[94863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:10:06 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-29c5e469-7d55-463a-b885-c6b67118016c tempest-VolumesGetTest-197214973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:10:06 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-29c5e469-7d55-463a-b885-c6b67118016c tempest-VolumesGetTest-197214973 None] Flow 'volume_create_manager' (427cfe04-54c5-4b3a-889b-c8b3c66810e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:10:06 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-29c5e469-7d55-463a-b885-c6b67118016c tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (946c83fd-8943-42a9-adf1-1b263e58228e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:10:06 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-29c5e469-7d55-463a-b885-c6b67118016c tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (946c83fd-8943-42a9-adf1-1b263e58228e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:10:06Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1194073785',display_name='tempest-VolumesGetTest-Volume-1214050722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dc97b8a-8e42-44da-9ca6-f2f8e3647444,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6e1b243e2ee4fa3bf1c3dda0bf8b5da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:10:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:10:07Z,use_quota=True,user_id='683315fe0f3a4835aed6459f8e52b1dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:10:06 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-29c5e469-7d55-463a-b885-c6b67118016c tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4324293-736e-45ed-9395-c7e3975f02fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:10:06 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-29c5e469-7d55-463a-b885-c6b67118016c tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4324293-736e-45ed-9395-c7e3975f02fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:10:06 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-29c5e469-7d55-463a-b885-c6b67118016c tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf67fbf6-70ed-41f8-a9e5-17563977fb84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:10:06 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-29c5e469-7d55-463a-b885-c6b67118016c tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf67fbf6-70ed-41f8-a9e5-17563977fb84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4dc97b8a-8e42-44da-9ca6-f2f8e3647444', 'volume_name': 'volume-4dc97b8a-8e42-44da-9ca6-f2f8e3647444', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:10:06 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-29c5e469-7d55-463a-b885-c6b67118016c tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52a9ea18-9e4f-4529-82b7-b58ffe529f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:10:06 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-29c5e469-7d55-463a-b885-c6b67118016c tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52a9ea18-9e4f-4529-82b7-b58ffe529f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:10:06 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-29c5e469-7d55-463a-b885-c6b67118016c tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64873773-8571-4437-903c-11c51adb0e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:10:06 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-29c5e469-7d55-463a-b885-c6b67118016c tempest-VolumesGetTest-197214973 None] Volume 4dc97b8a-8e42-44da-9ca6-f2f8e3647444: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4dc97b8a-8e42-44da-9ca6-f2f8e3647444', 'volume_size': 1} Jul 10 10:10:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-29c5e469-7d55-463a-b885-c6b67118016c tempest-VolumesGetTest-197214973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:10:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-29c5e469-7d55-463a-b885-c6b67118016c tempest-VolumesGetTest-197214973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:10:06 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-29c5e469-7d55-463a-b885-c6b67118016c tempest-VolumesGetTest-197214973 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:10:06Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1194073785',display_name='tempest-VolumesGetTest-Volume-1214050722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dc97b8a-8e42-44da-9ca6-f2f8e3647444,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6e1b243e2ee4fa3bf1c3dda0bf8b5da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:10:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:10:07Z,use_quota=True,user_id='683315fe0f3a4835aed6459f8e52b1dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:10:06 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-29c5e469-7d55-463a-b885-c6b67118016c tempest-VolumesGetTest-197214973 None] Creating volume 4dc97b8a-8e42-44da-9ca6-f2f8e3647444 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:10:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-29c5e469-7d55-463a-b885-c6b67118016c tempest-VolumesGetTest-197214973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:10:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-29c5e469-7d55-463a-b885-c6b67118016c tempest-VolumesGetTest-197214973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:10:06 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-29c5e469-7d55-463a-b885-c6b67118016c tempest-VolumesGetTest-197214973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:10:06 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-29c5e469-7d55-463a-b885-c6b67118016c tempest-VolumesGetTest-197214973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:10:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-29c5e469-7d55-463a-b885-c6b67118016c tempest-VolumesGetTest-197214973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:10:06 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-29c5e469-7d55-463a-b885-c6b67118016c tempest-VolumesGetTest-197214973 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:10:06 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-29c5e469-7d55-463a-b885-c6b67118016c tempest-VolumesGetTest-197214973 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:10:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-29c5e469-7d55-463a-b885-c6b67118016c tempest-VolumesGetTest-197214973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-4dc97b8a-8e42-44da-9ca6-f2f8e3647444 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:10:06 devstack sudo[94869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-4dc97b8a-8e42-44da-9ca6-f2f8e3647444 1073741824 Jul 10 10:10:06 devstack sudo[94869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:10:06 devstack sudo[94863]: pam_unix(sudo:session): session closed for user root Jul 10 10:10:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4d3331a4-5f22-4834-a6f2-417c8ec598ea tempest-VolumesSnapshotListTestJSON-1635654721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.0c44a94b-72c2-47b8-9182-f96bbb76fbdc" returned: 0 in 0.783s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:10:06 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-4d3331a4-5f22-4834-a6f2-417c8ec598ea tempest-VolumesSnapshotListTestJSON-1635654721 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58dc29ee-e952-417f-ad88-34a62b59cb41(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 10:10:06 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff91922-e9d2-42a8-8844-3f7ecffdef1e]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:10:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4d3331a4-5f22-4834-a6f2-417c8ec598ea tempest-VolumesSnapshotListTestJSON-1635654721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:10:07 devstack sudo[94871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41 Jul 10 10:10:07 devstack sudo[94871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:10:07 devstack sudo[94871]: pam_unix(sudo:session): session closed for user root Jul 10 10:10:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4d3331a4-5f22-4834-a6f2-417c8ec598ea tempest-VolumesSnapshotListTestJSON-1635654721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41" returned: 0 in 0.859s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:10:07 devstack sudo[94869]: pam_unix(sudo:session): session closed for user root Jul 10 10:10:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4d3331a4-5f22-4834-a6f2-417c8ec598ea tempest-VolumesSnapshotListTestJSON-1635654721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.0c44a94b-72c2-47b8-9182-f96bbb76fbdc {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:10:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-29c5e469-7d55-463a-b885-c6b67118016c tempest-VolumesGetTest-197214973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-4dc97b8a-8e42-44da-9ca6-f2f8e3647444 1073741824" returned: 0 in 0.960s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:10:07 devstack sudo[94879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.0c44a94b-72c2-47b8-9182-f96bbb76fbdc Jul 10 10:10:07 devstack sudo[94879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:10:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-29c5e469-7d55-463a-b885-c6b67118016c tempest-VolumesGetTest-197214973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-4dc97b8a-8e42-44da-9ca6-f2f8e3647444 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:10:07 devstack sudo[94881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-4dc97b8a-8e42-44da-9ca6-f2f8e3647444 Jul 10 10:10:07 devstack sudo[94881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:10:08 devstack sudo[94881]: pam_unix(sudo:session): session closed for user root Jul 10 10:10:08 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-29c5e469-7d55-463a-b885-c6b67118016c tempest-VolumesGetTest-197214973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-4dc97b8a-8e42-44da-9ca6-f2f8e3647444" returned: 0 in 0.750s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:10:08 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-29c5e469-7d55-463a-b885-c6b67118016c tempest-VolumesGetTest-197214973 None] <== create_volume: return (1761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:10:08 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-29c5e469-7d55-463a-b885-c6b67118016c tempest-VolumesGetTest-197214973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.765s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:10:08 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-29c5e469-7d55-463a-b885-c6b67118016c tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64873773-8571-4437-903c-11c51adb0e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4dc97b8a-8e42-44da-9ca6-f2f8e3647444', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:10:08 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-29c5e469-7d55-463a-b885-c6b67118016c tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0d4dfe9-7aca-4e00-8f38-a5ca86332f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:10:08 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-29c5e469-7d55-463a-b885-c6b67118016c tempest-VolumesGetTest-197214973 None] Volume volume-4dc97b8a-8e42-44da-9ca6-f2f8e3647444 (4dc97b8a-8e42-44da-9ca6-f2f8e3647444): created successfully Jul 10 10:10:08 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-29c5e469-7d55-463a-b885-c6b67118016c tempest-VolumesGetTest-197214973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0d4dfe9-7aca-4e00-8f38-a5ca86332f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:10:08 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-29c5e469-7d55-463a-b885-c6b67118016c tempest-VolumesGetTest-197214973 None] Flow 'volume_create_manager' (427cfe04-54c5-4b3a-889b-c8b3c66810e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:10:08 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-29c5e469-7d55-463a-b885-c6b67118016c tempest-VolumesGetTest-197214973 None] Created volume successfully. Jul 10 10:10:08 devstack sudo[94879]: pam_unix(sudo:session): session closed for user root Jul 10 10:10:08 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4d3331a4-5f22-4834-a6f2-417c8ec598ea tempest-VolumesSnapshotListTestJSON-1635654721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.0c44a94b-72c2-47b8-9182-f96bbb76fbdc" returned: 0 in 0.885s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:10:08 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4d3331a4-5f22-4834-a6f2-417c8ec598ea tempest-VolumesSnapshotListTestJSON-1635654721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.0c44a94b-72c2-47b8-9182-f96bbb76fbdc {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:10:08 devstack sudo[94889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.0c44a94b-72c2-47b8-9182-f96bbb76fbdc Jul 10 10:10:08 devstack sudo[94889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:10:08 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-41ca9f06-4d9a-4be6-ab25-cface46b2486 tempest-VolumesGetTest-197214973 None] Acquiring lock "cinder-4dc97b8a-8e42-44da-9ca6-f2f8e3647444-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:10:08 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-41ca9f06-4d9a-4be6-ab25-cface46b2486 tempest-VolumesGetTest-197214973 None] Lock "cinder-4dc97b8a-8e42-44da-9ca6-f2f8e3647444-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:10:09 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-41ca9f06-4d9a-4be6-ab25-cface46b2486 tempest-VolumesGetTest-197214973 None] Acquiring lock "cinder-quobyte-4dc97b8a-8e42-44da-9ca6-f2f8e3647444" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:10:09 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-41ca9f06-4d9a-4be6-ab25-cface46b2486 tempest-VolumesGetTest-197214973 None] Lock "cinder-quobyte-4dc97b8a-8e42-44da-9ca6-f2f8e3647444" acquired by "delete_volume" :: waited 0.019s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:10:09 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca01edc-7a3e-46da-8664-0e6b384d2243]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:10:09 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-41ca9f06-4d9a-4be6-ab25-cface46b2486 tempest-VolumesGetTest-197214973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-4dc97b8a-8e42-44da-9ca6-f2f8e3647444 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:10:09 devstack sudo[94891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-4dc97b8a-8e42-44da-9ca6-f2f8e3647444 Jul 10 10:10:09 devstack sudo[94891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:10:09 devstack sudo[94889]: pam_unix(sudo:session): session closed for user root Jul 10 10:10:09 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4d3331a4-5f22-4834-a6f2-417c8ec598ea tempest-VolumesSnapshotListTestJSON-1635654721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41.0c44a94b-72c2-47b8-9182-f96bbb76fbdc" returned: 0 in 0.763s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:10:09 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-4d3331a4-5f22-4834-a6f2-417c8ec598ea tempest-VolumesSnapshotListTestJSON-1635654721 None] Lock "cinder-quobyte-0c44a94b-72c2-47b8-9182-f96bbb76fbdc" released by "_delete_snapshot" :: held 3.449s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:10:09 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-4d3331a4-5f22-4834-a6f2-417c8ec598ea tempest-VolumesSnapshotListTestJSON-1635654721 None] Lock "cinder-quobyte-58dc29ee-e952-417f-ad88-34a62b59cb41" released by "delete_snapshot" :: held 3.491s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:10:09 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-4d3331a4-5f22-4834-a6f2-417c8ec598ea tempest-VolumesSnapshotListTestJSON-1635654721 None] Created reservations ['bcb99044-9bfd-4d39-b1af-2bd086dc06d8', 'f13b16ab-ca59-44b3-b4b7-18664fe3fce9', '1b329c03-b124-4ea5-9355-312e4644cb37', 'bebd5112-84d8-4bde-9861-8e99e64a41f3'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:10:09 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-4d3331a4-5f22-4834-a6f2-417c8ec598ea tempest-VolumesSnapshotListTestJSON-1635654721 None] Delete snapshot completed successfully. Jul 10 10:10:09 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-4d3331a4-5f22-4834-a6f2-417c8ec598ea tempest-VolumesSnapshotListTestJSON-1635654721 None] Lock "cinder-0c44a94b-72c2-47b8-9182-f96bbb76fbdc-delete_snapshot" released by "delete_snapshot" :: held 3.675s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:10:09 devstack sudo[94891]: pam_unix(sudo:session): session closed for user root Jul 10 10:10:09 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-41ca9f06-4d9a-4be6-ab25-cface46b2486 tempest-VolumesGetTest-197214973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-4dc97b8a-8e42-44da-9ca6-f2f8e3647444" returned: 0 in 0.874s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:10:09 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-41ca9f06-4d9a-4be6-ab25-cface46b2486 tempest-VolumesGetTest-197214973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-4dc97b8a-8e42-44da-9ca6-f2f8e3647444 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:10:09 devstack sudo[94898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-4dc97b8a-8e42-44da-9ca6-f2f8e3647444 Jul 10 10:10:09 devstack sudo[94898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:10:10 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-295f73c4-e3fc-4624-8050-a0d7bc2e8da7 tempest-VolumesSnapshotListTestJSON-1635654721 None] Acquiring lock "cinder-58dc29ee-e952-417f-ad88-34a62b59cb41-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:10:10 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-295f73c4-e3fc-4624-8050-a0d7bc2e8da7 tempest-VolumesSnapshotListTestJSON-1635654721 None] Lock "cinder-58dc29ee-e952-417f-ad88-34a62b59cb41-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:10:10 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-295f73c4-e3fc-4624-8050-a0d7bc2e8da7 tempest-VolumesSnapshotListTestJSON-1635654721 None] Acquiring lock "cinder-quobyte-58dc29ee-e952-417f-ad88-34a62b59cb41" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:10:10 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-295f73c4-e3fc-4624-8050-a0d7bc2e8da7 tempest-VolumesSnapshotListTestJSON-1635654721 None] Lock "cinder-quobyte-58dc29ee-e952-417f-ad88-34a62b59cb41" acquired by "delete_volume" :: waited 0.017s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:10:10 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[9230d111-5563-4667-b084-f164517063f6]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:10:10 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-295f73c4-e3fc-4624-8050-a0d7bc2e8da7 tempest-VolumesSnapshotListTestJSON-1635654721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:10:10 devstack sudo[94900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41 Jul 10 10:10:10 devstack sudo[94900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:10:10 devstack sudo[94898]: pam_unix(sudo:session): session closed for user root Jul 10 10:10:10 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-41ca9f06-4d9a-4be6-ab25-cface46b2486 tempest-VolumesGetTest-197214973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-4dc97b8a-8e42-44da-9ca6-f2f8e3647444" returned: 0 in 0.807s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:10:10 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-41ca9f06-4d9a-4be6-ab25-cface46b2486 tempest-VolumesGetTest-197214973 None] Lock "cinder-quobyte-4dc97b8a-8e42-44da-9ca6-f2f8e3647444" released by "delete_volume" :: held 1.739s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:10:10 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-41ca9f06-4d9a-4be6-ab25-cface46b2486 tempest-VolumesGetTest-197214973 None] Created reservations ['b4cebda0-9c4a-4b91-b132-1532a7560508', '3f62dc48-e684-457c-9705-55b146a069fc', 'ce8ce8cd-f6e4-4d4a-9522-2d40e76269a6', '9a1667f9-2f08-418e-81a5-0e614330ab65'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:10:10 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-41ca9f06-4d9a-4be6-ab25-cface46b2486 tempest-VolumesGetTest-197214973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:10:10 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-41ca9f06-4d9a-4be6-ab25-cface46b2486 tempest-VolumesGetTest-197214973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:10:10 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-41ca9f06-4d9a-4be6-ab25-cface46b2486 tempest-VolumesGetTest-197214973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:10:10 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-41ca9f06-4d9a-4be6-ab25-cface46b2486 tempest-VolumesGetTest-197214973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:10:10 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-41ca9f06-4d9a-4be6-ab25-cface46b2486 tempest-VolumesGetTest-197214973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:10:10 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-41ca9f06-4d9a-4be6-ab25-cface46b2486 tempest-VolumesGetTest-197214973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:10:11 devstack sudo[94937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:10:11 devstack sudo[94937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:10:11 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-59519c71-b5df-4612-b2dd-edfb75b65d71 tempest-VolumesGetTest-197214973 None] Acquiring lock "cinder-0ddaa956-2d32-4c03-9ea1-4f27b4671e18-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:10:11 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-59519c71-b5df-4612-b2dd-edfb75b65d71 tempest-VolumesGetTest-197214973 None] Lock "cinder-0ddaa956-2d32-4c03-9ea1-4f27b4671e18-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:10:11 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-59519c71-b5df-4612-b2dd-edfb75b65d71 tempest-VolumesGetTest-197214973 None] Acquiring lock "cinder-quobyte-0ddaa956-2d32-4c03-9ea1-4f27b4671e18" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:10:11 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-59519c71-b5df-4612-b2dd-edfb75b65d71 tempest-VolumesGetTest-197214973 None] Lock "cinder-quobyte-0ddaa956-2d32-4c03-9ea1-4f27b4671e18" acquired by "delete_volume" :: waited 0.036s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:10:11 devstack sudo[94900]: pam_unix(sudo:session): session closed for user root Jul 10 10:10:11 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-295f73c4-e3fc-4624-8050-a0d7bc2e8da7 tempest-VolumesSnapshotListTestJSON-1635654721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41" returned: 0 in 1.214s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:10:11 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-295f73c4-e3fc-4624-8050-a0d7bc2e8da7 tempest-VolumesSnapshotListTestJSON-1635654721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:10:11 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[f70548f8-d7c0-43b8-b576-3543ea728bbd]: (4, 'raw') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:10:11 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-59519c71-b5df-4612-b2dd-edfb75b65d71 tempest-VolumesGetTest-197214973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0ddaa956-2d32-4c03-9ea1-4f27b4671e18 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:10:11 devstack sudo[94944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41 Jul 10 10:10:11 devstack sudo[94944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:10:11 devstack sudo[94937]: pam_unix(sudo:session): session closed for user root Jul 10 10:10:11 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-41ca9f06-4d9a-4be6-ab25-cface46b2486 tempest-VolumesGetTest-197214973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 1.003s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:10:11 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-41ca9f06-4d9a-4be6-ab25-cface46b2486 tempest-VolumesGetTest-197214973 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:10:11 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-41ca9f06-4d9a-4be6-ab25-cface46b2486 tempest-VolumesGetTest-197214973 None] Deleted volume successfully. Jul 10 10:10:12 devstack sudo[94945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0ddaa956-2d32-4c03-9ea1-4f27b4671e18 Jul 10 10:10:12 devstack sudo[94945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:10:12 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-41ca9f06-4d9a-4be6-ab25-cface46b2486 tempest-VolumesGetTest-197214973 None] Lock "cinder-4dc97b8a-8e42-44da-9ca6-f2f8e3647444-delete_volume" released by "delete_volume" :: held 3.068s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:10:12 devstack sudo[94944]: pam_unix(sudo:session): session closed for user root Jul 10 10:10:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-295f73c4-e3fc-4624-8050-a0d7bc2e8da7 tempest-VolumesSnapshotListTestJSON-1635654721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-58dc29ee-e952-417f-ad88-34a62b59cb41" returned: 0 in 0.814s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:10:12 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-295f73c4-e3fc-4624-8050-a0d7bc2e8da7 tempest-VolumesSnapshotListTestJSON-1635654721 None] Lock "cinder-quobyte-58dc29ee-e952-417f-ad88-34a62b59cb41" released by "delete_volume" :: held 2.143s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:10:12 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-295f73c4-e3fc-4624-8050-a0d7bc2e8da7 tempest-VolumesSnapshotListTestJSON-1635654721 None] Created reservations ['6265c402-6766-40c8-89c3-522d14204145', 'b3834bf0-56a5-4939-af32-1b5610aff1d2', 'f56d5c52-e674-4b40-a2c6-ee8f04b859d2', '6fabdc77-a77f-4547-b3ca-42d0ff608d0f'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:10:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-295f73c4-e3fc-4624-8050-a0d7bc2e8da7 tempest-VolumesSnapshotListTestJSON-1635654721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:10:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-295f73c4-e3fc-4624-8050-a0d7bc2e8da7 tempest-VolumesSnapshotListTestJSON-1635654721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:10:12 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-295f73c4-e3fc-4624-8050-a0d7bc2e8da7 tempest-VolumesSnapshotListTestJSON-1635654721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:10:12 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-295f73c4-e3fc-4624-8050-a0d7bc2e8da7 tempest-VolumesSnapshotListTestJSON-1635654721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:10:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-295f73c4-e3fc-4624-8050-a0d7bc2e8da7 tempest-VolumesSnapshotListTestJSON-1635654721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:10:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-295f73c4-e3fc-4624-8050-a0d7bc2e8da7 tempest-VolumesSnapshotListTestJSON-1635654721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:10:12 devstack sudo[94945]: pam_unix(sudo:session): session closed for user root Jul 10 10:10:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-59519c71-b5df-4612-b2dd-edfb75b65d71 tempest-VolumesGetTest-197214973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0ddaa956-2d32-4c03-9ea1-4f27b4671e18" returned: 0 in 1.090s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:10:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-59519c71-b5df-4612-b2dd-edfb75b65d71 tempest-VolumesGetTest-197214973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0ddaa956-2d32-4c03-9ea1-4f27b4671e18 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:10:12 devstack sudo[94953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:10:12 devstack sudo[94953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:10:12 devstack sudo[94954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0ddaa956-2d32-4c03-9ea1-4f27b4671e18 Jul 10 10:10:12 devstack sudo[94954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:10:13 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-975be127-8011-4f60-b34e-178a95a4cc94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:10:13 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-975be127-8011-4f60-b34e-178a95a4cc94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] Flow 'volume_create_manager' (727d1d8e-9900-48df-afa6-bc5f9f978643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:10:13 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-975be127-8011-4f60-b34e-178a95a4cc94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (956539b7-a24e-48a1-9d90-11e9e787cd52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:10:13 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-975be127-8011-4f60-b34e-178a95a4cc94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (956539b7-a24e-48a1-9d90-11e9e787cd52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:10:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-627597186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c61cb7df-5e8f-4780-9ed4-69a5adeb6cea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24d2a19c1f4f4f2487c7fd1c13a0df1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:10:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:10:13Z,use_quota=True,user_id='e6ae978f2983450d949eb5a878d524c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:10:13 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-975be127-8011-4f60-b34e-178a95a4cc94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c963aec-4d4f-4f26-a469-aa261e34dc00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:10:13 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-975be127-8011-4f60-b34e-178a95a4cc94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c963aec-4d4f-4f26-a469-aa261e34dc00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:10:13 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-975be127-8011-4f60-b34e-178a95a4cc94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c1f0d78-a59f-45e1-8256-5bbccab3f541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:10:13 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-975be127-8011-4f60-b34e-178a95a4cc94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c1f0d78-a59f-45e1-8256-5bbccab3f541) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c61cb7df-5e8f-4780-9ed4-69a5adeb6cea', 'volume_name': 'volume-c61cb7df-5e8f-4780-9ed4-69a5adeb6cea', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:10:13 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-975be127-8011-4f60-b34e-178a95a4cc94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc57a7c6-aacc-4fe6-8a39-5085fe2b7e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:10:13 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-975be127-8011-4f60-b34e-178a95a4cc94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc57a7c6-aacc-4fe6-8a39-5085fe2b7e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:10:13 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-975be127-8011-4f60-b34e-178a95a4cc94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64ceee3c-39a8-45ea-bb79-b77c9ee3c5a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:10:13 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-975be127-8011-4f60-b34e-178a95a4cc94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] Volume c61cb7df-5e8f-4780-9ed4-69a5adeb6cea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c61cb7df-5e8f-4780-9ed4-69a5adeb6cea', 'volume_size': 1} Jul 10 10:10:13 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-975be127-8011-4f60-b34e-178a95a4cc94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:10:13 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-975be127-8011-4f60-b34e-178a95a4cc94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:10:13 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-975be127-8011-4f60-b34e-178a95a4cc94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:10:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-627597186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c61cb7df-5e8f-4780-9ed4-69a5adeb6cea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24d2a19c1f4f4f2487c7fd1c13a0df1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:10:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:10:13Z,use_quota=True,user_id='e6ae978f2983450d949eb5a878d524c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:10:13 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-975be127-8011-4f60-b34e-178a95a4cc94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] Creating volume c61cb7df-5e8f-4780-9ed4-69a5adeb6cea {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:10:13 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-975be127-8011-4f60-b34e-178a95a4cc94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:10:13 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-975be127-8011-4f60-b34e-178a95a4cc94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:10:13 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-975be127-8011-4f60-b34e-178a95a4cc94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:10:13 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-975be127-8011-4f60-b34e-178a95a4cc94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:10:13 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-975be127-8011-4f60-b34e-178a95a4cc94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:10:13 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-975be127-8011-4f60-b34e-178a95a4cc94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:10:13 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-975be127-8011-4f60-b34e-178a95a4cc94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:10:13 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-975be127-8011-4f60-b34e-178a95a4cc94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c61cb7df-5e8f-4780-9ed4-69a5adeb6cea 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:10:13 devstack sudo[94957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c61cb7df-5e8f-4780-9ed4-69a5adeb6cea 1073741824 Jul 10 10:10:13 devstack sudo[94957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:10:13 devstack sudo[94953]: pam_unix(sudo:session): session closed for user root Jul 10 10:10:13 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-295f73c4-e3fc-4624-8050-a0d7bc2e8da7 tempest-VolumesSnapshotListTestJSON-1635654721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.771s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:10:13 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-295f73c4-e3fc-4624-8050-a0d7bc2e8da7 tempest-VolumesSnapshotListTestJSON-1635654721 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:10:13 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-295f73c4-e3fc-4624-8050-a0d7bc2e8da7 tempest-VolumesSnapshotListTestJSON-1635654721 None] Deleted volume successfully. Jul 10 10:10:13 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-295f73c4-e3fc-4624-8050-a0d7bc2e8da7 tempest-VolumesSnapshotListTestJSON-1635654721 None] Lock "cinder-58dc29ee-e952-417f-ad88-34a62b59cb41-delete_volume" released by "delete_volume" :: held 3.244s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:10:13 devstack sudo[94954]: pam_unix(sudo:session): session closed for user root Jul 10 10:10:13 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-59519c71-b5df-4612-b2dd-edfb75b65d71 tempest-VolumesGetTest-197214973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0ddaa956-2d32-4c03-9ea1-4f27b4671e18" returned: 1 in 0.808s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:10:13 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-59519c71-b5df-4612-b2dd-edfb75b65d71 tempest-VolumesGetTest-197214973 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0ddaa956-2d32-4c03-9ea1-4f27b4671e18' failed. Not Retrying. {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 10:10:13 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-59519c71-b5df-4612-b2dd-edfb75b65d71 tempest-VolumesGetTest-197214973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0ddaa956-2d32-4c03-9ea1-4f27b4671e18 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:10:13 devstack sudo[94963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0ddaa956-2d32-4c03-9ea1-4f27b4671e18 Jul 10 10:10:13 devstack sudo[94963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:10:14 devstack sudo[94957]: pam_unix(sudo:session): session closed for user root Jul 10 10:10:14 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-975be127-8011-4f60-b34e-178a95a4cc94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c61cb7df-5e8f-4780-9ed4-69a5adeb6cea 1073741824" returned: 0 in 0.878s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:10:14 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-975be127-8011-4f60-b34e-178a95a4cc94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c61cb7df-5e8f-4780-9ed4-69a5adeb6cea {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:10:14 devstack sudo[94969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c61cb7df-5e8f-4780-9ed4-69a5adeb6cea Jul 10 10:10:14 devstack sudo[94969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:10:14 devstack sudo[94963]: pam_unix(sudo:session): session closed for user root Jul 10 10:10:14 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-59519c71-b5df-4612-b2dd-edfb75b65d71 tempest-VolumesGetTest-197214973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0ddaa956-2d32-4c03-9ea1-4f27b4671e18" returned: 0 in 0.670s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:10:14 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-59519c71-b5df-4612-b2dd-edfb75b65d71 tempest-VolumesGetTest-197214973 None] Lock "cinder-quobyte-0ddaa956-2d32-4c03-9ea1-4f27b4671e18" released by "delete_volume" :: held 2.718s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:10:14 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-59519c71-b5df-4612-b2dd-edfb75b65d71 tempest-VolumesGetTest-197214973 None] Created reservations ['b533f230-6df5-474d-8a80-1fbda08d8dad', '80e1a693-1739-490e-ac6a-c948c25a615d', '69229241-986d-4ce2-8343-7b5cfeeeb068', '133962e2-87e8-4ec4-b5e4-44bc8c1ca912'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:10:14 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-59519c71-b5df-4612-b2dd-edfb75b65d71 tempest-VolumesGetTest-197214973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:10:14 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-59519c71-b5df-4612-b2dd-edfb75b65d71 tempest-VolumesGetTest-197214973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:10:14 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-59519c71-b5df-4612-b2dd-edfb75b65d71 tempest-VolumesGetTest-197214973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:10:14 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-59519c71-b5df-4612-b2dd-edfb75b65d71 tempest-VolumesGetTest-197214973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:10:14 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-59519c71-b5df-4612-b2dd-edfb75b65d71 tempest-VolumesGetTest-197214973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:10:14 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-59519c71-b5df-4612-b2dd-edfb75b65d71 tempest-VolumesGetTest-197214973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:10:14 devstack sudo[94971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:10:14 devstack sudo[94971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:10:14 devstack sudo[94969]: pam_unix(sudo:session): session closed for user root Jul 10 10:10:14 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-975be127-8011-4f60-b34e-178a95a4cc94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c61cb7df-5e8f-4780-9ed4-69a5adeb6cea" returned: 0 in 0.751s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:10:14 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-975be127-8011-4f60-b34e-178a95a4cc94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] <== create_volume: return (1679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:10:14 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-975be127-8011-4f60-b34e-178a95a4cc94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.681s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:10:15 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-975be127-8011-4f60-b34e-178a95a4cc94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64ceee3c-39a8-45ea-bb79-b77c9ee3c5a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c61cb7df-5e8f-4780-9ed4-69a5adeb6cea', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:10:15 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-975be127-8011-4f60-b34e-178a95a4cc94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dc1e185-284f-4df9-9dd8-32e5084f5c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:10:15 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-975be127-8011-4f60-b34e-178a95a4cc94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] Volume volume-c61cb7df-5e8f-4780-9ed4-69a5adeb6cea (c61cb7df-5e8f-4780-9ed4-69a5adeb6cea): created successfully Jul 10 10:10:15 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-975be127-8011-4f60-b34e-178a95a4cc94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dc1e185-284f-4df9-9dd8-32e5084f5c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:10:15 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-975be127-8011-4f60-b34e-178a95a4cc94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] Flow 'volume_create_manager' (727d1d8e-9900-48df-afa6-bc5f9f978643) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:10:15 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-975be127-8011-4f60-b34e-178a95a4cc94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] Created volume successfully. Jul 10 10:10:15 devstack sudo[94971]: pam_unix(sudo:session): session closed for user root Jul 10 10:10:15 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-59519c71-b5df-4612-b2dd-edfb75b65d71 tempest-VolumesGetTest-197214973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.815s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:10:15 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-59519c71-b5df-4612-b2dd-edfb75b65d71 tempest-VolumesGetTest-197214973 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:10:15 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-59519c71-b5df-4612-b2dd-edfb75b65d71 tempest-VolumesGetTest-197214973 None] Deleted volume successfully. Jul 10 10:10:15 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-59519c71-b5df-4612-b2dd-edfb75b65d71 tempest-VolumesGetTest-197214973 None] Lock "cinder-0ddaa956-2d32-4c03-9ea1-4f27b4671e18-delete_volume" released by "delete_volume" :: held 3.849s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:10:15 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-b304a30d-e037-4b1f-aba1-e7aadf2dd8a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:10:15 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-b304a30d-e037-4b1f-aba1-e7aadf2dd8a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:10:15 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-b304a30d-e037-4b1f-aba1-e7aadf2dd8a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] Creating offline snapshot 19fbcd4c-20b3-4f65-bc95-666f9eab9a5d of volume c61cb7df-5e8f-4780-9ed4-69a5adeb6cea {{(pid=87234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 10:10:15 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1e46e7-7bd8-4a32-83a9-a42db42f5a7e]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:10:15 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-b304a30d-e037-4b1f-aba1-e7aadf2dd8a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c61cb7df-5e8f-4780-9ed4-69a5adeb6cea {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:10:15 devstack sudo[94977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c61cb7df-5e8f-4780-9ed4-69a5adeb6cea Jul 10 10:10:15 devstack sudo[94977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:10:16 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-f70300b5-6967-432c-a0eb-b2e9ebf6e69b tempest-AttachVolumeTestJSON-202001593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:10:16 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f70300b5-6967-432c-a0eb-b2e9ebf6e69b tempest-AttachVolumeTestJSON-202001593 None] Flow 'volume_create_manager' (781a93b2-5772-47b5-8c8f-48e7e7f16b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:10:16 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f70300b5-6967-432c-a0eb-b2e9ebf6e69b tempest-AttachVolumeTestJSON-202001593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c636f59f-d1ec-4ecf-8f02-5a4b558471a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:10:16 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f70300b5-6967-432c-a0eb-b2e9ebf6e69b tempest-AttachVolumeTestJSON-202001593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c636f59f-d1ec-4ecf-8f02-5a4b558471a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-828741189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54e3082c-43ed-462f-a69e-8185d20660cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d966001b9e149a5abffd793edefdb23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:10:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:10:16Z,use_quota=True,user_id='1f1147266c9a478b8054352a9f42bd97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:10:16 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f70300b5-6967-432c-a0eb-b2e9ebf6e69b tempest-AttachVolumeTestJSON-202001593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c144a50-494c-4cdc-8529-d598e9ac6887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:10:16 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f70300b5-6967-432c-a0eb-b2e9ebf6e69b tempest-AttachVolumeTestJSON-202001593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c144a50-494c-4cdc-8529-d598e9ac6887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:10:16 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f70300b5-6967-432c-a0eb-b2e9ebf6e69b tempest-AttachVolumeTestJSON-202001593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aabb529f-3fd0-4fcf-b2e2-e67194088024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:10:16 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f70300b5-6967-432c-a0eb-b2e9ebf6e69b tempest-AttachVolumeTestJSON-202001593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aabb529f-3fd0-4fcf-b2e2-e67194088024) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54e3082c-43ed-462f-a69e-8185d20660cb', 'volume_name': 'volume-54e3082c-43ed-462f-a69e-8185d20660cb', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:10:16 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f70300b5-6967-432c-a0eb-b2e9ebf6e69b tempest-AttachVolumeTestJSON-202001593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c36c3041-a4de-40d2-8d19-6e2bd9c95e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:10:16 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f70300b5-6967-432c-a0eb-b2e9ebf6e69b tempest-AttachVolumeTestJSON-202001593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c36c3041-a4de-40d2-8d19-6e2bd9c95e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:10:16 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f70300b5-6967-432c-a0eb-b2e9ebf6e69b tempest-AttachVolumeTestJSON-202001593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (698a95c6-9632-4430-a0f0-df7b014b4c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:10:16 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-f70300b5-6967-432c-a0eb-b2e9ebf6e69b tempest-AttachVolumeTestJSON-202001593 None] Volume 54e3082c-43ed-462f-a69e-8185d20660cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54e3082c-43ed-462f-a69e-8185d20660cb', 'volume_size': 1} Jul 10 10:10:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f70300b5-6967-432c-a0eb-b2e9ebf6e69b tempest-AttachVolumeTestJSON-202001593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:10:16 devstack sudo[94977]: pam_unix(sudo:session): session closed for user root Jul 10 10:10:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-b304a30d-e037-4b1f-aba1-e7aadf2dd8a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c61cb7df-5e8f-4780-9ed4-69a5adeb6cea" returned: 0 in 0.948s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:10:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-b304a30d-e037-4b1f-aba1-e7aadf2dd8a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c61cb7df-5e8f-4780-9ed4-69a5adeb6cea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c61cb7df-5e8f-4780-9ed4-69a5adeb6cea.19fbcd4c-20b3-4f65-bc95-666f9eab9a5d 1G {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:10:16 devstack sudo[94983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c61cb7df-5e8f-4780-9ed4-69a5adeb6cea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c61cb7df-5e8f-4780-9ed4-69a5adeb6cea.19fbcd4c-20b3-4f65-bc95-666f9eab9a5d 1G Jul 10 10:10:16 devstack sudo[94983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:10:17 devstack sudo[94983]: pam_unix(sudo:session): session closed for user root Jul 10 10:10:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-b304a30d-e037-4b1f-aba1-e7aadf2dd8a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c61cb7df-5e8f-4780-9ed4-69a5adeb6cea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c61cb7df-5e8f-4780-9ed4-69a5adeb6cea.19fbcd4c-20b3-4f65-bc95-666f9eab9a5d 1G" returned: 0 in 0.979s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:10:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-b304a30d-e037-4b1f-aba1-e7aadf2dd8a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c61cb7df-5e8f-4780-9ed4-69a5adeb6cea -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c61cb7df-5e8f-4780-9ed4-69a5adeb6cea.19fbcd4c-20b3-4f65-bc95-666f9eab9a5d {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:10:17 devstack sudo[94989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c61cb7df-5e8f-4780-9ed4-69a5adeb6cea -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c61cb7df-5e8f-4780-9ed4-69a5adeb6cea.19fbcd4c-20b3-4f65-bc95-666f9eab9a5d Jul 10 10:10:17 devstack sudo[94989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:10:18 devstack sudo[94989]: pam_unix(sudo:session): session closed for user root Jul 10 10:10:18 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-b304a30d-e037-4b1f-aba1-e7aadf2dd8a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c61cb7df-5e8f-4780-9ed4-69a5adeb6cea -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c61cb7df-5e8f-4780-9ed4-69a5adeb6cea.19fbcd4c-20b3-4f65-bc95-666f9eab9a5d" returned: 0 in 0.785s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:10:18 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-b304a30d-e037-4b1f-aba1-e7aadf2dd8a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c61cb7df-5e8f-4780-9ed4-69a5adeb6cea.19fbcd4c-20b3-4f65-bc95-666f9eab9a5d is being set with open permissions: ugo+rw Jul 10 10:10:18 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-b304a30d-e037-4b1f-aba1-e7aadf2dd8a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c61cb7df-5e8f-4780-9ed4-69a5adeb6cea.19fbcd4c-20b3-4f65-bc95-666f9eab9a5d {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:10:18 devstack sudo[94994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c61cb7df-5e8f-4780-9ed4-69a5adeb6cea.19fbcd4c-20b3-4f65-bc95-666f9eab9a5d Jul 10 10:10:18 devstack sudo[94994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:10:18 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-c370ba83-cf22-4802-a65f-bfe84d7fd440 tempest-VolumesNegativeTest-532697711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:10:18 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c370ba83-cf22-4802-a65f-bfe84d7fd440 tempest-VolumesNegativeTest-532697711 None] Flow 'volume_create_manager' (8d9c4e09-221e-4fcb-b283-5539bec484a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:10:18 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c370ba83-cf22-4802-a65f-bfe84d7fd440 tempest-VolumesNegativeTest-532697711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6437136b-ed5a-4fcf-ba30-91c620a80cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:10:18 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c370ba83-cf22-4802-a65f-bfe84d7fd440 tempest-VolumesNegativeTest-532697711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6437136b-ed5a-4fcf-ba30-91c620a80cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:10:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1316509674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f34a6c81-b9bf-4953-b4a3-91e9c5096401,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47018a233a894997bdffc7ff3b5c75e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:10:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:10:19Z,use_quota=True,user_id='5b0d37291290447da6fe464e662a25b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:10:18 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c370ba83-cf22-4802-a65f-bfe84d7fd440 tempest-VolumesNegativeTest-532697711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33f7c1a1-07a1-48bf-89ab-e7a18ca6cfc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:10:18 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c370ba83-cf22-4802-a65f-bfe84d7fd440 tempest-VolumesNegativeTest-532697711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33f7c1a1-07a1-48bf-89ab-e7a18ca6cfc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:10:18 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c370ba83-cf22-4802-a65f-bfe84d7fd440 tempest-VolumesNegativeTest-532697711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17666eca-06b6-4e9c-81db-20b63ebfcf2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:10:18 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c370ba83-cf22-4802-a65f-bfe84d7fd440 tempest-VolumesNegativeTest-532697711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17666eca-06b6-4e9c-81db-20b63ebfcf2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f34a6c81-b9bf-4953-b4a3-91e9c5096401', 'volume_name': 'volume-f34a6c81-b9bf-4953-b4a3-91e9c5096401', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:10:18 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c370ba83-cf22-4802-a65f-bfe84d7fd440 tempest-VolumesNegativeTest-532697711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f150997-a2cc-4c75-8ca3-55d28aa1a975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:10:18 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c370ba83-cf22-4802-a65f-bfe84d7fd440 tempest-VolumesNegativeTest-532697711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f150997-a2cc-4c75-8ca3-55d28aa1a975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:10:18 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c370ba83-cf22-4802-a65f-bfe84d7fd440 tempest-VolumesNegativeTest-532697711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e45c0e0-89b6-40f5-9232-6254bd75ceca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:10:18 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-c370ba83-cf22-4802-a65f-bfe84d7fd440 tempest-VolumesNegativeTest-532697711 None] Volume f34a6c81-b9bf-4953-b4a3-91e9c5096401: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f34a6c81-b9bf-4953-b4a3-91e9c5096401', 'volume_size': 1} Jul 10 10:10:18 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-c370ba83-cf22-4802-a65f-bfe84d7fd440 tempest-VolumesNegativeTest-532697711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:10:19 devstack sudo[94994]: pam_unix(sudo:session): session closed for user root Jul 10 10:10:19 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-b304a30d-e037-4b1f-aba1-e7aadf2dd8a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c61cb7df-5e8f-4780-9ed4-69a5adeb6cea.19fbcd4c-20b3-4f65-bc95-666f9eab9a5d" returned: 0 in 0.692s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:10:19 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-b304a30d-e037-4b1f-aba1-e7aadf2dd8a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c61cb7df-5e8f-4780-9ed4-69a5adeb6cea.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:10:19 devstack sudo[94998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c61cb7df-5e8f-4780-9ed4-69a5adeb6cea.info Jul 10 10:10:19 devstack sudo[94998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:10:19 devstack sudo[94998]: pam_unix(sudo:session): session closed for user root Jul 10 10:10:19 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-b304a30d-e037-4b1f-aba1-e7aadf2dd8a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c61cb7df-5e8f-4780-9ed4-69a5adeb6cea.info" returned: 0 in 0.696s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:10:19 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-b304a30d-e037-4b1f-aba1-e7aadf2dd8a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c61cb7df-5e8f-4780-9ed4-69a5adeb6cea.info is being set with open permissions: ugo+rw Jul 10 10:10:19 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-b304a30d-e037-4b1f-aba1-e7aadf2dd8a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c61cb7df-5e8f-4780-9ed4-69a5adeb6cea.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:10:19 devstack sudo[95002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c61cb7df-5e8f-4780-9ed4-69a5adeb6cea.info Jul 10 10:10:19 devstack sudo[95002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:10:20 devstack sudo[95002]: pam_unix(sudo:session): session closed for user root Jul 10 10:10:20 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-b304a30d-e037-4b1f-aba1-e7aadf2dd8a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c61cb7df-5e8f-4780-9ed4-69a5adeb6cea.info" returned: 0 in 0.687s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:10:20 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-b304a30d-e037-4b1f-aba1-e7aadf2dd8a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.925s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:10:20 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f70300b5-6967-432c-a0eb-b2e9ebf6e69b tempest-AttachVolumeTestJSON-202001593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.260s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:10:20 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f70300b5-6967-432c-a0eb-b2e9ebf6e69b tempest-AttachVolumeTestJSON-202001593 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-828741189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54e3082c-43ed-462f-a69e-8185d20660cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d966001b9e149a5abffd793edefdb23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:10:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:10:16Z,use_quota=True,user_id='1f1147266c9a478b8054352a9f42bd97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:10:20 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-f70300b5-6967-432c-a0eb-b2e9ebf6e69b tempest-AttachVolumeTestJSON-202001593 None] Creating volume 54e3082c-43ed-462f-a69e-8185d20660cb {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:10:20 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f70300b5-6967-432c-a0eb-b2e9ebf6e69b tempest-AttachVolumeTestJSON-202001593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:10:20 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f70300b5-6967-432c-a0eb-b2e9ebf6e69b tempest-AttachVolumeTestJSON-202001593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:10:20 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f70300b5-6967-432c-a0eb-b2e9ebf6e69b tempest-AttachVolumeTestJSON-202001593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:10:20 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f70300b5-6967-432c-a0eb-b2e9ebf6e69b tempest-AttachVolumeTestJSON-202001593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:10:20 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f70300b5-6967-432c-a0eb-b2e9ebf6e69b tempest-AttachVolumeTestJSON-202001593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:10:20 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f70300b5-6967-432c-a0eb-b2e9ebf6e69b tempest-AttachVolumeTestJSON-202001593 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:10:20 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-f70300b5-6967-432c-a0eb-b2e9ebf6e69b tempest-AttachVolumeTestJSON-202001593 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:10:20 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f70300b5-6967-432c-a0eb-b2e9ebf6e69b tempest-AttachVolumeTestJSON-202001593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-54e3082c-43ed-462f-a69e-8185d20660cb 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:10:20 devstack sudo[95005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-54e3082c-43ed-462f-a69e-8185d20660cb 1073741824 Jul 10 10:10:20 devstack sudo[95005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:10:20 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-b304a30d-e037-4b1f-aba1-e7aadf2dd8a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] Create snapshot completed successfully Jul 10 10:10:21 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-5c651c6b-ce2a-4e49-8fc4-e5c3b5edb236 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] Acquiring lock "cinder-19fbcd4c-20b3-4f65-bc95-666f9eab9a5d-delete_snapshot" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:10:21 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-5c651c6b-ce2a-4e49-8fc4-e5c3b5edb236 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] Lock "cinder-19fbcd4c-20b3-4f65-bc95-666f9eab9a5d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:10:21 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-5c651c6b-ce2a-4e49-8fc4-e5c3b5edb236 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] Acquiring lock "cinder-quobyte-c61cb7df-5e8f-4780-9ed4-69a5adeb6cea" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:10:21 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-5c651c6b-ce2a-4e49-8fc4-e5c3b5edb236 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] Lock "cinder-quobyte-c61cb7df-5e8f-4780-9ed4-69a5adeb6cea" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:10:21 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-5c651c6b-ce2a-4e49-8fc4-e5c3b5edb236 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] Acquiring lock "cinder-quobyte-19fbcd4c-20b3-4f65-bc95-666f9eab9a5d" by "_delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:10:21 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-5c651c6b-ce2a-4e49-8fc4-e5c3b5edb236 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] Lock "cinder-quobyte-19fbcd4c-20b3-4f65-bc95-666f9eab9a5d" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:10:21 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-5c651c6b-ce2a-4e49-8fc4-e5c3b5edb236 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] Deleting offline snapshot 19fbcd4c-20b3-4f65-bc95-666f9eab9a5d of volume c61cb7df-5e8f-4780-9ed4-69a5adeb6cea {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 10:10:21 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-5c651c6b-ce2a-4e49-8fc4-e5c3b5edb236 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] snapshot_file for this snap is: volume-c61cb7df-5e8f-4780-9ed4-69a5adeb6cea.19fbcd4c-20b3-4f65-bc95-666f9eab9a5d {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 10:10:21 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f8f56aa-f412-4138-ad26-786aa18f2af0]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:10:21 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5c651c6b-ce2a-4e49-8fc4-e5c3b5edb236 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c61cb7df-5e8f-4780-9ed4-69a5adeb6cea.19fbcd4c-20b3-4f65-bc95-666f9eab9a5d {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:10:21 devstack sudo[95005]: pam_unix(sudo:session): session closed for user root Jul 10 10:10:21 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f70300b5-6967-432c-a0eb-b2e9ebf6e69b tempest-AttachVolumeTestJSON-202001593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-54e3082c-43ed-462f-a69e-8185d20660cb 1073741824" returned: 0 in 1.037s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:10:21 devstack sudo[95011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c61cb7df-5e8f-4780-9ed4-69a5adeb6cea.19fbcd4c-20b3-4f65-bc95-666f9eab9a5d Jul 10 10:10:21 devstack sudo[95011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:10:21 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f70300b5-6967-432c-a0eb-b2e9ebf6e69b tempest-AttachVolumeTestJSON-202001593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-54e3082c-43ed-462f-a69e-8185d20660cb {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:10:21 devstack sudo[95013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-54e3082c-43ed-462f-a69e-8185d20660cb Jul 10 10:10:21 devstack sudo[95013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:10:22 devstack sudo[95011]: pam_unix(sudo:session): session closed for user root Jul 10 10:10:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5c651c6b-ce2a-4e49-8fc4-e5c3b5edb236 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c61cb7df-5e8f-4780-9ed4-69a5adeb6cea.19fbcd4c-20b3-4f65-bc95-666f9eab9a5d" returned: 0 in 0.925s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:10:22 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-5c651c6b-ce2a-4e49-8fc4-e5c3b5edb236 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c61cb7df-5e8f-4780-9ed4-69a5adeb6cea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 10:10:22 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[f15b9cd0-fba9-4608-89ff-9aa9222559cd]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:10:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5c651c6b-ce2a-4e49-8fc4-e5c3b5edb236 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c61cb7df-5e8f-4780-9ed4-69a5adeb6cea {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:10:22 devstack sudo[95013]: pam_unix(sudo:session): session closed for user root Jul 10 10:10:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f70300b5-6967-432c-a0eb-b2e9ebf6e69b tempest-AttachVolumeTestJSON-202001593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-54e3082c-43ed-462f-a69e-8185d20660cb" returned: 0 in 0.788s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:10:22 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f70300b5-6967-432c-a0eb-b2e9ebf6e69b tempest-AttachVolumeTestJSON-202001593 None] <== create_volume: return (1891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:10:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f70300b5-6967-432c-a0eb-b2e9ebf6e69b tempest-AttachVolumeTestJSON-202001593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.895s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:10:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-c370ba83-cf22-4802-a65f-bfe84d7fd440 tempest-VolumesNegativeTest-532697711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.746s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:10:22 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-c370ba83-cf22-4802-a65f-bfe84d7fd440 tempest-VolumesNegativeTest-532697711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:10:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1316509674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f34a6c81-b9bf-4953-b4a3-91e9c5096401,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47018a233a894997bdffc7ff3b5c75e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:10:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:10:19Z,use_quota=True,user_id='5b0d37291290447da6fe464e662a25b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:10:22 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-c370ba83-cf22-4802-a65f-bfe84d7fd440 tempest-VolumesNegativeTest-532697711 None] Creating volume f34a6c81-b9bf-4953-b4a3-91e9c5096401 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:10:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-c370ba83-cf22-4802-a65f-bfe84d7fd440 tempest-VolumesNegativeTest-532697711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:10:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-c370ba83-cf22-4802-a65f-bfe84d7fd440 tempest-VolumesNegativeTest-532697711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:10:22 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-c370ba83-cf22-4802-a65f-bfe84d7fd440 tempest-VolumesNegativeTest-532697711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:10:22 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-c370ba83-cf22-4802-a65f-bfe84d7fd440 tempest-VolumesNegativeTest-532697711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:10:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-c370ba83-cf22-4802-a65f-bfe84d7fd440 tempest-VolumesNegativeTest-532697711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:10:22 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-c370ba83-cf22-4802-a65f-bfe84d7fd440 tempest-VolumesNegativeTest-532697711 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:10:22 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-c370ba83-cf22-4802-a65f-bfe84d7fd440 tempest-VolumesNegativeTest-532697711 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:10:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c370ba83-cf22-4802-a65f-bfe84d7fd440 tempest-VolumesNegativeTest-532697711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f34a6c81-b9bf-4953-b4a3-91e9c5096401 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:10:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f70300b5-6967-432c-a0eb-b2e9ebf6e69b tempest-AttachVolumeTestJSON-202001593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (698a95c6-9632-4430-a0f0-df7b014b4c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54e3082c-43ed-462f-a69e-8185d20660cb', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:10:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f70300b5-6967-432c-a0eb-b2e9ebf6e69b tempest-AttachVolumeTestJSON-202001593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad5f9f44-ca52-483b-bc49-a92088b80b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:10:22 devstack sudo[95022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f34a6c81-b9bf-4953-b4a3-91e9c5096401 1073741824 Jul 10 10:10:22 devstack sudo[95022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:10:22 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-f70300b5-6967-432c-a0eb-b2e9ebf6e69b tempest-AttachVolumeTestJSON-202001593 None] Volume volume-54e3082c-43ed-462f-a69e-8185d20660cb (54e3082c-43ed-462f-a69e-8185d20660cb): created successfully Jul 10 10:10:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f70300b5-6967-432c-a0eb-b2e9ebf6e69b tempest-AttachVolumeTestJSON-202001593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad5f9f44-ca52-483b-bc49-a92088b80b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:10:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f70300b5-6967-432c-a0eb-b2e9ebf6e69b tempest-AttachVolumeTestJSON-202001593 None] Flow 'volume_create_manager' (781a93b2-5772-47b5-8c8f-48e7e7f16b11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:10:22 devstack sudo[95021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c61cb7df-5e8f-4780-9ed4-69a5adeb6cea Jul 10 10:10:22 devstack sudo[95021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:10:22 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-f70300b5-6967-432c-a0eb-b2e9ebf6e69b tempest-AttachVolumeTestJSON-202001593 None] Created volume successfully. Jul 10 10:10:23 devstack sudo[95021]: pam_unix(sudo:session): session closed for user root Jul 10 10:10:23 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5c651c6b-ce2a-4e49-8fc4-e5c3b5edb236 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c61cb7df-5e8f-4780-9ed4-69a5adeb6cea" returned: 0 in 0.814s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:10:23 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5c651c6b-ce2a-4e49-8fc4-e5c3b5edb236 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c61cb7df-5e8f-4780-9ed4-69a5adeb6cea.19fbcd4c-20b3-4f65-bc95-666f9eab9a5d {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:10:23 devstack sudo[95032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c61cb7df-5e8f-4780-9ed4-69a5adeb6cea.19fbcd4c-20b3-4f65-bc95-666f9eab9a5d Jul 10 10:10:23 devstack sudo[95032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:10:23 devstack sudo[95022]: pam_unix(sudo:session): session closed for user root Jul 10 10:10:23 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c370ba83-cf22-4802-a65f-bfe84d7fd440 tempest-VolumesNegativeTest-532697711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f34a6c81-b9bf-4953-b4a3-91e9c5096401 1073741824" returned: 0 in 0.982s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:10:23 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c370ba83-cf22-4802-a65f-bfe84d7fd440 tempest-VolumesNegativeTest-532697711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f34a6c81-b9bf-4953-b4a3-91e9c5096401 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:10:23 devstack sudo[95034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f34a6c81-b9bf-4953-b4a3-91e9c5096401 Jul 10 10:10:23 devstack sudo[95034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:10:24 devstack sudo[95032]: pam_unix(sudo:session): session closed for user root Jul 10 10:10:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5c651c6b-ce2a-4e49-8fc4-e5c3b5edb236 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c61cb7df-5e8f-4780-9ed4-69a5adeb6cea.19fbcd4c-20b3-4f65-bc95-666f9eab9a5d" returned: 0 in 0.921s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:10:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5c651c6b-ce2a-4e49-8fc4-e5c3b5edb236 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c61cb7df-5e8f-4780-9ed4-69a5adeb6cea.19fbcd4c-20b3-4f65-bc95-666f9eab9a5d {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:10:24 devstack sudo[95044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c61cb7df-5e8f-4780-9ed4-69a5adeb6cea.19fbcd4c-20b3-4f65-bc95-666f9eab9a5d Jul 10 10:10:24 devstack sudo[95044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:10:24 devstack sudo[95034]: pam_unix(sudo:session): session closed for user root Jul 10 10:10:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c370ba83-cf22-4802-a65f-bfe84d7fd440 tempest-VolumesNegativeTest-532697711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f34a6c81-b9bf-4953-b4a3-91e9c5096401" returned: 0 in 0.787s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:10:24 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-c370ba83-cf22-4802-a65f-bfe84d7fd440 tempest-VolumesNegativeTest-532697711 None] <== create_volume: return (1837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:10:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-c370ba83-cf22-4802-a65f-bfe84d7fd440 tempest-VolumesNegativeTest-532697711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.841s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:10:24 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c370ba83-cf22-4802-a65f-bfe84d7fd440 tempest-VolumesNegativeTest-532697711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e45c0e0-89b6-40f5-9232-6254bd75ceca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f34a6c81-b9bf-4953-b4a3-91e9c5096401', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:10:24 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c370ba83-cf22-4802-a65f-bfe84d7fd440 tempest-VolumesNegativeTest-532697711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1786ac63-e99d-4170-8846-e118dbca4c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:10:24 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-c370ba83-cf22-4802-a65f-bfe84d7fd440 tempest-VolumesNegativeTest-532697711 None] Volume volume-f34a6c81-b9bf-4953-b4a3-91e9c5096401 (f34a6c81-b9bf-4953-b4a3-91e9c5096401): created successfully Jul 10 10:10:24 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c370ba83-cf22-4802-a65f-bfe84d7fd440 tempest-VolumesNegativeTest-532697711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1786ac63-e99d-4170-8846-e118dbca4c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:10:24 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c370ba83-cf22-4802-a65f-bfe84d7fd440 tempest-VolumesNegativeTest-532697711 None] Flow 'volume_create_manager' (8d9c4e09-221e-4fcb-b283-5539bec484a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:10:24 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-c370ba83-cf22-4802-a65f-bfe84d7fd440 tempest-VolumesNegativeTest-532697711 None] Created volume successfully. Jul 10 10:10:24 devstack sudo[95044]: pam_unix(sudo:session): session closed for user root Jul 10 10:10:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5c651c6b-ce2a-4e49-8fc4-e5c3b5edb236 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c61cb7df-5e8f-4780-9ed4-69a5adeb6cea.19fbcd4c-20b3-4f65-bc95-666f9eab9a5d" returned: 0 in 0.692s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:10:24 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-5c651c6b-ce2a-4e49-8fc4-e5c3b5edb236 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] Lock "cinder-quobyte-19fbcd4c-20b3-4f65-bc95-666f9eab9a5d" released by "_delete_snapshot" :: held 3.515s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:10:24 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-5c651c6b-ce2a-4e49-8fc4-e5c3b5edb236 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] Lock "cinder-quobyte-c61cb7df-5e8f-4780-9ed4-69a5adeb6cea" released by "delete_snapshot" :: held 3.553s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:10:24 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-5c651c6b-ce2a-4e49-8fc4-e5c3b5edb236 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] Created reservations ['2e19d3e7-5a62-4572-8daa-b496ead3cc7d', '7d67ba26-221c-4f55-b0c3-5fd1269662d4', 'a5f39807-c3ee-4c1a-8232-fb9f6df09f89', '6ad84516-b7ee-4637-8738-074e3193c8d2'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:10:25 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-5c651c6b-ce2a-4e49-8fc4-e5c3b5edb236 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] Delete snapshot completed successfully. Jul 10 10:10:25 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-5c651c6b-ce2a-4e49-8fc4-e5c3b5edb236 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] Lock "cinder-19fbcd4c-20b3-4f65-bc95-666f9eab9a5d-delete_snapshot" released by "delete_snapshot" :: held 3.726s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:10:25 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-49002f05-a72f-4821-b5c5-8d402f1d39b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] Acquiring lock "cinder-c61cb7df-5e8f-4780-9ed4-69a5adeb6cea-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:10:25 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-49002f05-a72f-4821-b5c5-8d402f1d39b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] Lock "cinder-c61cb7df-5e8f-4780-9ed4-69a5adeb6cea-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:10:25 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-49002f05-a72f-4821-b5c5-8d402f1d39b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] Acquiring lock "cinder-quobyte-c61cb7df-5e8f-4780-9ed4-69a5adeb6cea" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:10:25 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-49002f05-a72f-4821-b5c5-8d402f1d39b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] Lock "cinder-quobyte-c61cb7df-5e8f-4780-9ed4-69a5adeb6cea" acquired by "delete_volume" :: waited 0.029s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:10:25 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[9789ed7d-0373-478e-8612-d80636c0e6a9]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:10:25 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-49002f05-a72f-4821-b5c5-8d402f1d39b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c61cb7df-5e8f-4780-9ed4-69a5adeb6cea {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:10:26 devstack sudo[95051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c61cb7df-5e8f-4780-9ed4-69a5adeb6cea Jul 10 10:10:26 devstack sudo[95051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:10:27 devstack sudo[95051]: pam_unix(sudo:session): session closed for user root Jul 10 10:10:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-49002f05-a72f-4821-b5c5-8d402f1d39b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c61cb7df-5e8f-4780-9ed4-69a5adeb6cea" returned: 0 in 1.181s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:10:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-49002f05-a72f-4821-b5c5-8d402f1d39b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c61cb7df-5e8f-4780-9ed4-69a5adeb6cea {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:10:27 devstack sudo[95067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c61cb7df-5e8f-4780-9ed4-69a5adeb6cea Jul 10 10:10:27 devstack sudo[95067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:10:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-9f5b9ad4-7f1c-4047-8d9b-56a543107e33 req-785fa828-0b8e-455a-b233-741f6fe93251 tempest-AttachVolumeTestJSON-202001593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:10:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-9f5b9ad4-7f1c-4047-8d9b-56a543107e33 req-785fa828-0b8e-455a-b233-741f6fe93251 tempest-AttachVolumeTestJSON-202001593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:10:27 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff3836a-9818-4258-8ec1-34db767872af]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:10:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-9f5b9ad4-7f1c-4047-8d9b-56a543107e33 req-785fa828-0b8e-455a-b233-741f6fe93251 tempest-AttachVolumeTestJSON-202001593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-54e3082c-43ed-462f-a69e-8185d20660cb {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:10:27 devstack sudo[95069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-54e3082c-43ed-462f-a69e-8185d20660cb Jul 10 10:10:27 devstack sudo[95069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:10:27 devstack sudo[95067]: pam_unix(sudo:session): session closed for user root Jul 10 10:10:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-49002f05-a72f-4821-b5c5-8d402f1d39b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c61cb7df-5e8f-4780-9ed4-69a5adeb6cea" returned: 0 in 0.806s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:10:27 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-49002f05-a72f-4821-b5c5-8d402f1d39b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] Lock "cinder-quobyte-c61cb7df-5e8f-4780-9ed4-69a5adeb6cea" released by "delete_volume" :: held 2.123s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:10:27 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-49002f05-a72f-4821-b5c5-8d402f1d39b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] Created reservations ['a466b445-5212-4495-aaf8-1400dcaf4f1b', 'f97e92e9-952f-41f3-843a-d5cea249b105', '5c459eee-df12-45cc-a673-114c25abea89', 'f84e3c47-2c6e-4b83-99c6-604c415ed2a3'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:10:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-49002f05-a72f-4821-b5c5-8d402f1d39b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:10:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-49002f05-a72f-4821-b5c5-8d402f1d39b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:10:28 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-49002f05-a72f-4821-b5c5-8d402f1d39b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:10:28 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-49002f05-a72f-4821-b5c5-8d402f1d39b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:10:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-49002f05-a72f-4821-b5c5-8d402f1d39b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:10:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-49002f05-a72f-4821-b5c5-8d402f1d39b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:10:28 devstack sudo[95075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:10:28 devstack sudo[95075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:10:28 devstack sudo[95069]: pam_unix(sudo:session): session closed for user root Jul 10 10:10:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-9f5b9ad4-7f1c-4047-8d9b-56a543107e33 req-785fa828-0b8e-455a-b233-741f6fe93251 tempest-AttachVolumeTestJSON-202001593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-54e3082c-43ed-462f-a69e-8185d20660cb" returned: 0 in 0.937s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:10:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-9f5b9ad4-7f1c-4047-8d9b-56a543107e33 req-785fa828-0b8e-455a-b233-741f6fe93251 tempest-AttachVolumeTestJSON-202001593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.966s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:10:28 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [req-9f5b9ad4-7f1c-4047-8d9b-56a543107e33 req-785fa828-0b8e-455a-b233-741f6fe93251 tempest-AttachVolumeTestJSON-202001593 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091', 'name': 'volume-54e3082c-43ed-462f-a69e-8185d20660cb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ea89ff21-463c-4646-9df6-85e1105826dd', 'enforce_multipath': True} {{(pid=87234) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 10:10:28 devstack cinder-volume[87234]: INFO cinder.volume.manager [req-9f5b9ad4-7f1c-4047-8d9b-56a543107e33 req-785fa828-0b8e-455a-b233-741f6fe93251 tempest-AttachVolumeTestJSON-202001593 None] attachment_update completed successfully. Jul 10 10:10:28 devstack sudo[95075]: pam_unix(sudo:session): session closed for user root Jul 10 10:10:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-49002f05-a72f-4821-b5c5-8d402f1d39b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.751s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:10:28 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-49002f05-a72f-4821-b5c5-8d402f1d39b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:10:28 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-49002f05-a72f-4821-b5c5-8d402f1d39b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] Deleted volume successfully. Jul 10 10:10:28 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-49002f05-a72f-4821-b5c5-8d402f1d39b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1076628572 None] Lock "cinder-c61cb7df-5e8f-4780-9ed4-69a5adeb6cea-delete_volume" released by "delete_volume" :: held 3.166s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:10:34 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fcd6ba6-9c81-43a0-b48a-e43381a44f99 tempest-AttachVolumeTestJSON-202001593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:10:34 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-0fcd6ba6-9c81-43a0-b48a-e43381a44f99 tempest-AttachVolumeTestJSON-202001593 None] Flow 'volume_create_manager' (191d3ac3-2efa-48a6-899e-8b8773db5a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:10:34 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-0fcd6ba6-9c81-43a0-b48a-e43381a44f99 tempest-AttachVolumeTestJSON-202001593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45ac3cca-1ddc-4d1d-87f3-43afb6f996ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:10:34 devstack cinder-volume[87234]: DEBUG dbcounter [-] [87234] Writing DB stats cinder:UPDATE=127,cinder:SELECT=108,cinder:INSERT=37,cinder:DELETE=14 {{(pid=87234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 10:10:34 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-0fcd6ba6-9c81-43a0-b48a-e43381a44f99 tempest-AttachVolumeTestJSON-202001593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45ac3cca-1ddc-4d1d-87f3-43afb6f996ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:10:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1621198925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d73e33e7-165c-47b9-872a-44a441d45eaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d966001b9e149a5abffd793edefdb23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:10:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:10:34Z,use_quota=True,user_id='1f1147266c9a478b8054352a9f42bd97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:10:34 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-0fcd6ba6-9c81-43a0-b48a-e43381a44f99 tempest-AttachVolumeTestJSON-202001593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2948947f-0f39-4f35-82af-8f531ac3899e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:10:34 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-0fcd6ba6-9c81-43a0-b48a-e43381a44f99 tempest-AttachVolumeTestJSON-202001593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2948947f-0f39-4f35-82af-8f531ac3899e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:10:34 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-0fcd6ba6-9c81-43a0-b48a-e43381a44f99 tempest-AttachVolumeTestJSON-202001593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a549b17e-7046-4660-9958-a82aa8a5a626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:10:34 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-0fcd6ba6-9c81-43a0-b48a-e43381a44f99 tempest-AttachVolumeTestJSON-202001593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a549b17e-7046-4660-9958-a82aa8a5a626) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd73e33e7-165c-47b9-872a-44a441d45eaa', 'volume_name': 'volume-d73e33e7-165c-47b9-872a-44a441d45eaa', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:10:34 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-0fcd6ba6-9c81-43a0-b48a-e43381a44f99 tempest-AttachVolumeTestJSON-202001593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54ce6edc-b7e6-45ec-83c1-416030a46abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:10:34 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-0fcd6ba6-9c81-43a0-b48a-e43381a44f99 tempest-AttachVolumeTestJSON-202001593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54ce6edc-b7e6-45ec-83c1-416030a46abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:10:34 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-0fcd6ba6-9c81-43a0-b48a-e43381a44f99 tempest-AttachVolumeTestJSON-202001593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22f866c0-1e64-4f70-b0d8-4abdd2533f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:10:34 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-0fcd6ba6-9c81-43a0-b48a-e43381a44f99 tempest-AttachVolumeTestJSON-202001593 None] Volume d73e33e7-165c-47b9-872a-44a441d45eaa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d73e33e7-165c-47b9-872a-44a441d45eaa', 'volume_size': 1} Jul 10 10:10:34 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-0fcd6ba6-9c81-43a0-b48a-e43381a44f99 tempest-AttachVolumeTestJSON-202001593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:10:34 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-0fcd6ba6-9c81-43a0-b48a-e43381a44f99 tempest-AttachVolumeTestJSON-202001593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:10:34 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-0fcd6ba6-9c81-43a0-b48a-e43381a44f99 tempest-AttachVolumeTestJSON-202001593 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:10:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1621198925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d73e33e7-165c-47b9-872a-44a441d45eaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d966001b9e149a5abffd793edefdb23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:10:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:10:34Z,use_quota=True,user_id='1f1147266c9a478b8054352a9f42bd97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:10:34 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-0fcd6ba6-9c81-43a0-b48a-e43381a44f99 tempest-AttachVolumeTestJSON-202001593 None] Creating volume d73e33e7-165c-47b9-872a-44a441d45eaa {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:10:34 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-0fcd6ba6-9c81-43a0-b48a-e43381a44f99 tempest-AttachVolumeTestJSON-202001593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:10:34 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-0fcd6ba6-9c81-43a0-b48a-e43381a44f99 tempest-AttachVolumeTestJSON-202001593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:10:34 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-0fcd6ba6-9c81-43a0-b48a-e43381a44f99 tempest-AttachVolumeTestJSON-202001593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:10:34 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-0fcd6ba6-9c81-43a0-b48a-e43381a44f99 tempest-AttachVolumeTestJSON-202001593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:10:34 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-0fcd6ba6-9c81-43a0-b48a-e43381a44f99 tempest-AttachVolumeTestJSON-202001593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:10:34 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-0fcd6ba6-9c81-43a0-b48a-e43381a44f99 tempest-AttachVolumeTestJSON-202001593 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:10:34 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-0fcd6ba6-9c81-43a0-b48a-e43381a44f99 tempest-AttachVolumeTestJSON-202001593 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:10:34 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0fcd6ba6-9c81-43a0-b48a-e43381a44f99 tempest-AttachVolumeTestJSON-202001593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d73e33e7-165c-47b9-872a-44a441d45eaa 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:10:34 devstack sudo[95482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d73e33e7-165c-47b9-872a-44a441d45eaa 1073741824 Jul 10 10:10:34 devstack sudo[95482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:10:35 devstack sudo[95482]: pam_unix(sudo:session): session closed for user root Jul 10 10:10:35 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0fcd6ba6-9c81-43a0-b48a-e43381a44f99 tempest-AttachVolumeTestJSON-202001593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d73e33e7-165c-47b9-872a-44a441d45eaa 1073741824" returned: 0 in 1.316s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:10:35 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0fcd6ba6-9c81-43a0-b48a-e43381a44f99 tempest-AttachVolumeTestJSON-202001593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d73e33e7-165c-47b9-872a-44a441d45eaa {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:10:35 devstack sudo[95489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d73e33e7-165c-47b9-872a-44a441d45eaa Jul 10 10:10:35 devstack sudo[95489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:10:36 devstack sudo[95489]: pam_unix(sudo:session): session closed for user root Jul 10 10:10:36 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0fcd6ba6-9c81-43a0-b48a-e43381a44f99 tempest-AttachVolumeTestJSON-202001593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d73e33e7-165c-47b9-872a-44a441d45eaa" returned: 0 in 0.979s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:10:36 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-0fcd6ba6-9c81-43a0-b48a-e43381a44f99 tempest-AttachVolumeTestJSON-202001593 None] <== create_volume: return (2359ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:10:36 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-0fcd6ba6-9c81-43a0-b48a-e43381a44f99 tempest-AttachVolumeTestJSON-202001593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.361s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:10:36 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-0fcd6ba6-9c81-43a0-b48a-e43381a44f99 tempest-AttachVolumeTestJSON-202001593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22f866c0-1e64-4f70-b0d8-4abdd2533f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d73e33e7-165c-47b9-872a-44a441d45eaa', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:10:36 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-0fcd6ba6-9c81-43a0-b48a-e43381a44f99 tempest-AttachVolumeTestJSON-202001593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9bd0ecb-bdf4-45e7-874d-cda8a5bc47e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:10:36 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-0fcd6ba6-9c81-43a0-b48a-e43381a44f99 tempest-AttachVolumeTestJSON-202001593 None] Volume volume-d73e33e7-165c-47b9-872a-44a441d45eaa (d73e33e7-165c-47b9-872a-44a441d45eaa): created successfully Jul 10 10:10:36 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-0fcd6ba6-9c81-43a0-b48a-e43381a44f99 tempest-AttachVolumeTestJSON-202001593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9bd0ecb-bdf4-45e7-874d-cda8a5bc47e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:10:36 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-0fcd6ba6-9c81-43a0-b48a-e43381a44f99 tempest-AttachVolumeTestJSON-202001593 None] Flow 'volume_create_manager' (191d3ac3-2efa-48a6-899e-8b8773db5a9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:10:37 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-0fcd6ba6-9c81-43a0-b48a-e43381a44f99 tempest-AttachVolumeTestJSON-202001593 None] Created volume successfully. Jul 10 10:10:38 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-94325b40-2d88-41e2-a90a-a099e5019598 tempest-VolumeTypesAccessTest-876258851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:10:38 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-94325b40-2d88-41e2-a90a-a099e5019598 tempest-VolumeTypesAccessTest-876258851 None] Flow 'volume_create_manager' (7696295f-3523-4a0b-acea-1bf8422881be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:10:38 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-94325b40-2d88-41e2-a90a-a099e5019598 tempest-VolumeTypesAccessTest-876258851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (388b2d63-ffbf-4193-b388-b7f2fc461d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:10:38 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-94325b40-2d88-41e2-a90a-a099e5019598 tempest-VolumeTypesAccessTest-876258851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (388b2d63-ffbf-4193-b388-b7f2fc461d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:10:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-408154705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f694d136-2d2e-4875-8f90-f20592e5be39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f293abd057ba4950a4ac45c673e2b9e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:10:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:10:38Z,use_quota=True,user_id='c6c2673e1aac4910bf2e5b9e8fc34b6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(afad337e-1466-4740-9e2f-974bf9f04741),volume_type_id=afad337e-1466-4740-9e2f-974bf9f04741)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:10:38 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-94325b40-2d88-41e2-a90a-a099e5019598 tempest-VolumeTypesAccessTest-876258851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f32d37f-6483-4e93-bfbc-4af82f679a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:10:38 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-94325b40-2d88-41e2-a90a-a099e5019598 tempest-VolumeTypesAccessTest-876258851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f32d37f-6483-4e93-bfbc-4af82f679a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:10:38 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-94325b40-2d88-41e2-a90a-a099e5019598 tempest-VolumeTypesAccessTest-876258851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21095153-6534-485a-9440-a6cecab43655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:10:38 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-94325b40-2d88-41e2-a90a-a099e5019598 tempest-VolumeTypesAccessTest-876258851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21095153-6534-485a-9440-a6cecab43655) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f694d136-2d2e-4875-8f90-f20592e5be39', 'volume_name': 'volume-f694d136-2d2e-4875-8f90-f20592e5be39', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:10:38 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-94325b40-2d88-41e2-a90a-a099e5019598 tempest-VolumeTypesAccessTest-876258851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6c7389e-5f38-48e7-8411-ecb60453eef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:10:38 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-94325b40-2d88-41e2-a90a-a099e5019598 tempest-VolumeTypesAccessTest-876258851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6c7389e-5f38-48e7-8411-ecb60453eef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:10:38 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-94325b40-2d88-41e2-a90a-a099e5019598 tempest-VolumeTypesAccessTest-876258851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a98c712f-54c9-4c38-bee4-96b7a5152522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:10:38 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-94325b40-2d88-41e2-a90a-a099e5019598 tempest-VolumeTypesAccessTest-876258851 None] Volume f694d136-2d2e-4875-8f90-f20592e5be39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f694d136-2d2e-4875-8f90-f20592e5be39', 'volume_size': 1} Jul 10 10:10:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-94325b40-2d88-41e2-a90a-a099e5019598 tempest-VolumeTypesAccessTest-876258851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:10:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-94325b40-2d88-41e2-a90a-a099e5019598 tempest-VolumeTypesAccessTest-876258851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:10:38 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-94325b40-2d88-41e2-a90a-a099e5019598 tempest-VolumeTypesAccessTest-876258851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:10:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-408154705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f694d136-2d2e-4875-8f90-f20592e5be39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f293abd057ba4950a4ac45c673e2b9e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:10:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:10:38Z,use_quota=True,user_id='c6c2673e1aac4910bf2e5b9e8fc34b6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(afad337e-1466-4740-9e2f-974bf9f04741),volume_type_id=afad337e-1466-4740-9e2f-974bf9f04741)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:10:38 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-94325b40-2d88-41e2-a90a-a099e5019598 tempest-VolumeTypesAccessTest-876258851 None] Creating volume f694d136-2d2e-4875-8f90-f20592e5be39 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:10:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-94325b40-2d88-41e2-a90a-a099e5019598 tempest-VolumeTypesAccessTest-876258851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:10:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-94325b40-2d88-41e2-a90a-a099e5019598 tempest-VolumeTypesAccessTest-876258851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:10:38 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-94325b40-2d88-41e2-a90a-a099e5019598 tempest-VolumeTypesAccessTest-876258851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:10:38 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-94325b40-2d88-41e2-a90a-a099e5019598 tempest-VolumeTypesAccessTest-876258851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:10:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-94325b40-2d88-41e2-a90a-a099e5019598 tempest-VolumeTypesAccessTest-876258851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:10:38 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-94325b40-2d88-41e2-a90a-a099e5019598 tempest-VolumeTypesAccessTest-876258851 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:10:38 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-94325b40-2d88-41e2-a90a-a099e5019598 tempest-VolumeTypesAccessTest-876258851 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:10:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-94325b40-2d88-41e2-a90a-a099e5019598 tempest-VolumeTypesAccessTest-876258851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f694d136-2d2e-4875-8f90-f20592e5be39 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:10:38 devstack sudo[95497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f694d136-2d2e-4875-8f90-f20592e5be39 1073741824 Jul 10 10:10:38 devstack sudo[95497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:10:39 devstack sudo[95497]: pam_unix(sudo:session): session closed for user root Jul 10 10:10:39 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-94325b40-2d88-41e2-a90a-a099e5019598 tempest-VolumeTypesAccessTest-876258851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f694d136-2d2e-4875-8f90-f20592e5be39 1073741824" returned: 0 in 0.957s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:10:39 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-94325b40-2d88-41e2-a90a-a099e5019598 tempest-VolumeTypesAccessTest-876258851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f694d136-2d2e-4875-8f90-f20592e5be39 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:10:39 devstack sudo[95502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f694d136-2d2e-4875-8f90-f20592e5be39 Jul 10 10:10:39 devstack sudo[95502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:10:40 devstack sudo[95502]: pam_unix(sudo:session): session closed for user root Jul 10 10:10:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-94325b40-2d88-41e2-a90a-a099e5019598 tempest-VolumeTypesAccessTest-876258851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f694d136-2d2e-4875-8f90-f20592e5be39" returned: 0 in 0.719s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:10:40 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-94325b40-2d88-41e2-a90a-a099e5019598 tempest-VolumeTypesAccessTest-876258851 None] <== create_volume: return (1719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:10:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-94325b40-2d88-41e2-a90a-a099e5019598 tempest-VolumeTypesAccessTest-876258851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.721s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:10:40 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-94325b40-2d88-41e2-a90a-a099e5019598 tempest-VolumeTypesAccessTest-876258851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a98c712f-54c9-4c38-bee4-96b7a5152522) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f694d136-2d2e-4875-8f90-f20592e5be39', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:10:40 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-94325b40-2d88-41e2-a90a-a099e5019598 tempest-VolumeTypesAccessTest-876258851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d3bc13f-6437-4e21-b604-0718453a4a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:10:40 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-94325b40-2d88-41e2-a90a-a099e5019598 tempest-VolumeTypesAccessTest-876258851 None] Volume volume-f694d136-2d2e-4875-8f90-f20592e5be39 (f694d136-2d2e-4875-8f90-f20592e5be39): created successfully Jul 10 10:10:40 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-94325b40-2d88-41e2-a90a-a099e5019598 tempest-VolumeTypesAccessTest-876258851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d3bc13f-6437-4e21-b604-0718453a4a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:10:40 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-94325b40-2d88-41e2-a90a-a099e5019598 tempest-VolumeTypesAccessTest-876258851 None] Flow 'volume_create_manager' (7696295f-3523-4a0b-acea-1bf8422881be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:10:40 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-94325b40-2d88-41e2-a90a-a099e5019598 tempest-VolumeTypesAccessTest-876258851 None] Created volume successfully. Jul 10 10:10:40 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-679bc268-f2b7-4c4b-bbe1-d4a04c44bc1c tempest-VolumeTypesAccessTest-876258851 None] Acquiring lock "cinder-f694d136-2d2e-4875-8f90-f20592e5be39-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:10:40 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-679bc268-f2b7-4c4b-bbe1-d4a04c44bc1c tempest-VolumeTypesAccessTest-876258851 None] Lock "cinder-f694d136-2d2e-4875-8f90-f20592e5be39-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:10:40 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-679bc268-f2b7-4c4b-bbe1-d4a04c44bc1c tempest-VolumeTypesAccessTest-876258851 None] Acquiring lock "cinder-quobyte-f694d136-2d2e-4875-8f90-f20592e5be39" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:10:40 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-679bc268-f2b7-4c4b-bbe1-d4a04c44bc1c tempest-VolumeTypesAccessTest-876258851 None] Lock "cinder-quobyte-f694d136-2d2e-4875-8f90-f20592e5be39" acquired by "delete_volume" :: waited 0.022s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:10:40 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f8ef1f1-664a-4bcb-810c-c4ef6d73c4d9]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:10:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-679bc268-f2b7-4c4b-bbe1-d4a04c44bc1c tempest-VolumeTypesAccessTest-876258851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f694d136-2d2e-4875-8f90-f20592e5be39 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:10:41 devstack sudo[95536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f694d136-2d2e-4875-8f90-f20592e5be39 Jul 10 10:10:41 devstack sudo[95536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:10:41 devstack cinder-volume[87234]: DEBUG dbcounter [-] [87234] Writing DB stats cinder:INSERT=38,cinder:UPDATE=121,cinder:SELECT=108,cinder:DELETE=5 {{(pid=87234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 10:10:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-2f3646a2-36d6-4ecb-a85c-83c85c3ebcd0 req-991338db-e82f-4e72-82aa-20d7541a9984 tempest-AttachVolumeTestJSON-202001593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:10:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-2f3646a2-36d6-4ecb-a85c-83c85c3ebcd0 req-991338db-e82f-4e72-82aa-20d7541a9984 tempest-AttachVolumeTestJSON-202001593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:10:41 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec27779-8c12-444e-8118-4f53651291ae]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:10:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-2f3646a2-36d6-4ecb-a85c-83c85c3ebcd0 req-991338db-e82f-4e72-82aa-20d7541a9984 tempest-AttachVolumeTestJSON-202001593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d73e33e7-165c-47b9-872a-44a441d45eaa {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:10:41 devstack sudo[95555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d73e33e7-165c-47b9-872a-44a441d45eaa Jul 10 10:10:41 devstack sudo[95555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:10:41 devstack sudo[95536]: pam_unix(sudo:session): session closed for user root Jul 10 10:10:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-679bc268-f2b7-4c4b-bbe1-d4a04c44bc1c tempest-VolumeTypesAccessTest-876258851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f694d136-2d2e-4875-8f90-f20592e5be39" returned: 0 in 1.161s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:10:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-679bc268-f2b7-4c4b-bbe1-d4a04c44bc1c tempest-VolumeTypesAccessTest-876258851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f694d136-2d2e-4875-8f90-f20592e5be39 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:10:41 devstack sudo[95568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f694d136-2d2e-4875-8f90-f20592e5be39 Jul 10 10:10:42 devstack sudo[95568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:10:42 devstack cinder-volume[87234]: DEBUG oslo_service.periodic_task [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 10:10:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:10:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:10:42 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:10:42 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:10:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:10:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:10:42 devstack sudo[95582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:10:42 devstack sudo[95582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:10:42 devstack sudo[95555]: pam_unix(sudo:session): session closed for user root Jul 10 10:10:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-2f3646a2-36d6-4ecb-a85c-83c85c3ebcd0 req-991338db-e82f-4e72-82aa-20d7541a9984 tempest-AttachVolumeTestJSON-202001593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d73e33e7-165c-47b9-872a-44a441d45eaa" returned: 0 in 1.041s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:10:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-2f3646a2-36d6-4ecb-a85c-83c85c3ebcd0 req-991338db-e82f-4e72-82aa-20d7541a9984 tempest-AttachVolumeTestJSON-202001593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.083s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:10:42 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [req-2f3646a2-36d6-4ecb-a85c-83c85c3ebcd0 req-991338db-e82f-4e72-82aa-20d7541a9984 tempest-AttachVolumeTestJSON-202001593 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091', 'name': 'volume-d73e33e7-165c-47b9-872a-44a441d45eaa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ec431ced-c319-4a4e-b84a-a0ffce3556f4', 'enforce_multipath': True} {{(pid=87234) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 10:10:42 devstack cinder-volume[87234]: INFO cinder.volume.manager [req-2f3646a2-36d6-4ecb-a85c-83c85c3ebcd0 req-991338db-e82f-4e72-82aa-20d7541a9984 tempest-AttachVolumeTestJSON-202001593 None] attachment_update completed successfully. Jul 10 10:10:43 devstack sudo[95582]: pam_unix(sudo:session): session closed for user root Jul 10 10:10:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.920s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:10:43 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:10:43 devstack cinder-volume[87234]: DEBUG oslo_service.periodic_task [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Running periodic task VolumeManager._thread_info {{(pid=87234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 10:10:43 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] thread count: 28 {{(pid=87234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 10:10:43 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] thread info: [<_MainThread(MainThread, started 131600773742720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 10:10:43 devstack sudo[95568]: pam_unix(sudo:session): session closed for user root Jul 10 10:10:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-679bc268-f2b7-4c4b-bbe1-d4a04c44bc1c tempest-VolumeTypesAccessTest-876258851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f694d136-2d2e-4875-8f90-f20592e5be39" returned: 0 in 1.246s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:10:43 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-679bc268-f2b7-4c4b-bbe1-d4a04c44bc1c tempest-VolumeTypesAccessTest-876258851 None] Lock "cinder-quobyte-f694d136-2d2e-4875-8f90-f20592e5be39" released by "delete_volume" :: held 2.472s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:10:43 devstack cinder-volume[87234]: WARNING cinder.quota [None req-679bc268-f2b7-4c4b-bbe1-d4a04c44bc1c tempest-VolumeTypesAccessTest-876258851 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1934078916 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1934078916, it is now deprecated. Please use the default quota class for default quota. Jul 10 10:10:43 devstack cinder-volume[87234]: WARNING cinder.quota [None req-679bc268-f2b7-4c4b-bbe1-d4a04c44bc1c tempest-VolumeTypesAccessTest-876258851 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1934078916 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1934078916, it is now deprecated. Please use the default quota class for default quota. Jul 10 10:10:43 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-679bc268-f2b7-4c4b-bbe1-d4a04c44bc1c tempest-VolumeTypesAccessTest-876258851 None] Created reservations ['b437797a-b4ec-4970-b784-814d9d0b7371', '9d352b2d-ea93-47b0-9618-12d4f72814e8', 'd7b9dc82-6861-4850-b872-00008ade6d87', 'd91c790e-e5c2-4fce-a924-d07cea5db0ad'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:10:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-679bc268-f2b7-4c4b-bbe1-d4a04c44bc1c tempest-VolumeTypesAccessTest-876258851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:10:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-679bc268-f2b7-4c4b-bbe1-d4a04c44bc1c tempest-VolumeTypesAccessTest-876258851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:10:43 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-679bc268-f2b7-4c4b-bbe1-d4a04c44bc1c tempest-VolumeTypesAccessTest-876258851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:10:43 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-679bc268-f2b7-4c4b-bbe1-d4a04c44bc1c tempest-VolumeTypesAccessTest-876258851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:10:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-679bc268-f2b7-4c4b-bbe1-d4a04c44bc1c tempest-VolumeTypesAccessTest-876258851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:10:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-679bc268-f2b7-4c4b-bbe1-d4a04c44bc1c tempest-VolumeTypesAccessTest-876258851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:10:43 devstack sudo[95601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:10:43 devstack sudo[95601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:10:44 devstack sudo[95601]: pam_unix(sudo:session): session closed for user root Jul 10 10:10:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-679bc268-f2b7-4c4b-bbe1-d4a04c44bc1c tempest-VolumeTypesAccessTest-876258851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.999s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:10:44 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-679bc268-f2b7-4c4b-bbe1-d4a04c44bc1c tempest-VolumeTypesAccessTest-876258851 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:10:44 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-679bc268-f2b7-4c4b-bbe1-d4a04c44bc1c tempest-VolumeTypesAccessTest-876258851 None] Deleted volume successfully. Jul 10 10:10:44 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-679bc268-f2b7-4c4b-bbe1-d4a04c44bc1c tempest-VolumeTypesAccessTest-876258851 None] Lock "cinder-f694d136-2d2e-4875-8f90-f20592e5be39-delete_volume" released by "delete_volume" :: held 3.769s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:10:48 devstack cinder-volume[87234]: INFO cinder.volume.manager [req-87899cc0-2824-4e68-b880-5b50dbea4a2d req-3847e042-8119-472d-8a86-14cda79f9261 tempest-AttachVolumeTestJSON-202001593 None] Terminate volume connection completed successfully. Jul 10 10:10:48 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [req-87899cc0-2824-4e68-b880-5b50dbea4a2d req-3847e042-8119-472d-8a86-14cda79f9261 tempest-AttachVolumeTestJSON-202001593 None] Deleting attachment ea89ff21-463c-4646-9df6-85e1105826dd. {{(pid=87234) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 10:10:50 devstack cinder-volume[87234]: INFO cinder.volume.manager [req-c58a2ab1-05ad-43c0-9672-c5da319467c6 req-54178994-71ca-49d8-b4f1-16c9d2f45d52 tempest-AttachVolumeTestJSON-202001593 None] Terminate volume connection completed successfully. Jul 10 10:10:50 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [req-c58a2ab1-05ad-43c0-9672-c5da319467c6 req-54178994-71ca-49d8-b4f1-16c9d2f45d52 tempest-AttachVolumeTestJSON-202001593 None] Deleting attachment ec431ced-c319-4a4e-b84a-a0ffce3556f4. {{(pid=87234) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 10:11:00 devstack cinder-volume[87234]: DEBUG dbcounter [-] [87234] Writing DB stats cinder:SELECT=17,cinder:INSERT=4,cinder:UPDATE=16,cinder:DELETE=1 {{(pid=87234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 10:11:00 devstack cinder-volume[87234]: DEBUG dbcounter [-] [87234] Writing DB stats cinder:SELECT=9,cinder:UPDATE=9,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 10:11:01 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-1d1db245-70f1-4c53-814f-45ce8b229d9c tempest-VolumesNegativeTest-532697711 None] Acquiring lock "cinder-f34a6c81-b9bf-4953-b4a3-91e9c5096401-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:11:01 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-1d1db245-70f1-4c53-814f-45ce8b229d9c tempest-VolumesNegativeTest-532697711 None] Lock "cinder-f34a6c81-b9bf-4953-b4a3-91e9c5096401-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:11:01 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-1d1db245-70f1-4c53-814f-45ce8b229d9c tempest-VolumesNegativeTest-532697711 None] Acquiring lock "cinder-quobyte-f34a6c81-b9bf-4953-b4a3-91e9c5096401" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:11:01 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-1d1db245-70f1-4c53-814f-45ce8b229d9c tempest-VolumesNegativeTest-532697711 None] Lock "cinder-quobyte-f34a6c81-b9bf-4953-b4a3-91e9c5096401" acquired by "delete_volume" :: waited 0.021s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:11:01 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6dfeca5-c04f-4fbd-8586-81213870b747]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:11:01 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1d1db245-70f1-4c53-814f-45ce8b229d9c tempest-VolumesNegativeTest-532697711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f34a6c81-b9bf-4953-b4a3-91e9c5096401 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:11:02 devstack sudo[95801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f34a6c81-b9bf-4953-b4a3-91e9c5096401 Jul 10 10:11:02 devstack sudo[95801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:11:03 devstack sudo[95801]: pam_unix(sudo:session): session closed for user root Jul 10 10:11:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1d1db245-70f1-4c53-814f-45ce8b229d9c tempest-VolumesNegativeTest-532697711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f34a6c81-b9bf-4953-b4a3-91e9c5096401" returned: 0 in 1.460s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:11:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1d1db245-70f1-4c53-814f-45ce8b229d9c tempest-VolumesNegativeTest-532697711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f34a6c81-b9bf-4953-b4a3-91e9c5096401 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:11:03 devstack sudo[95806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f34a6c81-b9bf-4953-b4a3-91e9c5096401 Jul 10 10:11:03 devstack sudo[95806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:11:03 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-88fb69a2-f56a-4384-a6da-08b446235d76 tempest-TestMinimumBasicScenario-1075697663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:11:03 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-88fb69a2-f56a-4384-a6da-08b446235d76 tempest-TestMinimumBasicScenario-1075697663 None] Flow 'volume_create_manager' (decb23c9-3964-4d62-aa51-29bd134f76a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:11:03 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-88fb69a2-f56a-4384-a6da-08b446235d76 tempest-TestMinimumBasicScenario-1075697663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91c731df-90b8-41f2-a693-5bba0cbe2151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:11:03 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-88fb69a2-f56a-4384-a6da-08b446235d76 tempest-TestMinimumBasicScenario-1075697663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91c731df-90b8-41f2-a693-5bba0cbe2151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:11:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1575588719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20996cbe-3a07-4778-b9fe-f30d73b17dbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='641c3df50d114afea9886af927d5ea65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:11:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:11:03Z,use_quota=True,user_id='1e313ecbca7a4f2e8de7fac0ffac95c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:11:03 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-88fb69a2-f56a-4384-a6da-08b446235d76 tempest-TestMinimumBasicScenario-1075697663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5a2e84b-7092-4e83-b3fe-23657bce11f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:11:03 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-88fb69a2-f56a-4384-a6da-08b446235d76 tempest-TestMinimumBasicScenario-1075697663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5a2e84b-7092-4e83-b3fe-23657bce11f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:11:03 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-88fb69a2-f56a-4384-a6da-08b446235d76 tempest-TestMinimumBasicScenario-1075697663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfec5ff8-d835-4216-9a3d-ae80362345bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:11:03 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-88fb69a2-f56a-4384-a6da-08b446235d76 tempest-TestMinimumBasicScenario-1075697663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfec5ff8-d835-4216-9a3d-ae80362345bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20996cbe-3a07-4778-b9fe-f30d73b17dbc', 'volume_name': 'volume-20996cbe-3a07-4778-b9fe-f30d73b17dbc', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:11:03 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-88fb69a2-f56a-4384-a6da-08b446235d76 tempest-TestMinimumBasicScenario-1075697663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b610a78c-f033-4282-a8fa-04cb5195a37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:11:03 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-88fb69a2-f56a-4384-a6da-08b446235d76 tempest-TestMinimumBasicScenario-1075697663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b610a78c-f033-4282-a8fa-04cb5195a37c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:11:03 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-88fb69a2-f56a-4384-a6da-08b446235d76 tempest-TestMinimumBasicScenario-1075697663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (538ae73f-514c-4bc9-8684-a607f87e0d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:11:03 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-88fb69a2-f56a-4384-a6da-08b446235d76 tempest-TestMinimumBasicScenario-1075697663 None] Volume 20996cbe-3a07-4778-b9fe-f30d73b17dbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20996cbe-3a07-4778-b9fe-f30d73b17dbc', 'volume_size': 1} Jul 10 10:11:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-88fb69a2-f56a-4384-a6da-08b446235d76 tempest-TestMinimumBasicScenario-1075697663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:11:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-88fb69a2-f56a-4384-a6da-08b446235d76 tempest-TestMinimumBasicScenario-1075697663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:11:03 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-88fb69a2-f56a-4384-a6da-08b446235d76 tempest-TestMinimumBasicScenario-1075697663 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:11:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1575588719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20996cbe-3a07-4778-b9fe-f30d73b17dbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='641c3df50d114afea9886af927d5ea65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:11:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:11:03Z,use_quota=True,user_id='1e313ecbca7a4f2e8de7fac0ffac95c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:11:03 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-88fb69a2-f56a-4384-a6da-08b446235d76 tempest-TestMinimumBasicScenario-1075697663 None] Creating volume 20996cbe-3a07-4778-b9fe-f30d73b17dbc {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:11:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-88fb69a2-f56a-4384-a6da-08b446235d76 tempest-TestMinimumBasicScenario-1075697663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:11:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-88fb69a2-f56a-4384-a6da-08b446235d76 tempest-TestMinimumBasicScenario-1075697663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:11:03 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-88fb69a2-f56a-4384-a6da-08b446235d76 tempest-TestMinimumBasicScenario-1075697663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:11:03 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-88fb69a2-f56a-4384-a6da-08b446235d76 tempest-TestMinimumBasicScenario-1075697663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:11:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-88fb69a2-f56a-4384-a6da-08b446235d76 tempest-TestMinimumBasicScenario-1075697663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:11:03 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-88fb69a2-f56a-4384-a6da-08b446235d76 tempest-TestMinimumBasicScenario-1075697663 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:11:03 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-88fb69a2-f56a-4384-a6da-08b446235d76 tempest-TestMinimumBasicScenario-1075697663 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:11:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-88fb69a2-f56a-4384-a6da-08b446235d76 tempest-TestMinimumBasicScenario-1075697663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-20996cbe-3a07-4778-b9fe-f30d73b17dbc 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:11:03 devstack sudo[95808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-20996cbe-3a07-4778-b9fe-f30d73b17dbc 1073741824 Jul 10 10:11:03 devstack sudo[95808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:11:04 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-c3175253-04ee-4534-aee7-14840f355802 tempest-AttachVolumeTestJSON-202001593 None] Acquiring lock "cinder-d73e33e7-165c-47b9-872a-44a441d45eaa-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:11:04 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-c3175253-04ee-4534-aee7-14840f355802 tempest-AttachVolumeTestJSON-202001593 None] Lock "cinder-d73e33e7-165c-47b9-872a-44a441d45eaa-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:11:04 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-c3175253-04ee-4534-aee7-14840f355802 tempest-AttachVolumeTestJSON-202001593 None] Acquiring lock "cinder-quobyte-d73e33e7-165c-47b9-872a-44a441d45eaa" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:11:04 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-c3175253-04ee-4534-aee7-14840f355802 tempest-AttachVolumeTestJSON-202001593 None] Lock "cinder-quobyte-d73e33e7-165c-47b9-872a-44a441d45eaa" acquired by "delete_volume" :: waited 0.044s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:11:04 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[a859a8ef-286c-4375-9d8c-eca5c1719b0c]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:11:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c3175253-04ee-4534-aee7-14840f355802 tempest-AttachVolumeTestJSON-202001593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d73e33e7-165c-47b9-872a-44a441d45eaa {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:11:04 devstack sudo[95811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d73e33e7-165c-47b9-872a-44a441d45eaa Jul 10 10:11:04 devstack sudo[95811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:11:04 devstack sudo[95806]: pam_unix(sudo:session): session closed for user root Jul 10 10:11:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1d1db245-70f1-4c53-814f-45ce8b229d9c tempest-VolumesNegativeTest-532697711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f34a6c81-b9bf-4953-b4a3-91e9c5096401" returned: 0 in 1.254s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:11:04 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-1d1db245-70f1-4c53-814f-45ce8b229d9c tempest-VolumesNegativeTest-532697711 None] Lock "cinder-quobyte-f34a6c81-b9bf-4953-b4a3-91e9c5096401" released by "delete_volume" :: held 2.795s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:11:04 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-1d1db245-70f1-4c53-814f-45ce8b229d9c tempest-VolumesNegativeTest-532697711 None] Created reservations ['9ed52c66-2e1c-4af2-bcb9-7bd2c95df05c', '14384608-649f-4ee6-8abd-c5bb0c8587ae', '0ff7d437-ca1c-4c10-8854-5ec27088ee10', 'a10fcc9e-fcfd-4157-9542-99408b924d57'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:11:04 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-49dde953-3372-48f1-8580-134c64a30d6b tempest-VolumesDeleteCascade-1259063873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:11:04 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-49dde953-3372-48f1-8580-134c64a30d6b tempest-VolumesDeleteCascade-1259063873 None] Flow 'volume_create_manager' (7a3b1274-f947-410a-a2b0-e7ef456768ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:11:04 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-49dde953-3372-48f1-8580-134c64a30d6b tempest-VolumesDeleteCascade-1259063873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20cefae4-76a4-40b8-b0d2-017a2290398c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:11:04 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-49dde953-3372-48f1-8580-134c64a30d6b tempest-VolumesDeleteCascade-1259063873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20cefae4-76a4-40b8-b0d2-017a2290398c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:11:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-35767253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=550e4afc-bec6-4ed3-828d-c6e319a42dc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='271189cec40041d38ae51354c096f46a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:11:05Z,use_quota=True,user_id='2623c56cb8fb46b1b82a7d248e8360f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:11:04 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-49dde953-3372-48f1-8580-134c64a30d6b tempest-VolumesDeleteCascade-1259063873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a42cde44-7409-456e-a61a-11dbd04ee35f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:11:04 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-49dde953-3372-48f1-8580-134c64a30d6b tempest-VolumesDeleteCascade-1259063873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a42cde44-7409-456e-a61a-11dbd04ee35f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:11:04 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-49dde953-3372-48f1-8580-134c64a30d6b tempest-VolumesDeleteCascade-1259063873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1765252-4af7-4beb-8b41-4511a44568cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:11:04 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-49dde953-3372-48f1-8580-134c64a30d6b tempest-VolumesDeleteCascade-1259063873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1765252-4af7-4beb-8b41-4511a44568cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '550e4afc-bec6-4ed3-828d-c6e319a42dc4', 'volume_name': 'volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:11:04 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-49dde953-3372-48f1-8580-134c64a30d6b tempest-VolumesDeleteCascade-1259063873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d122282c-7be8-45a8-b8a2-3dfe174447cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:11:04 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-49dde953-3372-48f1-8580-134c64a30d6b tempest-VolumesDeleteCascade-1259063873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d122282c-7be8-45a8-b8a2-3dfe174447cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:11:04 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-49dde953-3372-48f1-8580-134c64a30d6b tempest-VolumesDeleteCascade-1259063873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51265636-045b-44ca-a7a6-3849a53872e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:11:04 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-49dde953-3372-48f1-8580-134c64a30d6b tempest-VolumesDeleteCascade-1259063873 None] Volume 550e4afc-bec6-4ed3-828d-c6e319a42dc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4', 'volume_size': 1} Jul 10 10:11:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-49dde953-3372-48f1-8580-134c64a30d6b tempest-VolumesDeleteCascade-1259063873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:11:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-1d1db245-70f1-4c53-814f-45ce8b229d9c tempest-VolumesNegativeTest-532697711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:11:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-1d1db245-70f1-4c53-814f-45ce8b229d9c tempest-VolumesNegativeTest-532697711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:11:04 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-1d1db245-70f1-4c53-814f-45ce8b229d9c tempest-VolumesNegativeTest-532697711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:11:04 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-1d1db245-70f1-4c53-814f-45ce8b229d9c tempest-VolumesNegativeTest-532697711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:11:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-1d1db245-70f1-4c53-814f-45ce8b229d9c tempest-VolumesNegativeTest-532697711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:11:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1d1db245-70f1-4c53-814f-45ce8b229d9c tempest-VolumesNegativeTest-532697711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:11:04 devstack sudo[95816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:11:04 devstack sudo[95816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:11:05 devstack sudo[95808]: pam_unix(sudo:session): session closed for user root Jul 10 10:11:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-88fb69a2-f56a-4384-a6da-08b446235d76 tempest-TestMinimumBasicScenario-1075697663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-20996cbe-3a07-4778-b9fe-f30d73b17dbc 1073741824" returned: 0 in 1.418s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:11:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-88fb69a2-f56a-4384-a6da-08b446235d76 tempest-TestMinimumBasicScenario-1075697663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-20996cbe-3a07-4778-b9fe-f30d73b17dbc {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:11:05 devstack sudo[95821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-20996cbe-3a07-4778-b9fe-f30d73b17dbc Jul 10 10:11:05 devstack sudo[95821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:11:05 devstack sudo[95811]: pam_unix(sudo:session): session closed for user root Jul 10 10:11:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c3175253-04ee-4534-aee7-14840f355802 tempest-AttachVolumeTestJSON-202001593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d73e33e7-165c-47b9-872a-44a441d45eaa" returned: 0 in 0.950s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:11:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c3175253-04ee-4534-aee7-14840f355802 tempest-AttachVolumeTestJSON-202001593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d73e33e7-165c-47b9-872a-44a441d45eaa {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:11:05 devstack sudo[95823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d73e33e7-165c-47b9-872a-44a441d45eaa Jul 10 10:11:05 devstack sudo[95823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:11:05 devstack sudo[95816]: pam_unix(sudo:session): session closed for user root Jul 10 10:11:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1d1db245-70f1-4c53-814f-45ce8b229d9c tempest-VolumesNegativeTest-532697711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 1.005s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:11:05 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-1d1db245-70f1-4c53-814f-45ce8b229d9c tempest-VolumesNegativeTest-532697711 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:11:05 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-1d1db245-70f1-4c53-814f-45ce8b229d9c tempest-VolumesNegativeTest-532697711 None] Deleted volume successfully. Jul 10 10:11:06 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-1d1db245-70f1-4c53-814f-45ce8b229d9c tempest-VolumesNegativeTest-532697711 None] Lock "cinder-f34a6c81-b9bf-4953-b4a3-91e9c5096401-delete_volume" released by "delete_volume" :: held 4.251s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:11:06 devstack sudo[95821]: pam_unix(sudo:session): session closed for user root Jul 10 10:11:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-88fb69a2-f56a-4384-a6da-08b446235d76 tempest-TestMinimumBasicScenario-1075697663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-20996cbe-3a07-4778-b9fe-f30d73b17dbc" returned: 0 in 0.933s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:11:06 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-88fb69a2-f56a-4384-a6da-08b446235d76 tempest-TestMinimumBasicScenario-1075697663 None] <== create_volume: return (2417ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:11:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-88fb69a2-f56a-4384-a6da-08b446235d76 tempest-TestMinimumBasicScenario-1075697663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.422s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:11:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-49dde953-3372-48f1-8580-134c64a30d6b tempest-VolumesDeleteCascade-1259063873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.102s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:11:06 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-49dde953-3372-48f1-8580-134c64a30d6b tempest-VolumesDeleteCascade-1259063873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:11:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-35767253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=550e4afc-bec6-4ed3-828d-c6e319a42dc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='271189cec40041d38ae51354c096f46a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:11:05Z,use_quota=True,user_id='2623c56cb8fb46b1b82a7d248e8360f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:11:06 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-49dde953-3372-48f1-8580-134c64a30d6b tempest-VolumesDeleteCascade-1259063873 None] Creating volume 550e4afc-bec6-4ed3-828d-c6e319a42dc4 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:11:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-49dde953-3372-48f1-8580-134c64a30d6b tempest-VolumesDeleteCascade-1259063873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:11:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-49dde953-3372-48f1-8580-134c64a30d6b tempest-VolumesDeleteCascade-1259063873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:11:06 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-49dde953-3372-48f1-8580-134c64a30d6b tempest-VolumesDeleteCascade-1259063873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:11:06 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-49dde953-3372-48f1-8580-134c64a30d6b tempest-VolumesDeleteCascade-1259063873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:11:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-49dde953-3372-48f1-8580-134c64a30d6b tempest-VolumesDeleteCascade-1259063873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:11:06 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-49dde953-3372-48f1-8580-134c64a30d6b tempest-VolumesDeleteCascade-1259063873 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:11:06 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-49dde953-3372-48f1-8580-134c64a30d6b tempest-VolumesDeleteCascade-1259063873 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:11:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-49dde953-3372-48f1-8580-134c64a30d6b tempest-VolumesDeleteCascade-1259063873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:11:06 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-88fb69a2-f56a-4384-a6da-08b446235d76 tempest-TestMinimumBasicScenario-1075697663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (538ae73f-514c-4bc9-8684-a607f87e0d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20996cbe-3a07-4778-b9fe-f30d73b17dbc', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:11:06 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-88fb69a2-f56a-4384-a6da-08b446235d76 tempest-TestMinimumBasicScenario-1075697663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8871234a-10cc-471c-89cd-700e710e71b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:11:06 devstack sudo[95827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4 1073741824 Jul 10 10:11:06 devstack sudo[95827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:11:06 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-88fb69a2-f56a-4384-a6da-08b446235d76 tempest-TestMinimumBasicScenario-1075697663 None] Volume volume-20996cbe-3a07-4778-b9fe-f30d73b17dbc (20996cbe-3a07-4778-b9fe-f30d73b17dbc): created successfully Jul 10 10:11:06 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-88fb69a2-f56a-4384-a6da-08b446235d76 tempest-TestMinimumBasicScenario-1075697663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8871234a-10cc-471c-89cd-700e710e71b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:11:06 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-88fb69a2-f56a-4384-a6da-08b446235d76 tempest-TestMinimumBasicScenario-1075697663 None] Flow 'volume_create_manager' (decb23c9-3964-4d62-aa51-29bd134f76a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:11:06 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-88fb69a2-f56a-4384-a6da-08b446235d76 tempest-TestMinimumBasicScenario-1075697663 None] Created volume successfully. Jul 10 10:11:06 devstack sudo[95823]: pam_unix(sudo:session): session closed for user root Jul 10 10:11:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c3175253-04ee-4534-aee7-14840f355802 tempest-AttachVolumeTestJSON-202001593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d73e33e7-165c-47b9-872a-44a441d45eaa" returned: 0 in 1.080s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:11:06 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-c3175253-04ee-4534-aee7-14840f355802 tempest-AttachVolumeTestJSON-202001593 None] Lock "cinder-quobyte-d73e33e7-165c-47b9-872a-44a441d45eaa" released by "delete_volume" :: held 2.091s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:11:06 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-c3175253-04ee-4534-aee7-14840f355802 tempest-AttachVolumeTestJSON-202001593 None] Created reservations ['4ba4b789-4dea-4583-b509-9c0fa97e6f2e', '2def747f-a2fb-44b0-b9df-8f8e07bf561b', '93845d84-5063-4198-88d8-87ea02385930', 'c942ad5f-dc97-4d94-9e24-2c43ffc71568'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:11:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-c3175253-04ee-4534-aee7-14840f355802 tempest-AttachVolumeTestJSON-202001593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:11:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-c3175253-04ee-4534-aee7-14840f355802 tempest-AttachVolumeTestJSON-202001593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:11:06 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-c3175253-04ee-4534-aee7-14840f355802 tempest-AttachVolumeTestJSON-202001593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:11:06 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-c3175253-04ee-4534-aee7-14840f355802 tempest-AttachVolumeTestJSON-202001593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:11:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-c3175253-04ee-4534-aee7-14840f355802 tempest-AttachVolumeTestJSON-202001593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:11:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c3175253-04ee-4534-aee7-14840f355802 tempest-AttachVolumeTestJSON-202001593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:11:06 devstack sudo[95830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:11:06 devstack sudo[95830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:11:06 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-11451e86-4c42-436f-972a-785392578cd1 tempest-AttachVolumeTestJSON-202001593 None] Acquiring lock "cinder-54e3082c-43ed-462f-a69e-8185d20660cb-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:11:06 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-11451e86-4c42-436f-972a-785392578cd1 tempest-AttachVolumeTestJSON-202001593 None] Lock "cinder-54e3082c-43ed-462f-a69e-8185d20660cb-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:11:06 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-11451e86-4c42-436f-972a-785392578cd1 tempest-AttachVolumeTestJSON-202001593 None] Acquiring lock "cinder-quobyte-54e3082c-43ed-462f-a69e-8185d20660cb" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:11:06 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-11451e86-4c42-436f-972a-785392578cd1 tempest-AttachVolumeTestJSON-202001593 None] Lock "cinder-quobyte-54e3082c-43ed-462f-a69e-8185d20660cb" acquired by "delete_volume" :: waited 0.038s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:11:06 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac105c93-4edc-411d-b386-18a438156b59]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:11:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-11451e86-4c42-436f-972a-785392578cd1 tempest-AttachVolumeTestJSON-202001593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-54e3082c-43ed-462f-a69e-8185d20660cb {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:11:07 devstack sudo[95833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-54e3082c-43ed-462f-a69e-8185d20660cb Jul 10 10:11:07 devstack sudo[95833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:11:07 devstack sudo[95827]: pam_unix(sudo:session): session closed for user root Jul 10 10:11:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-49dde953-3372-48f1-8580-134c64a30d6b tempest-VolumesDeleteCascade-1259063873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4 1073741824" returned: 0 in 1.676s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:11:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-49dde953-3372-48f1-8580-134c64a30d6b tempest-VolumesDeleteCascade-1259063873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:11:07 devstack sudo[95830]: pam_unix(sudo:session): session closed for user root Jul 10 10:11:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c3175253-04ee-4534-aee7-14840f355802 tempest-AttachVolumeTestJSON-202001593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 1.327s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:11:07 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-c3175253-04ee-4534-aee7-14840f355802 tempest-AttachVolumeTestJSON-202001593 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:11:07 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-c3175253-04ee-4534-aee7-14840f355802 tempest-AttachVolumeTestJSON-202001593 None] Deleted volume successfully. Jul 10 10:11:07 devstack sudo[95844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4 Jul 10 10:11:07 devstack sudo[95844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:11:07 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-c3175253-04ee-4534-aee7-14840f355802 tempest-AttachVolumeTestJSON-202001593 None] Lock "cinder-d73e33e7-165c-47b9-872a-44a441d45eaa-delete_volume" released by "delete_volume" :: held 3.770s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:11:08 devstack sudo[95833]: pam_unix(sudo:session): session closed for user root Jul 10 10:11:08 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-11451e86-4c42-436f-972a-785392578cd1 tempest-AttachVolumeTestJSON-202001593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-54e3082c-43ed-462f-a69e-8185d20660cb" returned: 0 in 1.458s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:11:08 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-11451e86-4c42-436f-972a-785392578cd1 tempest-AttachVolumeTestJSON-202001593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-54e3082c-43ed-462f-a69e-8185d20660cb {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:11:08 devstack sudo[95849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-54e3082c-43ed-462f-a69e-8185d20660cb Jul 10 10:11:08 devstack sudo[95849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:11:08 devstack sudo[95844]: pam_unix(sudo:session): session closed for user root Jul 10 10:11:08 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-49dde953-3372-48f1-8580-134c64a30d6b tempest-VolumesDeleteCascade-1259063873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4" returned: 0 in 0.902s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:11:08 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-49dde953-3372-48f1-8580-134c64a30d6b tempest-VolumesDeleteCascade-1259063873 None] <== create_volume: return (2659ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:11:08 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-49dde953-3372-48f1-8580-134c64a30d6b tempest-VolumesDeleteCascade-1259063873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.664s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:11:08 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-49dde953-3372-48f1-8580-134c64a30d6b tempest-VolumesDeleteCascade-1259063873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51265636-045b-44ca-a7a6-3849a53872e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:11:08 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-49dde953-3372-48f1-8580-134c64a30d6b tempest-VolumesDeleteCascade-1259063873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d418c33b-ce74-4e33-bc4a-7344a12045e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:11:08 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-49dde953-3372-48f1-8580-134c64a30d6b tempest-VolumesDeleteCascade-1259063873 None] Volume volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4 (550e4afc-bec6-4ed3-828d-c6e319a42dc4): created successfully Jul 10 10:11:08 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-49dde953-3372-48f1-8580-134c64a30d6b tempest-VolumesDeleteCascade-1259063873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d418c33b-ce74-4e33-bc4a-7344a12045e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:11:08 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-49dde953-3372-48f1-8580-134c64a30d6b tempest-VolumesDeleteCascade-1259063873 None] Flow 'volume_create_manager' (7a3b1274-f947-410a-a2b0-e7ef456768ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:11:08 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-49dde953-3372-48f1-8580-134c64a30d6b tempest-VolumesDeleteCascade-1259063873 None] Created volume successfully. Jul 10 10:11:09 devstack sudo[95849]: pam_unix(sudo:session): session closed for user root Jul 10 10:11:09 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-11451e86-4c42-436f-972a-785392578cd1 tempest-AttachVolumeTestJSON-202001593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-54e3082c-43ed-462f-a69e-8185d20660cb" returned: 0 in 0.828s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:11:09 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-11451e86-4c42-436f-972a-785392578cd1 tempest-AttachVolumeTestJSON-202001593 None] Lock "cinder-quobyte-54e3082c-43ed-462f-a69e-8185d20660cb" released by "delete_volume" :: held 2.388s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:11:09 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-11451e86-4c42-436f-972a-785392578cd1 tempest-AttachVolumeTestJSON-202001593 None] Created reservations ['328d2fb4-1abb-4709-bd76-1a367f175cb7', 'fe7c42e2-f269-4a3c-9a00-386bb8c89d2b', 'bd4df19d-8384-40ef-817f-af1e8453eb77', 'f326b7c8-eef5-419e-a9cb-d6beb9edd461'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:11:09 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-3731897f-cec5-446b-ab2b-88a63e25078c tempest-VolumesDeleteCascade-1259063873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:11:09 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-3731897f-cec5-446b-ab2b-88a63e25078c tempest-VolumesDeleteCascade-1259063873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:11:09 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-3731897f-cec5-446b-ab2b-88a63e25078c tempest-VolumesDeleteCascade-1259063873 None] Creating offline snapshot 7eba57f7-c720-45bf-8a55-ccaef92dbbd8 of volume 550e4afc-bec6-4ed3-828d-c6e319a42dc4 {{(pid=87234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 10:11:09 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe08b81-babe-4a94-8887-f7899b6734e9]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:11:09 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3731897f-cec5-446b-ab2b-88a63e25078c tempest-VolumesDeleteCascade-1259063873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:11:09 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-11451e86-4c42-436f-972a-785392578cd1 tempest-AttachVolumeTestJSON-202001593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:11:09 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-11451e86-4c42-436f-972a-785392578cd1 tempest-AttachVolumeTestJSON-202001593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:11:09 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-11451e86-4c42-436f-972a-785392578cd1 tempest-AttachVolumeTestJSON-202001593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:11:09 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-11451e86-4c42-436f-972a-785392578cd1 tempest-AttachVolumeTestJSON-202001593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:11:09 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-11451e86-4c42-436f-972a-785392578cd1 tempest-AttachVolumeTestJSON-202001593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:11:09 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-11451e86-4c42-436f-972a-785392578cd1 tempest-AttachVolumeTestJSON-202001593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:11:09 devstack sudo[95854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:11:09 devstack sudo[95854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:11:09 devstack sudo[95853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4 Jul 10 10:11:09 devstack sudo[95853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:11:10 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-6dc4e586-7be9-4387-a826-0f41a47df2be tempest-AttachVolumeTestJSON-202001593 None] Acquiring lock "cinder-fbafb75e-f1c3-48a2-91fb-8eb5a84c6df9-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:11:10 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-6dc4e586-7be9-4387-a826-0f41a47df2be tempest-AttachVolumeTestJSON-202001593 None] Lock "cinder-fbafb75e-f1c3-48a2-91fb-8eb5a84c6df9-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:11:10 devstack sudo[95853]: pam_unix(sudo:session): session closed for user root Jul 10 10:11:10 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3731897f-cec5-446b-ab2b-88a63e25078c tempest-VolumesDeleteCascade-1259063873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4" returned: 0 in 1.251s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:11:10 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3731897f-cec5-446b-ab2b-88a63e25078c tempest-VolumesDeleteCascade-1259063873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4.7eba57f7-c720-45bf-8a55-ccaef92dbbd8 1G {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:11:10 devstack sudo[95862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4.7eba57f7-c720-45bf-8a55-ccaef92dbbd8 1G Jul 10 10:11:10 devstack sudo[95862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:11:10 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-6dc4e586-7be9-4387-a826-0f41a47df2be tempest-AttachVolumeTestJSON-202001593 None] Acquiring lock "cinder-quobyte-fbafb75e-f1c3-48a2-91fb-8eb5a84c6df9" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:11:10 devstack sudo[95854]: pam_unix(sudo:session): session closed for user root Jul 10 10:11:10 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-6dc4e586-7be9-4387-a826-0f41a47df2be tempest-AttachVolumeTestJSON-202001593 None] Lock "cinder-quobyte-fbafb75e-f1c3-48a2-91fb-8eb5a84c6df9" acquired by "delete_volume" :: waited 0.058s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:11:10 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-11451e86-4c42-436f-972a-785392578cd1 tempest-AttachVolumeTestJSON-202001593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 1.479s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:11:10 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-11451e86-4c42-436f-972a-785392578cd1 tempest-AttachVolumeTestJSON-202001593 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:11:10 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-11451e86-4c42-436f-972a-785392578cd1 tempest-AttachVolumeTestJSON-202001593 None] Deleted volume successfully. Jul 10 10:11:10 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be7cb3f-8d63-4c4a-a636-d8c32f3b8966]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:11:10 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-6dc4e586-7be9-4387-a826-0f41a47df2be tempest-AttachVolumeTestJSON-202001593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-fbafb75e-f1c3-48a2-91fb-8eb5a84c6df9 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:11:11 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-11451e86-4c42-436f-972a-785392578cd1 tempest-AttachVolumeTestJSON-202001593 None] Lock "cinder-54e3082c-43ed-462f-a69e-8185d20660cb-delete_volume" released by "delete_volume" :: held 4.367s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:11:11 devstack sudo[95872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-fbafb75e-f1c3-48a2-91fb-8eb5a84c6df9 Jul 10 10:11:11 devstack sudo[95872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:11:11 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-d22a6b36-32be-45f4-ad7d-eb7c7d5fef3c req-217982d1-cc2f-4e0c-98a8-9f0faab9dc73 tempest-TestMinimumBasicScenario-1075697663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:11:11 devstack sudo[95872]: pam_unix(sudo:session): session closed for user root Jul 10 10:11:11 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-6dc4e586-7be9-4387-a826-0f41a47df2be tempest-AttachVolumeTestJSON-202001593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-fbafb75e-f1c3-48a2-91fb-8eb5a84c6df9" returned: 0 in 1.069s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:11:11 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-6dc4e586-7be9-4387-a826-0f41a47df2be tempest-AttachVolumeTestJSON-202001593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-fbafb75e-f1c3-48a2-91fb-8eb5a84c6df9 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:11:12 devstack sudo[95862]: pam_unix(sudo:session): session closed for user root Jul 10 10:11:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3731897f-cec5-446b-ab2b-88a63e25078c tempest-VolumesDeleteCascade-1259063873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4.7eba57f7-c720-45bf-8a55-ccaef92dbbd8 1G" returned: 0 in 1.437s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:11:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3731897f-cec5-446b-ab2b-88a63e25078c tempest-VolumesDeleteCascade-1259063873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4.7eba57f7-c720-45bf-8a55-ccaef92dbbd8 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:11:12 devstack sudo[95945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-fbafb75e-f1c3-48a2-91fb-8eb5a84c6df9 Jul 10 10:11:12 devstack sudo[95945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:11:12 devstack sudo[95947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4.7eba57f7-c720-45bf-8a55-ccaef92dbbd8 Jul 10 10:11:12 devstack sudo[95947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:11:12 devstack sudo[95945]: pam_unix(sudo:session): session closed for user root Jul 10 10:11:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-6dc4e586-7be9-4387-a826-0f41a47df2be tempest-AttachVolumeTestJSON-202001593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-fbafb75e-f1c3-48a2-91fb-8eb5a84c6df9" returned: 0 in 0.729s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:11:12 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-6dc4e586-7be9-4387-a826-0f41a47df2be tempest-AttachVolumeTestJSON-202001593 None] Lock "cinder-quobyte-fbafb75e-f1c3-48a2-91fb-8eb5a84c6df9" released by "delete_volume" :: held 1.901s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:11:12 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-6dc4e586-7be9-4387-a826-0f41a47df2be tempest-AttachVolumeTestJSON-202001593 None] Created reservations ['450b7003-1e77-4fce-a7d6-9e22a0e79dfc', 'e4c263a0-5df6-42dc-8d02-7f9c0683a7a1', '99299963-2676-47da-9b3c-92d0a77d1e36', '1996d59c-a04d-46c0-b37e-aef947b9b33d'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:11:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-6dc4e586-7be9-4387-a826-0f41a47df2be tempest-AttachVolumeTestJSON-202001593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:11:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-6dc4e586-7be9-4387-a826-0f41a47df2be tempest-AttachVolumeTestJSON-202001593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:11:12 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-6dc4e586-7be9-4387-a826-0f41a47df2be tempest-AttachVolumeTestJSON-202001593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:11:12 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-6dc4e586-7be9-4387-a826-0f41a47df2be tempest-AttachVolumeTestJSON-202001593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:11:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-6dc4e586-7be9-4387-a826-0f41a47df2be tempest-AttachVolumeTestJSON-202001593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:11:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-6dc4e586-7be9-4387-a826-0f41a47df2be tempest-AttachVolumeTestJSON-202001593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:11:12 devstack sudo[95955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:11:12 devstack sudo[95955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:11:12 devstack sudo[95947]: pam_unix(sudo:session): session closed for user root Jul 10 10:11:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3731897f-cec5-446b-ab2b-88a63e25078c tempest-VolumesDeleteCascade-1259063873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4.7eba57f7-c720-45bf-8a55-ccaef92dbbd8" returned: 0 in 0.863s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:11:12 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-3731897f-cec5-446b-ab2b-88a63e25078c tempest-VolumesDeleteCascade-1259063873 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4.7eba57f7-c720-45bf-8a55-ccaef92dbbd8 is being set with open permissions: ugo+rw Jul 10 10:11:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3731897f-cec5-446b-ab2b-88a63e25078c tempest-VolumesDeleteCascade-1259063873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4.7eba57f7-c720-45bf-8a55-ccaef92dbbd8 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:11:12 devstack sudo[95957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4.7eba57f7-c720-45bf-8a55-ccaef92dbbd8 Jul 10 10:11:12 devstack sudo[95957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:11:13 devstack sudo[95955]: pam_unix(sudo:session): session closed for user root Jul 10 10:11:13 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-6dc4e586-7be9-4387-a826-0f41a47df2be tempest-AttachVolumeTestJSON-202001593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.656s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:11:13 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-6dc4e586-7be9-4387-a826-0f41a47df2be tempest-AttachVolumeTestJSON-202001593 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:11:13 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-6dc4e586-7be9-4387-a826-0f41a47df2be tempest-AttachVolumeTestJSON-202001593 None] Deleted volume successfully. Jul 10 10:11:13 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-6dc4e586-7be9-4387-a826-0f41a47df2be tempest-AttachVolumeTestJSON-202001593 None] Lock "cinder-fbafb75e-f1c3-48a2-91fb-8eb5a84c6df9-delete_volume" released by "delete_volume" :: held 2.984s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:11:13 devstack sudo[95957]: pam_unix(sudo:session): session closed for user root Jul 10 10:11:13 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3731897f-cec5-446b-ab2b-88a63e25078c tempest-VolumesDeleteCascade-1259063873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4.7eba57f7-c720-45bf-8a55-ccaef92dbbd8" returned: 0 in 0.823s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:11:13 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3731897f-cec5-446b-ab2b-88a63e25078c tempest-VolumesDeleteCascade-1259063873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:11:13 devstack sudo[95961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4.info Jul 10 10:11:13 devstack sudo[95961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:11:14 devstack sudo[95961]: pam_unix(sudo:session): session closed for user root Jul 10 10:11:14 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3731897f-cec5-446b-ab2b-88a63e25078c tempest-VolumesDeleteCascade-1259063873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4.info" returned: 0 in 0.751s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:11:14 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-3731897f-cec5-446b-ab2b-88a63e25078c tempest-VolumesDeleteCascade-1259063873 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4.info is being set with open permissions: ugo+rw Jul 10 10:11:14 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3731897f-cec5-446b-ab2b-88a63e25078c tempest-VolumesDeleteCascade-1259063873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:11:14 devstack sudo[95964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4.info Jul 10 10:11:14 devstack sudo[95964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:11:15 devstack sudo[95964]: pam_unix(sudo:session): session closed for user root Jul 10 10:11:15 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3731897f-cec5-446b-ab2b-88a63e25078c tempest-VolumesDeleteCascade-1259063873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4.info" returned: 0 in 0.796s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:11:15 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-3731897f-cec5-446b-ab2b-88a63e25078c tempest-VolumesDeleteCascade-1259063873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.041s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:11:15 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-d22a6b36-32be-45f4-ad7d-eb7c7d5fef3c req-217982d1-cc2f-4e0c-98a8-9f0faab9dc73 tempest-TestMinimumBasicScenario-1075697663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.230s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:11:15 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[26962d30-aea0-40eb-bb8e-c8411baf8c33]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:11:15 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-d22a6b36-32be-45f4-ad7d-eb7c7d5fef3c req-217982d1-cc2f-4e0c-98a8-9f0faab9dc73 tempest-TestMinimumBasicScenario-1075697663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-20996cbe-3a07-4778-b9fe-f30d73b17dbc {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:11:15 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-3731897f-cec5-446b-ab2b-88a63e25078c tempest-VolumesDeleteCascade-1259063873 None] Create snapshot completed successfully Jul 10 10:11:15 devstack sudo[95968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-20996cbe-3a07-4778-b9fe-f30d73b17dbc Jul 10 10:11:15 devstack sudo[95968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:11:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-2dc67313-aae1-4fe1-9c40-1682e3c6fbfa tempest-VolumesDeleteCascade-1259063873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:11:16 devstack sudo[95968]: pam_unix(sudo:session): session closed for user root Jul 10 10:11:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-d22a6b36-32be-45f4-ad7d-eb7c7d5fef3c req-217982d1-cc2f-4e0c-98a8-9f0faab9dc73 tempest-TestMinimumBasicScenario-1075697663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-20996cbe-3a07-4778-b9fe-f30d73b17dbc" returned: 0 in 1.053s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:11:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-d22a6b36-32be-45f4-ad7d-eb7c7d5fef3c req-217982d1-cc2f-4e0c-98a8-9f0faab9dc73 tempest-TestMinimumBasicScenario-1075697663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.085s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:11:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-2dc67313-aae1-4fe1-9c40-1682e3c6fbfa tempest-VolumesDeleteCascade-1259063873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.310s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:11:16 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-2dc67313-aae1-4fe1-9c40-1682e3c6fbfa tempest-VolumesDeleteCascade-1259063873 None] Creating offline snapshot f60ba8dc-0d42-4537-ae99-fa935aef6b32 of volume 550e4afc-bec6-4ed3-828d-c6e319a42dc4 {{(pid=87234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 10:11:16 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[380158ea-deab-4e92-baf3-689005439330]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:11:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-2dc67313-aae1-4fe1-9c40-1682e3c6fbfa tempest-VolumesDeleteCascade-1259063873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4.7eba57f7-c720-45bf-8a55-ccaef92dbbd8 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:11:16 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [req-d22a6b36-32be-45f4-ad7d-eb7c7d5fef3c req-217982d1-cc2f-4e0c-98a8-9f0faab9dc73 tempest-TestMinimumBasicScenario-1075697663 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091', 'name': 'volume-20996cbe-3a07-4778-b9fe-f30d73b17dbc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a703bbda-e150-44f4-a7cd-afbac7b37d88', 'enforce_multipath': True} {{(pid=87234) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 10:11:16 devstack cinder-volume[87234]: INFO cinder.volume.manager [req-d22a6b36-32be-45f4-ad7d-eb7c7d5fef3c req-217982d1-cc2f-4e0c-98a8-9f0faab9dc73 tempest-TestMinimumBasicScenario-1075697663 None] attachment_update completed successfully. Jul 10 10:11:16 devstack sudo[95973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4.7eba57f7-c720-45bf-8a55-ccaef92dbbd8 Jul 10 10:11:16 devstack sudo[95973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:11:17 devstack sudo[95973]: pam_unix(sudo:session): session closed for user root Jul 10 10:11:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-2dc67313-aae1-4fe1-9c40-1682e3c6fbfa tempest-VolumesDeleteCascade-1259063873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4.7eba57f7-c720-45bf-8a55-ccaef92dbbd8" returned: 0 in 0.988s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:11:17 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-2dc67313-aae1-4fe1-9c40-1682e3c6fbfa tempest-VolumesDeleteCascade-1259063873 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 10:11:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-2dc67313-aae1-4fe1-9c40-1682e3c6fbfa tempest-VolumesDeleteCascade-1259063873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4.7eba57f7-c720-45bf-8a55-ccaef92dbbd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4.f60ba8dc-0d42-4537-ae99-fa935aef6b32 1G {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:11:17 devstack sudo[96046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4.7eba57f7-c720-45bf-8a55-ccaef92dbbd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4.f60ba8dc-0d42-4537-ae99-fa935aef6b32 1G Jul 10 10:11:17 devstack sudo[96046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:11:18 devstack sudo[96046]: pam_unix(sudo:session): session closed for user root Jul 10 10:11:18 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-2dc67313-aae1-4fe1-9c40-1682e3c6fbfa tempest-VolumesDeleteCascade-1259063873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4.7eba57f7-c720-45bf-8a55-ccaef92dbbd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4.f60ba8dc-0d42-4537-ae99-fa935aef6b32 1G" returned: 0 in 1.351s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:11:18 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-2dc67313-aae1-4fe1-9c40-1682e3c6fbfa tempest-VolumesDeleteCascade-1259063873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4.7eba57f7-c720-45bf-8a55-ccaef92dbbd8 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4.f60ba8dc-0d42-4537-ae99-fa935aef6b32 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:11:18 devstack sudo[96368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4.7eba57f7-c720-45bf-8a55-ccaef92dbbd8 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4.f60ba8dc-0d42-4537-ae99-fa935aef6b32 Jul 10 10:11:18 devstack sudo[96368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:11:20 devstack sudo[96368]: pam_unix(sudo:session): session closed for user root Jul 10 10:11:20 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-2dc67313-aae1-4fe1-9c40-1682e3c6fbfa tempest-VolumesDeleteCascade-1259063873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4.7eba57f7-c720-45bf-8a55-ccaef92dbbd8 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4.f60ba8dc-0d42-4537-ae99-fa935aef6b32" returned: 0 in 1.164s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:11:20 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-2dc67313-aae1-4fe1-9c40-1682e3c6fbfa tempest-VolumesDeleteCascade-1259063873 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4.f60ba8dc-0d42-4537-ae99-fa935aef6b32 is being set with open permissions: ugo+rw Jul 10 10:11:20 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-2dc67313-aae1-4fe1-9c40-1682e3c6fbfa tempest-VolumesDeleteCascade-1259063873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4.f60ba8dc-0d42-4537-ae99-fa935aef6b32 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:11:20 devstack sudo[96375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4.f60ba8dc-0d42-4537-ae99-fa935aef6b32 Jul 10 10:11:20 devstack sudo[96375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:11:20 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6d25fef-cd2f-4a8d-bebc-b01f72567985 tempest-VolumesSnapshotTestJSON-197741556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:11:20 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c6d25fef-cd2f-4a8d-bebc-b01f72567985 tempest-VolumesSnapshotTestJSON-197741556 None] Flow 'volume_create_manager' (bc53fe39-6539-4b10-bf03-55c87180aa0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:11:20 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c6d25fef-cd2f-4a8d-bebc-b01f72567985 tempest-VolumesSnapshotTestJSON-197741556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cebf1f42-21db-431b-b41c-7d2d0e00d508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:11:20 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c6d25fef-cd2f-4a8d-bebc-b01f72567985 tempest-VolumesSnapshotTestJSON-197741556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cebf1f42-21db-431b-b41c-7d2d0e00d508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:11:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1106968672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba142020-ef9e-4ae9-86d2-5377e7060492,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='890f1b9b455349768dd4e3854511a17f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:11:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:11:20Z,use_quota=True,user_id='9935e5f7f72e46f6b6220bb497204fc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:11:20 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c6d25fef-cd2f-4a8d-bebc-b01f72567985 tempest-VolumesSnapshotTestJSON-197741556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a6d799f-63c7-469f-8331-63e5891dbf80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:11:20 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c6d25fef-cd2f-4a8d-bebc-b01f72567985 tempest-VolumesSnapshotTestJSON-197741556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a6d799f-63c7-469f-8331-63e5891dbf80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:11:20 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c6d25fef-cd2f-4a8d-bebc-b01f72567985 tempest-VolumesSnapshotTestJSON-197741556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0e8141a-02c3-43c0-bb3a-eae4ff06b7c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:11:20 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c6d25fef-cd2f-4a8d-bebc-b01f72567985 tempest-VolumesSnapshotTestJSON-197741556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0e8141a-02c3-43c0-bb3a-eae4ff06b7c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba142020-ef9e-4ae9-86d2-5377e7060492', 'volume_name': 'volume-ba142020-ef9e-4ae9-86d2-5377e7060492', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:11:20 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c6d25fef-cd2f-4a8d-bebc-b01f72567985 tempest-VolumesSnapshotTestJSON-197741556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17b8c01a-a2be-4610-8085-8fd38af24bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:11:20 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c6d25fef-cd2f-4a8d-bebc-b01f72567985 tempest-VolumesSnapshotTestJSON-197741556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17b8c01a-a2be-4610-8085-8fd38af24bfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:11:20 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c6d25fef-cd2f-4a8d-bebc-b01f72567985 tempest-VolumesSnapshotTestJSON-197741556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86235b2b-2f25-42ae-a11e-aa584671c405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:11:20 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-c6d25fef-cd2f-4a8d-bebc-b01f72567985 tempest-VolumesSnapshotTestJSON-197741556 None] Volume ba142020-ef9e-4ae9-86d2-5377e7060492: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba142020-ef9e-4ae9-86d2-5377e7060492', 'volume_size': 1} Jul 10 10:11:20 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-c6d25fef-cd2f-4a8d-bebc-b01f72567985 tempest-VolumesSnapshotTestJSON-197741556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:11:21 devstack sudo[96375]: pam_unix(sudo:session): session closed for user root Jul 10 10:11:21 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-2dc67313-aae1-4fe1-9c40-1682e3c6fbfa tempest-VolumesDeleteCascade-1259063873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4.f60ba8dc-0d42-4537-ae99-fa935aef6b32" returned: 0 in 1.134s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:11:21 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-2dc67313-aae1-4fe1-9c40-1682e3c6fbfa tempest-VolumesDeleteCascade-1259063873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.790s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:11:21 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-c6d25fef-cd2f-4a8d-bebc-b01f72567985 tempest-VolumesSnapshotTestJSON-197741556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.609s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:11:21 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-c6d25fef-cd2f-4a8d-bebc-b01f72567985 tempest-VolumesSnapshotTestJSON-197741556 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:11:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1106968672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba142020-ef9e-4ae9-86d2-5377e7060492,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='890f1b9b455349768dd4e3854511a17f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:11:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:11:20Z,use_quota=True,user_id='9935e5f7f72e46f6b6220bb497204fc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:11:21 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-c6d25fef-cd2f-4a8d-bebc-b01f72567985 tempest-VolumesSnapshotTestJSON-197741556 None] Creating volume ba142020-ef9e-4ae9-86d2-5377e7060492 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:11:21 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-c6d25fef-cd2f-4a8d-bebc-b01f72567985 tempest-VolumesSnapshotTestJSON-197741556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:11:21 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-c6d25fef-cd2f-4a8d-bebc-b01f72567985 tempest-VolumesSnapshotTestJSON-197741556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:11:21 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-c6d25fef-cd2f-4a8d-bebc-b01f72567985 tempest-VolumesSnapshotTestJSON-197741556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:11:21 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-c6d25fef-cd2f-4a8d-bebc-b01f72567985 tempest-VolumesSnapshotTestJSON-197741556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:11:21 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-c6d25fef-cd2f-4a8d-bebc-b01f72567985 tempest-VolumesSnapshotTestJSON-197741556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:11:21 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-c6d25fef-cd2f-4a8d-bebc-b01f72567985 tempest-VolumesSnapshotTestJSON-197741556 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:11:21 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-c6d25fef-cd2f-4a8d-bebc-b01f72567985 tempest-VolumesSnapshotTestJSON-197741556 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:11:21 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c6d25fef-cd2f-4a8d-bebc-b01f72567985 tempest-VolumesSnapshotTestJSON-197741556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ba142020-ef9e-4ae9-86d2-5377e7060492 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:11:21 devstack sudo[96384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ba142020-ef9e-4ae9-86d2-5377e7060492 1073741824 Jul 10 10:11:21 devstack sudo[96384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:11:21 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-2dc67313-aae1-4fe1-9c40-1682e3c6fbfa tempest-VolumesDeleteCascade-1259063873 None] Create snapshot completed successfully Jul 10 10:11:22 devstack sudo[96384]: pam_unix(sudo:session): session closed for user root Jul 10 10:11:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c6d25fef-cd2f-4a8d-bebc-b01f72567985 tempest-VolumesSnapshotTestJSON-197741556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ba142020-ef9e-4ae9-86d2-5377e7060492 1073741824" returned: 0 in 1.126s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:11:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c6d25fef-cd2f-4a8d-bebc-b01f72567985 tempest-VolumesSnapshotTestJSON-197741556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ba142020-ef9e-4ae9-86d2-5377e7060492 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:11:22 devstack sudo[96392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ba142020-ef9e-4ae9-86d2-5377e7060492 Jul 10 10:11:22 devstack sudo[96392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:11:22 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-c25d11be-09a9-4f83-bf02-bcf130743fe8 tempest-VolumesDeleteCascade-1259063873 None] Acquiring lock "cinder-550e4afc-bec6-4ed3-828d-c6e319a42dc4-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:11:22 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-c25d11be-09a9-4f83-bf02-bcf130743fe8 tempest-VolumesDeleteCascade-1259063873 None] Lock "cinder-550e4afc-bec6-4ed3-828d-c6e319a42dc4-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:11:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c25d11be-09a9-4f83-bf02-bcf130743fe8 tempest-VolumesDeleteCascade-1259063873 None] Performing cascade delete. {{(pid=87234) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 10 10:11:22 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-c25d11be-09a9-4f83-bf02-bcf130743fe8 tempest-VolumesDeleteCascade-1259063873 None] Acquiring lock "cinder-7eba57f7-c720-45bf-8a55-ccaef92dbbd8-delete_snapshot" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:11:22 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-c25d11be-09a9-4f83-bf02-bcf130743fe8 tempest-VolumesDeleteCascade-1259063873 None] Lock "cinder-7eba57f7-c720-45bf-8a55-ccaef92dbbd8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:11:22 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-c25d11be-09a9-4f83-bf02-bcf130743fe8 tempest-VolumesDeleteCascade-1259063873 None] Acquiring lock "cinder-quobyte-550e4afc-bec6-4ed3-828d-c6e319a42dc4" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:11:22 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-c25d11be-09a9-4f83-bf02-bcf130743fe8 tempest-VolumesDeleteCascade-1259063873 None] Lock "cinder-quobyte-550e4afc-bec6-4ed3-828d-c6e319a42dc4" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:11:22 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-c25d11be-09a9-4f83-bf02-bcf130743fe8 tempest-VolumesDeleteCascade-1259063873 None] Acquiring lock "cinder-quobyte-7eba57f7-c720-45bf-8a55-ccaef92dbbd8" by "_delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:11:22 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-c25d11be-09a9-4f83-bf02-bcf130743fe8 tempest-VolumesDeleteCascade-1259063873 None] Lock "cinder-quobyte-7eba57f7-c720-45bf-8a55-ccaef92dbbd8" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:11:22 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-c25d11be-09a9-4f83-bf02-bcf130743fe8 tempest-VolumesDeleteCascade-1259063873 None] Deleting offline snapshot 7eba57f7-c720-45bf-8a55-ccaef92dbbd8 of volume 550e4afc-bec6-4ed3-828d-c6e319a42dc4 {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 10:11:22 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-c25d11be-09a9-4f83-bf02-bcf130743fe8 tempest-VolumesDeleteCascade-1259063873 None] snapshot_file for this snap is: volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4.7eba57f7-c720-45bf-8a55-ccaef92dbbd8 {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 10:11:22 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[5481946e-f824-4f2a-8027-df3f225a4eeb]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:11:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c25d11be-09a9-4f83-bf02-bcf130743fe8 tempest-VolumesDeleteCascade-1259063873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4.7eba57f7-c720-45bf-8a55-ccaef92dbbd8 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:11:22 devstack sudo[96394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4.7eba57f7-c720-45bf-8a55-ccaef92dbbd8 Jul 10 10:11:22 devstack sudo[96394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:11:23 devstack sudo[96392]: pam_unix(sudo:session): session closed for user root Jul 10 10:11:23 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c6d25fef-cd2f-4a8d-bebc-b01f72567985 tempest-VolumesSnapshotTestJSON-197741556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ba142020-ef9e-4ae9-86d2-5377e7060492" returned: 0 in 0.858s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:11:23 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-c6d25fef-cd2f-4a8d-bebc-b01f72567985 tempest-VolumesSnapshotTestJSON-197741556 None] <== create_volume: return (2070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:11:23 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-c6d25fef-cd2f-4a8d-bebc-b01f72567985 tempest-VolumesSnapshotTestJSON-197741556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.074s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:11:23 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c6d25fef-cd2f-4a8d-bebc-b01f72567985 tempest-VolumesSnapshotTestJSON-197741556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86235b2b-2f25-42ae-a11e-aa584671c405) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba142020-ef9e-4ae9-86d2-5377e7060492', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:11:23 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c6d25fef-cd2f-4a8d-bebc-b01f72567985 tempest-VolumesSnapshotTestJSON-197741556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afe094fa-036f-4c5f-9820-0594827e76ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:11:23 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-c6d25fef-cd2f-4a8d-bebc-b01f72567985 tempest-VolumesSnapshotTestJSON-197741556 None] Volume volume-ba142020-ef9e-4ae9-86d2-5377e7060492 (ba142020-ef9e-4ae9-86d2-5377e7060492): created successfully Jul 10 10:11:23 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c6d25fef-cd2f-4a8d-bebc-b01f72567985 tempest-VolumesSnapshotTestJSON-197741556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afe094fa-036f-4c5f-9820-0594827e76ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:11:23 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c6d25fef-cd2f-4a8d-bebc-b01f72567985 tempest-VolumesSnapshotTestJSON-197741556 None] Flow 'volume_create_manager' (bc53fe39-6539-4b10-bf03-55c87180aa0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:11:23 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-c6d25fef-cd2f-4a8d-bebc-b01f72567985 tempest-VolumesSnapshotTestJSON-197741556 None] Created volume successfully. Jul 10 10:11:23 devstack sudo[96394]: pam_unix(sudo:session): session closed for user root Jul 10 10:11:23 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c25d11be-09a9-4f83-bf02-bcf130743fe8 tempest-VolumesDeleteCascade-1259063873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4.7eba57f7-c720-45bf-8a55-ccaef92dbbd8" returned: 0 in 1.042s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:11:23 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-c25d11be-09a9-4f83-bf02-bcf130743fe8 tempest-VolumesDeleteCascade-1259063873 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 10:11:23 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a952c5-6729-4837-aca3-8ff239db0e56]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:11:23 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c25d11be-09a9-4f83-bf02-bcf130743fe8 tempest-VolumesDeleteCascade-1259063873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:11:24 devstack sudo[96400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4 Jul 10 10:11:24 devstack sudo[96400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:11:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-35abfe36-847a-4e8b-82b9-8d1ab8dc01b7 tempest-VolumesSnapshotTestJSON-197741556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:11:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-35abfe36-847a-4e8b-82b9-8d1ab8dc01b7 tempest-VolumesSnapshotTestJSON-197741556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:11:24 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-35abfe36-847a-4e8b-82b9-8d1ab8dc01b7 tempest-VolumesSnapshotTestJSON-197741556 None] Creating offline snapshot d4fd4018-ff8b-488c-9219-74faeef74ec8 of volume ba142020-ef9e-4ae9-86d2-5377e7060492 {{(pid=87234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 10:11:24 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[768fc6dd-b81a-4892-b763-cdfc5f66ad4a]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:11:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-35abfe36-847a-4e8b-82b9-8d1ab8dc01b7 tempest-VolumesSnapshotTestJSON-197741556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ba142020-ef9e-4ae9-86d2-5377e7060492 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:11:24 devstack sudo[96402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ba142020-ef9e-4ae9-86d2-5377e7060492 Jul 10 10:11:24 devstack sudo[96402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:11:25 devstack sudo[96400]: pam_unix(sudo:session): session closed for user root Jul 10 10:11:25 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c25d11be-09a9-4f83-bf02-bcf130743fe8 tempest-VolumesDeleteCascade-1259063873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4" returned: 0 in 1.128s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:11:25 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[41bf6976-9923-4baf-ad0f-21f28b1adb0e]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:11:25 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c25d11be-09a9-4f83-bf02-bcf130743fe8 tempest-VolumesDeleteCascade-1259063873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4.f60ba8dc-0d42-4537-ae99-fa935aef6b32 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:11:25 devstack sudo[96402]: pam_unix(sudo:session): session closed for user root Jul 10 10:11:25 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-35abfe36-847a-4e8b-82b9-8d1ab8dc01b7 tempest-VolumesSnapshotTestJSON-197741556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ba142020-ef9e-4ae9-86d2-5377e7060492" returned: 0 in 1.060s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:11:25 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-35abfe36-847a-4e8b-82b9-8d1ab8dc01b7 tempest-VolumesSnapshotTestJSON-197741556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ba142020-ef9e-4ae9-86d2-5377e7060492,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ba142020-ef9e-4ae9-86d2-5377e7060492.d4fd4018-ff8b-488c-9219-74faeef74ec8 1G {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:11:25 devstack sudo[96411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ba142020-ef9e-4ae9-86d2-5377e7060492,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ba142020-ef9e-4ae9-86d2-5377e7060492.d4fd4018-ff8b-488c-9219-74faeef74ec8 1G Jul 10 10:11:25 devstack sudo[96411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:11:25 devstack sudo[96410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4.f60ba8dc-0d42-4537-ae99-fa935aef6b32 Jul 10 10:11:25 devstack sudo[96410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:11:26 devstack sudo[96410]: pam_unix(sudo:session): session closed for user root Jul 10 10:11:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c25d11be-09a9-4f83-bf02-bcf130743fe8 tempest-VolumesDeleteCascade-1259063873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4.f60ba8dc-0d42-4537-ae99-fa935aef6b32" returned: 0 in 1.001s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:11:26 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-c25d11be-09a9-4f83-bf02-bcf130743fe8 tempest-VolumesDeleteCascade-1259063873 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 10:11:26 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[d338034a-c30b-446c-b1a0-ec4772ed021f]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:11:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c25d11be-09a9-4f83-bf02-bcf130743fe8 tempest-VolumesDeleteCascade-1259063873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4.7eba57f7-c720-45bf-8a55-ccaef92dbbd8 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:11:26 devstack sudo[96411]: pam_unix(sudo:session): session closed for user root Jul 10 10:11:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-35abfe36-847a-4e8b-82b9-8d1ab8dc01b7 tempest-VolumesSnapshotTestJSON-197741556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ba142020-ef9e-4ae9-86d2-5377e7060492,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ba142020-ef9e-4ae9-86d2-5377e7060492.d4fd4018-ff8b-488c-9219-74faeef74ec8 1G" returned: 0 in 1.103s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:11:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-35abfe36-847a-4e8b-82b9-8d1ab8dc01b7 tempest-VolumesSnapshotTestJSON-197741556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba142020-ef9e-4ae9-86d2-5377e7060492 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ba142020-ef9e-4ae9-86d2-5377e7060492.d4fd4018-ff8b-488c-9219-74faeef74ec8 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:11:26 devstack sudo[96423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4.7eba57f7-c720-45bf-8a55-ccaef92dbbd8 Jul 10 10:11:26 devstack sudo[96424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba142020-ef9e-4ae9-86d2-5377e7060492 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ba142020-ef9e-4ae9-86d2-5377e7060492.d4fd4018-ff8b-488c-9219-74faeef74ec8 Jul 10 10:11:26 devstack sudo[96424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:11:26 devstack sudo[96423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:11:27 devstack sudo[96424]: pam_unix(sudo:session): session closed for user root Jul 10 10:11:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-35abfe36-847a-4e8b-82b9-8d1ab8dc01b7 tempest-VolumesSnapshotTestJSON-197741556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba142020-ef9e-4ae9-86d2-5377e7060492 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ba142020-ef9e-4ae9-86d2-5377e7060492.d4fd4018-ff8b-488c-9219-74faeef74ec8" returned: 0 in 0.859s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:11:27 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-35abfe36-847a-4e8b-82b9-8d1ab8dc01b7 tempest-VolumesSnapshotTestJSON-197741556 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ba142020-ef9e-4ae9-86d2-5377e7060492.d4fd4018-ff8b-488c-9219-74faeef74ec8 is being set with open permissions: ugo+rw Jul 10 10:11:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-35abfe36-847a-4e8b-82b9-8d1ab8dc01b7 tempest-VolumesSnapshotTestJSON-197741556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ba142020-ef9e-4ae9-86d2-5377e7060492.d4fd4018-ff8b-488c-9219-74faeef74ec8 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:11:27 devstack sudo[96436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ba142020-ef9e-4ae9-86d2-5377e7060492.d4fd4018-ff8b-488c-9219-74faeef74ec8 Jul 10 10:11:27 devstack sudo[96436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:11:27 devstack sudo[96423]: pam_unix(sudo:session): session closed for user root Jul 10 10:11:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c25d11be-09a9-4f83-bf02-bcf130743fe8 tempest-VolumesDeleteCascade-1259063873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4.7eba57f7-c720-45bf-8a55-ccaef92dbbd8" returned: 0 in 1.118s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:11:27 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-c25d11be-09a9-4f83-bf02-bcf130743fe8 tempest-VolumesDeleteCascade-1259063873 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 10:11:27 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a2d8b34-343c-47e4-8e8d-3073293998aa]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:11:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c25d11be-09a9-4f83-bf02-bcf130743fe8 tempest-VolumesDeleteCascade-1259063873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:11:27 devstack sudo[96438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4 Jul 10 10:11:27 devstack sudo[96438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:11:27 devstack sudo[96436]: pam_unix(sudo:session): session closed for user root Jul 10 10:11:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-35abfe36-847a-4e8b-82b9-8d1ab8dc01b7 tempest-VolumesSnapshotTestJSON-197741556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ba142020-ef9e-4ae9-86d2-5377e7060492.d4fd4018-ff8b-488c-9219-74faeef74ec8" returned: 0 in 0.751s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:11:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-35abfe36-847a-4e8b-82b9-8d1ab8dc01b7 tempest-VolumesSnapshotTestJSON-197741556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ba142020-ef9e-4ae9-86d2-5377e7060492.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:11:28 devstack sudo[96441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ba142020-ef9e-4ae9-86d2-5377e7060492.info Jul 10 10:11:28 devstack sudo[96441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:11:28 devstack sudo[96438]: pam_unix(sudo:session): session closed for user root Jul 10 10:11:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c25d11be-09a9-4f83-bf02-bcf130743fe8 tempest-VolumesDeleteCascade-1259063873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4" returned: 0 in 0.965s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:11:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c25d11be-09a9-4f83-bf02-bcf130743fe8 tempest-VolumesDeleteCascade-1259063873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4.7eba57f7-c720-45bf-8a55-ccaef92dbbd8 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:11:28 devstack sudo[96446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4.7eba57f7-c720-45bf-8a55-ccaef92dbbd8 Jul 10 10:11:28 devstack sudo[96446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:11:29 devstack sudo[96441]: pam_unix(sudo:session): session closed for user root Jul 10 10:11:29 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-35abfe36-847a-4e8b-82b9-8d1ab8dc01b7 tempest-VolumesSnapshotTestJSON-197741556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ba142020-ef9e-4ae9-86d2-5377e7060492.info" returned: 0 in 1.050s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:11:29 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-35abfe36-847a-4e8b-82b9-8d1ab8dc01b7 tempest-VolumesSnapshotTestJSON-197741556 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ba142020-ef9e-4ae9-86d2-5377e7060492.info is being set with open permissions: ugo+rw Jul 10 10:11:29 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-35abfe36-847a-4e8b-82b9-8d1ab8dc01b7 tempest-VolumesSnapshotTestJSON-197741556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ba142020-ef9e-4ae9-86d2-5377e7060492.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:11:29 devstack sudo[96449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ba142020-ef9e-4ae9-86d2-5377e7060492.info Jul 10 10:11:29 devstack sudo[96449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:11:29 devstack sudo[96446]: pam_unix(sudo:session): session closed for user root Jul 10 10:11:29 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c25d11be-09a9-4f83-bf02-bcf130743fe8 tempest-VolumesDeleteCascade-1259063873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4.7eba57f7-c720-45bf-8a55-ccaef92dbbd8" returned: 0 in 1.101s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:11:29 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c25d11be-09a9-4f83-bf02-bcf130743fe8 tempest-VolumesDeleteCascade-1259063873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4.7eba57f7-c720-45bf-8a55-ccaef92dbbd8 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:11:29 devstack sudo[96461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4.7eba57f7-c720-45bf-8a55-ccaef92dbbd8 Jul 10 10:11:29 devstack sudo[96461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:11:29 devstack sudo[96449]: pam_unix(sudo:session): session closed for user root Jul 10 10:11:29 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-35abfe36-847a-4e8b-82b9-8d1ab8dc01b7 tempest-VolumesSnapshotTestJSON-197741556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ba142020-ef9e-4ae9-86d2-5377e7060492.info" returned: 0 in 0.845s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:11:29 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-35abfe36-847a-4e8b-82b9-8d1ab8dc01b7 tempest-VolumesSnapshotTestJSON-197741556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.795s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:11:29 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-35abfe36-847a-4e8b-82b9-8d1ab8dc01b7 tempest-VolumesSnapshotTestJSON-197741556 None] Create snapshot completed successfully Jul 10 10:11:30 devstack sudo[96461]: pam_unix(sudo:session): session closed for user root Jul 10 10:11:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c25d11be-09a9-4f83-bf02-bcf130743fe8 tempest-VolumesDeleteCascade-1259063873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4.7eba57f7-c720-45bf-8a55-ccaef92dbbd8" returned: 0 in 0.807s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:11:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c25d11be-09a9-4f83-bf02-bcf130743fe8 tempest-VolumesDeleteCascade-1259063873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4.f60ba8dc-0d42-4537-ae99-fa935aef6b32 -F qcow2 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:11:30 devstack sudo[96465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4.f60ba8dc-0d42-4537-ae99-fa935aef6b32 -F qcow2 Jul 10 10:11:30 devstack sudo[96465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:11:30 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-26481a5e-dd9f-457e-a179-b10e37bc3236 tempest-VolumesSnapshotTestJSON-197741556 None] Acquiring lock "cinder-d4fd4018-ff8b-488c-9219-74faeef74ec8-delete_snapshot" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:11:30 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-26481a5e-dd9f-457e-a179-b10e37bc3236 tempest-VolumesSnapshotTestJSON-197741556 None] Lock "cinder-d4fd4018-ff8b-488c-9219-74faeef74ec8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:11:30 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-26481a5e-dd9f-457e-a179-b10e37bc3236 tempest-VolumesSnapshotTestJSON-197741556 None] Acquiring lock "cinder-quobyte-ba142020-ef9e-4ae9-86d2-5377e7060492" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:11:30 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-26481a5e-dd9f-457e-a179-b10e37bc3236 tempest-VolumesSnapshotTestJSON-197741556 None] Lock "cinder-quobyte-ba142020-ef9e-4ae9-86d2-5377e7060492" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:11:30 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-26481a5e-dd9f-457e-a179-b10e37bc3236 tempest-VolumesSnapshotTestJSON-197741556 None] Acquiring lock "cinder-quobyte-d4fd4018-ff8b-488c-9219-74faeef74ec8" by "_delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:11:30 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-26481a5e-dd9f-457e-a179-b10e37bc3236 tempest-VolumesSnapshotTestJSON-197741556 None] Lock "cinder-quobyte-d4fd4018-ff8b-488c-9219-74faeef74ec8" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:11:30 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-26481a5e-dd9f-457e-a179-b10e37bc3236 tempest-VolumesSnapshotTestJSON-197741556 None] Deleting offline snapshot d4fd4018-ff8b-488c-9219-74faeef74ec8 of volume ba142020-ef9e-4ae9-86d2-5377e7060492 {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 10:11:30 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-26481a5e-dd9f-457e-a179-b10e37bc3236 tempest-VolumesSnapshotTestJSON-197741556 None] snapshot_file for this snap is: volume-ba142020-ef9e-4ae9-86d2-5377e7060492.d4fd4018-ff8b-488c-9219-74faeef74ec8 {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 10:11:30 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b15b654-c997-4359-a1c5-8a7f1870a8ca]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:11:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-26481a5e-dd9f-457e-a179-b10e37bc3236 tempest-VolumesSnapshotTestJSON-197741556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ba142020-ef9e-4ae9-86d2-5377e7060492.d4fd4018-ff8b-488c-9219-74faeef74ec8 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:11:31 devstack sudo[96467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ba142020-ef9e-4ae9-86d2-5377e7060492.d4fd4018-ff8b-488c-9219-74faeef74ec8 Jul 10 10:11:31 devstack sudo[96467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:11:31 devstack sudo[96465]: pam_unix(sudo:session): session closed for user root Jul 10 10:11:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c25d11be-09a9-4f83-bf02-bcf130743fe8 tempest-VolumesDeleteCascade-1259063873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4.f60ba8dc-0d42-4537-ae99-fa935aef6b32 -F qcow2" returned: 0 in 1.021s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:11:31 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-c25d11be-09a9-4f83-bf02-bcf130743fe8 tempest-VolumesDeleteCascade-1259063873 None] Lock "cinder-quobyte-7eba57f7-c720-45bf-8a55-ccaef92dbbd8" released by "_delete_snapshot" :: held 8.505s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:11:31 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-c25d11be-09a9-4f83-bf02-bcf130743fe8 tempest-VolumesDeleteCascade-1259063873 None] Lock "cinder-quobyte-550e4afc-bec6-4ed3-828d-c6e319a42dc4" released by "delete_snapshot" :: held 8.536s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:11:31 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-c25d11be-09a9-4f83-bf02-bcf130743fe8 tempest-VolumesDeleteCascade-1259063873 None] Created reservations ['42045ebd-b392-4679-9c73-0cf70e924334', '0a93589b-54d8-4479-8266-2d6c778daec8', '513b8ee0-4810-4bc8-b0c5-fba9780d537a', 'b9a5d2d6-a381-44a7-beb3-8fc03047b7c0'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:11:31 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-c25d11be-09a9-4f83-bf02-bcf130743fe8 tempest-VolumesDeleteCascade-1259063873 None] Delete snapshot completed successfully. Jul 10 10:11:31 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-c25d11be-09a9-4f83-bf02-bcf130743fe8 tempest-VolumesDeleteCascade-1259063873 None] Lock "cinder-7eba57f7-c720-45bf-8a55-ccaef92dbbd8-delete_snapshot" released by "delete_snapshot" :: held 8.749s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:11:31 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-c25d11be-09a9-4f83-bf02-bcf130743fe8 tempest-VolumesDeleteCascade-1259063873 None] Acquiring lock "cinder-f60ba8dc-0d42-4537-ae99-fa935aef6b32-delete_snapshot" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:11:31 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-c25d11be-09a9-4f83-bf02-bcf130743fe8 tempest-VolumesDeleteCascade-1259063873 None] Lock "cinder-f60ba8dc-0d42-4537-ae99-fa935aef6b32-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:11:31 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-c25d11be-09a9-4f83-bf02-bcf130743fe8 tempest-VolumesDeleteCascade-1259063873 None] Acquiring lock "cinder-quobyte-550e4afc-bec6-4ed3-828d-c6e319a42dc4" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:11:31 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-c25d11be-09a9-4f83-bf02-bcf130743fe8 tempest-VolumesDeleteCascade-1259063873 None] Lock "cinder-quobyte-550e4afc-bec6-4ed3-828d-c6e319a42dc4" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:11:31 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-c25d11be-09a9-4f83-bf02-bcf130743fe8 tempest-VolumesDeleteCascade-1259063873 None] Acquiring lock "cinder-quobyte-f60ba8dc-0d42-4537-ae99-fa935aef6b32" by "_delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:11:31 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-c25d11be-09a9-4f83-bf02-bcf130743fe8 tempest-VolumesDeleteCascade-1259063873 None] Lock "cinder-quobyte-f60ba8dc-0d42-4537-ae99-fa935aef6b32" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:11:31 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-c25d11be-09a9-4f83-bf02-bcf130743fe8 tempest-VolumesDeleteCascade-1259063873 None] Deleting offline snapshot f60ba8dc-0d42-4537-ae99-fa935aef6b32 of volume 550e4afc-bec6-4ed3-828d-c6e319a42dc4 {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 10:11:31 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-c25d11be-09a9-4f83-bf02-bcf130743fe8 tempest-VolumesDeleteCascade-1259063873 None] snapshot_file for this snap is: volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4.f60ba8dc-0d42-4537-ae99-fa935aef6b32 {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 10:11:31 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[66bcc247-1eaa-4255-a2d8-1562663e665c]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:11:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c25d11be-09a9-4f83-bf02-bcf130743fe8 tempest-VolumesDeleteCascade-1259063873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4.f60ba8dc-0d42-4537-ae99-fa935aef6b32 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:11:31 devstack sudo[96475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4.f60ba8dc-0d42-4537-ae99-fa935aef6b32 Jul 10 10:11:31 devstack sudo[96475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:11:32 devstack sudo[96467]: pam_unix(sudo:session): session closed for user root Jul 10 10:11:32 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-26481a5e-dd9f-457e-a179-b10e37bc3236 tempest-VolumesSnapshotTestJSON-197741556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ba142020-ef9e-4ae9-86d2-5377e7060492.d4fd4018-ff8b-488c-9219-74faeef74ec8" returned: 0 in 1.224s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:11:32 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-26481a5e-dd9f-457e-a179-b10e37bc3236 tempest-VolumesSnapshotTestJSON-197741556 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba142020-ef9e-4ae9-86d2-5377e7060492(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 10:11:32 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d44d60-7ccf-4176-af2c-4fd94a4bd7ba]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:11:32 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-26481a5e-dd9f-457e-a179-b10e37bc3236 tempest-VolumesSnapshotTestJSON-197741556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ba142020-ef9e-4ae9-86d2-5377e7060492 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:11:32 devstack sudo[96482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ba142020-ef9e-4ae9-86d2-5377e7060492 Jul 10 10:11:32 devstack sudo[96482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:11:32 devstack sudo[96475]: pam_unix(sudo:session): session closed for user root Jul 10 10:11:32 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c25d11be-09a9-4f83-bf02-bcf130743fe8 tempest-VolumesDeleteCascade-1259063873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4.f60ba8dc-0d42-4537-ae99-fa935aef6b32" returned: 0 in 1.029s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:11:32 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-c25d11be-09a9-4f83-bf02-bcf130743fe8 tempest-VolumesDeleteCascade-1259063873 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 10:11:32 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4494d90-f4ba-4373-a71d-8d76e294aa8c]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:11:32 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c25d11be-09a9-4f83-bf02-bcf130743fe8 tempest-VolumesDeleteCascade-1259063873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:11:33 devstack sudo[96487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4 Jul 10 10:11:33 devstack sudo[96487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:11:33 devstack sudo[96482]: pam_unix(sudo:session): session closed for user root Jul 10 10:11:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-26481a5e-dd9f-457e-a179-b10e37bc3236 tempest-VolumesSnapshotTestJSON-197741556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ba142020-ef9e-4ae9-86d2-5377e7060492" returned: 0 in 1.269s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:11:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-26481a5e-dd9f-457e-a179-b10e37bc3236 tempest-VolumesSnapshotTestJSON-197741556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ba142020-ef9e-4ae9-86d2-5377e7060492.d4fd4018-ff8b-488c-9219-74faeef74ec8 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:11:33 devstack sudo[96492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ba142020-ef9e-4ae9-86d2-5377e7060492.d4fd4018-ff8b-488c-9219-74faeef74ec8 Jul 10 10:11:33 devstack sudo[96492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:11:34 devstack sudo[96487]: pam_unix(sudo:session): session closed for user root Jul 10 10:11:34 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c25d11be-09a9-4f83-bf02-bcf130743fe8 tempest-VolumesDeleteCascade-1259063873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4" returned: 0 in 1.249s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:11:34 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c25d11be-09a9-4f83-bf02-bcf130743fe8 tempest-VolumesDeleteCascade-1259063873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4.f60ba8dc-0d42-4537-ae99-fa935aef6b32 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:11:34 devstack sudo[96498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4.f60ba8dc-0d42-4537-ae99-fa935aef6b32 Jul 10 10:11:34 devstack sudo[96498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:11:34 devstack sudo[96492]: pam_unix(sudo:session): session closed for user root Jul 10 10:11:34 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-26481a5e-dd9f-457e-a179-b10e37bc3236 tempest-VolumesSnapshotTestJSON-197741556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ba142020-ef9e-4ae9-86d2-5377e7060492.d4fd4018-ff8b-488c-9219-74faeef74ec8" returned: 0 in 1.125s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:11:34 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-26481a5e-dd9f-457e-a179-b10e37bc3236 tempest-VolumesSnapshotTestJSON-197741556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ba142020-ef9e-4ae9-86d2-5377e7060492.d4fd4018-ff8b-488c-9219-74faeef74ec8 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:11:34 devstack sudo[96504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ba142020-ef9e-4ae9-86d2-5377e7060492.d4fd4018-ff8b-488c-9219-74faeef74ec8 Jul 10 10:11:34 devstack sudo[96504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:11:35 devstack sudo[96498]: pam_unix(sudo:session): session closed for user root Jul 10 10:11:35 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c25d11be-09a9-4f83-bf02-bcf130743fe8 tempest-VolumesDeleteCascade-1259063873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4.f60ba8dc-0d42-4537-ae99-fa935aef6b32" returned: 0 in 0.996s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:11:35 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c25d11be-09a9-4f83-bf02-bcf130743fe8 tempest-VolumesDeleteCascade-1259063873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4.f60ba8dc-0d42-4537-ae99-fa935aef6b32 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:11:35 devstack sudo[96510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4.f60ba8dc-0d42-4537-ae99-fa935aef6b32 Jul 10 10:11:35 devstack sudo[96510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:11:35 devstack sudo[96504]: pam_unix(sudo:session): session closed for user root Jul 10 10:11:35 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-26481a5e-dd9f-457e-a179-b10e37bc3236 tempest-VolumesSnapshotTestJSON-197741556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ba142020-ef9e-4ae9-86d2-5377e7060492.d4fd4018-ff8b-488c-9219-74faeef74ec8" returned: 0 in 0.883s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:11:35 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-26481a5e-dd9f-457e-a179-b10e37bc3236 tempest-VolumesSnapshotTestJSON-197741556 None] Lock "cinder-quobyte-d4fd4018-ff8b-488c-9219-74faeef74ec8" released by "_delete_snapshot" :: held 4.683s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:11:35 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-26481a5e-dd9f-457e-a179-b10e37bc3236 tempest-VolumesSnapshotTestJSON-197741556 None] Lock "cinder-quobyte-ba142020-ef9e-4ae9-86d2-5377e7060492" released by "delete_snapshot" :: held 4.716s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:11:35 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-26481a5e-dd9f-457e-a179-b10e37bc3236 tempest-VolumesSnapshotTestJSON-197741556 None] Created reservations ['0d01f20e-f8b0-44f6-ba3f-ce01a64b0740', 'c55be68d-5eee-450d-a363-db6caf813bda', 'c8841510-50e4-4aae-a458-796fbf6727ea', '332e830f-818a-419e-9d39-24a2c1f6f178'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:11:35 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-26481a5e-dd9f-457e-a179-b10e37bc3236 tempest-VolumesSnapshotTestJSON-197741556 None] Delete snapshot completed successfully. Jul 10 10:11:35 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-26481a5e-dd9f-457e-a179-b10e37bc3236 tempest-VolumesSnapshotTestJSON-197741556 None] Lock "cinder-d4fd4018-ff8b-488c-9219-74faeef74ec8-delete_snapshot" released by "delete_snapshot" :: held 4.976s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:11:35 devstack sudo[96510]: pam_unix(sudo:session): session closed for user root Jul 10 10:11:35 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c25d11be-09a9-4f83-bf02-bcf130743fe8 tempest-VolumesDeleteCascade-1259063873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4.f60ba8dc-0d42-4537-ae99-fa935aef6b32" returned: 0 in 0.868s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:11:35 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-c25d11be-09a9-4f83-bf02-bcf130743fe8 tempest-VolumesDeleteCascade-1259063873 None] Lock "cinder-quobyte-f60ba8dc-0d42-4537-ae99-fa935aef6b32" released by "_delete_snapshot" :: held 4.307s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:11:35 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-c25d11be-09a9-4f83-bf02-bcf130743fe8 tempest-VolumesDeleteCascade-1259063873 None] Lock "cinder-quobyte-550e4afc-bec6-4ed3-828d-c6e319a42dc4" released by "delete_snapshot" :: held 4.351s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:11:35 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-c25d11be-09a9-4f83-bf02-bcf130743fe8 tempest-VolumesDeleteCascade-1259063873 None] Created reservations ['06402974-1cdd-448c-95e9-63ed0807453a', '3fedde09-974b-4118-a918-9cbdb742146f', '05b792e6-edd5-4321-aac3-c02702eafaa7', '1f8adf82-2c92-45d7-b9d6-be9417c4de3f'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:11:36 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-c25d11be-09a9-4f83-bf02-bcf130743fe8 tempest-VolumesDeleteCascade-1259063873 None] Delete snapshot completed successfully. Jul 10 10:11:36 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-c25d11be-09a9-4f83-bf02-bcf130743fe8 tempest-VolumesDeleteCascade-1259063873 None] Lock "cinder-f60ba8dc-0d42-4537-ae99-fa935aef6b32-delete_snapshot" released by "delete_snapshot" :: held 4.538s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:11:36 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c25d11be-09a9-4f83-bf02-bcf130743fe8 tempest-VolumesDeleteCascade-1259063873 None] Snapshots deleted, issuing volume delete {{(pid=87234) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 10 10:11:36 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-c25d11be-09a9-4f83-bf02-bcf130743fe8 tempest-VolumesDeleteCascade-1259063873 None] Acquiring lock "cinder-quobyte-550e4afc-bec6-4ed3-828d-c6e319a42dc4" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:11:36 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-c25d11be-09a9-4f83-bf02-bcf130743fe8 tempest-VolumesDeleteCascade-1259063873 None] Lock "cinder-quobyte-550e4afc-bec6-4ed3-828d-c6e319a42dc4" acquired by "delete_volume" :: waited 0.023s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:11:36 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a71f5df-05a3-474c-bde2-1170c285098a]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:11:36 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c25d11be-09a9-4f83-bf02-bcf130743fe8 tempest-VolumesDeleteCascade-1259063873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:11:36 devstack sudo[96514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4 Jul 10 10:11:36 devstack sudo[96514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:11:36 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4595820-8983-4c70-a373-9036e5bcb9c6 tempest-VolumesSnapshotTestJSON-197741556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:11:36 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f4595820-8983-4c70-a373-9036e5bcb9c6 tempest-VolumesSnapshotTestJSON-197741556 None] Flow 'volume_create_manager' (30a12ed3-103e-4326-ae0a-5e0b468cd9f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:11:36 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f4595820-8983-4c70-a373-9036e5bcb9c6 tempest-VolumesSnapshotTestJSON-197741556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e64de40-99df-481b-920b-facff6137886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:11:36 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f4595820-8983-4c70-a373-9036e5bcb9c6 tempest-VolumesSnapshotTestJSON-197741556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e64de40-99df-481b-920b-facff6137886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:11:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1450512908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c952a096-ac09-4a11-b56c-d9a174e21edf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='890f1b9b455349768dd4e3854511a17f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:11:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:11:37Z,use_quota=True,user_id='9935e5f7f72e46f6b6220bb497204fc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:11:36 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f4595820-8983-4c70-a373-9036e5bcb9c6 tempest-VolumesSnapshotTestJSON-197741556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b239daf1-25c1-4e4b-97a3-b448c59b8897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:11:36 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f4595820-8983-4c70-a373-9036e5bcb9c6 tempest-VolumesSnapshotTestJSON-197741556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b239daf1-25c1-4e4b-97a3-b448c59b8897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:11:36 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f4595820-8983-4c70-a373-9036e5bcb9c6 tempest-VolumesSnapshotTestJSON-197741556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44beae64-70ae-4a83-8e50-244dbe8ed04c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:11:36 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f4595820-8983-4c70-a373-9036e5bcb9c6 tempest-VolumesSnapshotTestJSON-197741556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44beae64-70ae-4a83-8e50-244dbe8ed04c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c952a096-ac09-4a11-b56c-d9a174e21edf', 'volume_name': 'volume-c952a096-ac09-4a11-b56c-d9a174e21edf', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:11:36 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f4595820-8983-4c70-a373-9036e5bcb9c6 tempest-VolumesSnapshotTestJSON-197741556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1422845e-1d99-4de8-aa0f-e97dc38c003d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:11:36 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f4595820-8983-4c70-a373-9036e5bcb9c6 tempest-VolumesSnapshotTestJSON-197741556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1422845e-1d99-4de8-aa0f-e97dc38c003d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:11:36 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f4595820-8983-4c70-a373-9036e5bcb9c6 tempest-VolumesSnapshotTestJSON-197741556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b17b0a4-9a25-47b1-ae64-5bd74e104e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:11:36 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-f4595820-8983-4c70-a373-9036e5bcb9c6 tempest-VolumesSnapshotTestJSON-197741556 None] Volume c952a096-ac09-4a11-b56c-d9a174e21edf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c952a096-ac09-4a11-b56c-d9a174e21edf', 'volume_size': 1} Jul 10 10:11:36 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f4595820-8983-4c70-a373-9036e5bcb9c6 tempest-VolumesSnapshotTestJSON-197741556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:11:36 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f4595820-8983-4c70-a373-9036e5bcb9c6 tempest-VolumesSnapshotTestJSON-197741556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:11:36 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f4595820-8983-4c70-a373-9036e5bcb9c6 tempest-VolumesSnapshotTestJSON-197741556 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:11:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1450512908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c952a096-ac09-4a11-b56c-d9a174e21edf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='890f1b9b455349768dd4e3854511a17f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:11:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:11:37Z,use_quota=True,user_id='9935e5f7f72e46f6b6220bb497204fc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:11:36 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-f4595820-8983-4c70-a373-9036e5bcb9c6 tempest-VolumesSnapshotTestJSON-197741556 None] Creating volume c952a096-ac09-4a11-b56c-d9a174e21edf {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:11:36 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f4595820-8983-4c70-a373-9036e5bcb9c6 tempest-VolumesSnapshotTestJSON-197741556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:11:36 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f4595820-8983-4c70-a373-9036e5bcb9c6 tempest-VolumesSnapshotTestJSON-197741556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:11:36 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f4595820-8983-4c70-a373-9036e5bcb9c6 tempest-VolumesSnapshotTestJSON-197741556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:11:36 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f4595820-8983-4c70-a373-9036e5bcb9c6 tempest-VolumesSnapshotTestJSON-197741556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:11:36 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f4595820-8983-4c70-a373-9036e5bcb9c6 tempest-VolumesSnapshotTestJSON-197741556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:11:36 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f4595820-8983-4c70-a373-9036e5bcb9c6 tempest-VolumesSnapshotTestJSON-197741556 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:11:36 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-f4595820-8983-4c70-a373-9036e5bcb9c6 tempest-VolumesSnapshotTestJSON-197741556 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:11:36 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f4595820-8983-4c70-a373-9036e5bcb9c6 tempest-VolumesSnapshotTestJSON-197741556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c952a096-ac09-4a11-b56c-d9a174e21edf 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:11:36 devstack sudo[96520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c952a096-ac09-4a11-b56c-d9a174e21edf 1073741824 Jul 10 10:11:36 devstack sudo[96520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:11:37 devstack sudo[96514]: pam_unix(sudo:session): session closed for user root Jul 10 10:11:37 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c25d11be-09a9-4f83-bf02-bcf130743fe8 tempest-VolumesDeleteCascade-1259063873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4" returned: 0 in 0.890s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:11:37 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c25d11be-09a9-4f83-bf02-bcf130743fe8 tempest-VolumesDeleteCascade-1259063873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:11:37 devstack sudo[96522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4 Jul 10 10:11:37 devstack sudo[96522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:11:37 devstack sudo[96522]: pam_unix(sudo:session): session closed for user root Jul 10 10:11:37 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c25d11be-09a9-4f83-bf02-bcf130743fe8 tempest-VolumesDeleteCascade-1259063873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-550e4afc-bec6-4ed3-828d-c6e319a42dc4" returned: 0 in 0.763s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:11:37 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-c25d11be-09a9-4f83-bf02-bcf130743fe8 tempest-VolumesDeleteCascade-1259063873 None] Lock "cinder-quobyte-550e4afc-bec6-4ed3-828d-c6e319a42dc4" released by "delete_volume" :: held 1.744s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:11:37 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-c25d11be-09a9-4f83-bf02-bcf130743fe8 tempest-VolumesDeleteCascade-1259063873 None] Created reservations ['2b0109f6-6f46-4d6e-97c0-681cf9815c9d', 'c6630ad2-785d-44cd-bf3f-8f0202582ed5', '9ac99f1e-7f15-4e02-9d14-da0fb4756cc1', '79e8d62d-d977-4a5d-b17f-287d108aa0d2'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:11:37 devstack sudo[96520]: pam_unix(sudo:session): session closed for user root Jul 10 10:11:37 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-c25d11be-09a9-4f83-bf02-bcf130743fe8 tempest-VolumesDeleteCascade-1259063873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:11:37 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-c25d11be-09a9-4f83-bf02-bcf130743fe8 tempest-VolumesDeleteCascade-1259063873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:11:37 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-c25d11be-09a9-4f83-bf02-bcf130743fe8 tempest-VolumesDeleteCascade-1259063873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:11:37 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-c25d11be-09a9-4f83-bf02-bcf130743fe8 tempest-VolumesDeleteCascade-1259063873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:11:37 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-c25d11be-09a9-4f83-bf02-bcf130743fe8 tempest-VolumesDeleteCascade-1259063873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:11:37 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c25d11be-09a9-4f83-bf02-bcf130743fe8 tempest-VolumesDeleteCascade-1259063873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:11:37 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f4595820-8983-4c70-a373-9036e5bcb9c6 tempest-VolumesSnapshotTestJSON-197741556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c952a096-ac09-4a11-b56c-d9a174e21edf 1073741824" returned: 0 in 1.089s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:11:38 devstack sudo[96556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:11:38 devstack sudo[96556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:11:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f4595820-8983-4c70-a373-9036e5bcb9c6 tempest-VolumesSnapshotTestJSON-197741556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c952a096-ac09-4a11-b56c-d9a174e21edf {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:11:38 devstack sudo[96558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c952a096-ac09-4a11-b56c-d9a174e21edf Jul 10 10:11:38 devstack sudo[96558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:11:38 devstack sudo[96556]: pam_unix(sudo:session): session closed for user root Jul 10 10:11:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c25d11be-09a9-4f83-bf02-bcf130743fe8 tempest-VolumesDeleteCascade-1259063873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.848s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:11:38 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-c25d11be-09a9-4f83-bf02-bcf130743fe8 tempest-VolumesDeleteCascade-1259063873 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:11:38 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-c25d11be-09a9-4f83-bf02-bcf130743fe8 tempest-VolumesDeleteCascade-1259063873 None] Deleted volume successfully. Jul 10 10:11:38 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-c25d11be-09a9-4f83-bf02-bcf130743fe8 tempest-VolumesDeleteCascade-1259063873 None] Lock "cinder-550e4afc-bec6-4ed3-828d-c6e319a42dc4-delete_volume" released by "delete_volume" :: held 16.246s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:11:38 devstack sudo[96558]: pam_unix(sudo:session): session closed for user root Jul 10 10:11:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f4595820-8983-4c70-a373-9036e5bcb9c6 tempest-VolumesSnapshotTestJSON-197741556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c952a096-ac09-4a11-b56c-d9a174e21edf" returned: 0 in 0.857s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:11:38 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f4595820-8983-4c70-a373-9036e5bcb9c6 tempest-VolumesSnapshotTestJSON-197741556 None] <== create_volume: return (1994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:11:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f4595820-8983-4c70-a373-9036e5bcb9c6 tempest-VolumesSnapshotTestJSON-197741556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.996s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:11:38 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f4595820-8983-4c70-a373-9036e5bcb9c6 tempest-VolumesSnapshotTestJSON-197741556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b17b0a4-9a25-47b1-ae64-5bd74e104e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c952a096-ac09-4a11-b56c-d9a174e21edf', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:11:38 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f4595820-8983-4c70-a373-9036e5bcb9c6 tempest-VolumesSnapshotTestJSON-197741556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0f6400a-9359-4a79-9cad-f99025ca5791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:11:38 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-f4595820-8983-4c70-a373-9036e5bcb9c6 tempest-VolumesSnapshotTestJSON-197741556 None] Volume volume-c952a096-ac09-4a11-b56c-d9a174e21edf (c952a096-ac09-4a11-b56c-d9a174e21edf): created successfully Jul 10 10:11:38 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f4595820-8983-4c70-a373-9036e5bcb9c6 tempest-VolumesSnapshotTestJSON-197741556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0f6400a-9359-4a79-9cad-f99025ca5791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:11:38 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f4595820-8983-4c70-a373-9036e5bcb9c6 tempest-VolumesSnapshotTestJSON-197741556 None] Flow 'volume_create_manager' (30a12ed3-103e-4326-ae0a-5e0b468cd9f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:11:38 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-f4595820-8983-4c70-a373-9036e5bcb9c6 tempest-VolumesSnapshotTestJSON-197741556 None] Created volume successfully. Jul 10 10:11:39 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b166b8b-87f4-4fc3-8736-3556211b4da3 tempest-VolumesDeleteCascade-1259063873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:11:39 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4b166b8b-87f4-4fc3-8736-3556211b4da3 tempest-VolumesDeleteCascade-1259063873 None] Flow 'volume_create_manager' (f2532fb4-5b4b-4576-b05c-e7afd8a262ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:11:39 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4b166b8b-87f4-4fc3-8736-3556211b4da3 tempest-VolumesDeleteCascade-1259063873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51473c01-7a44-4178-9e75-6d98168d00bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:11:39 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4b166b8b-87f4-4fc3-8736-3556211b4da3 tempest-VolumesDeleteCascade-1259063873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51473c01-7a44-4178-9e75-6d98168d00bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1206558827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=124c79dc-ac52-4c1a-99e7-e416869882cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='271189cec40041d38ae51354c096f46a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:11:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:11:39Z,use_quota=True,user_id='2623c56cb8fb46b1b82a7d248e8360f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:11:39 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4b166b8b-87f4-4fc3-8736-3556211b4da3 tempest-VolumesDeleteCascade-1259063873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15603091-4ac6-4155-9bf5-a8cf4a135736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:11:39 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4b166b8b-87f4-4fc3-8736-3556211b4da3 tempest-VolumesDeleteCascade-1259063873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15603091-4ac6-4155-9bf5-a8cf4a135736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:11:39 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4b166b8b-87f4-4fc3-8736-3556211b4da3 tempest-VolumesDeleteCascade-1259063873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bae198a-c1b1-4cab-a5c5-a9201fca0fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:11:39 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4b166b8b-87f4-4fc3-8736-3556211b4da3 tempest-VolumesDeleteCascade-1259063873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bae198a-c1b1-4cab-a5c5-a9201fca0fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '124c79dc-ac52-4c1a-99e7-e416869882cc', 'volume_name': 'volume-124c79dc-ac52-4c1a-99e7-e416869882cc', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:11:39 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4b166b8b-87f4-4fc3-8736-3556211b4da3 tempest-VolumesDeleteCascade-1259063873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7377fd54-268f-43c5-98ad-40141894c0d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:11:39 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4b166b8b-87f4-4fc3-8736-3556211b4da3 tempest-VolumesDeleteCascade-1259063873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7377fd54-268f-43c5-98ad-40141894c0d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:11:39 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4b166b8b-87f4-4fc3-8736-3556211b4da3 tempest-VolumesDeleteCascade-1259063873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70e6d8e5-b397-42df-9d74-32f842b671b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:11:39 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-4b166b8b-87f4-4fc3-8736-3556211b4da3 tempest-VolumesDeleteCascade-1259063873 None] Volume 124c79dc-ac52-4c1a-99e7-e416869882cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-124c79dc-ac52-4c1a-99e7-e416869882cc', 'volume_size': 1} Jul 10 10:11:39 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-4b166b8b-87f4-4fc3-8736-3556211b4da3 tempest-VolumesDeleteCascade-1259063873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:11:39 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-4b166b8b-87f4-4fc3-8736-3556211b4da3 tempest-VolumesDeleteCascade-1259063873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:11:39 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-4b166b8b-87f4-4fc3-8736-3556211b4da3 tempest-VolumesDeleteCascade-1259063873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1206558827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=124c79dc-ac52-4c1a-99e7-e416869882cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='271189cec40041d38ae51354c096f46a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:11:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:11:39Z,use_quota=True,user_id='2623c56cb8fb46b1b82a7d248e8360f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:11:39 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-4b166b8b-87f4-4fc3-8736-3556211b4da3 tempest-VolumesDeleteCascade-1259063873 None] Creating volume 124c79dc-ac52-4c1a-99e7-e416869882cc {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:11:39 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-4b166b8b-87f4-4fc3-8736-3556211b4da3 tempest-VolumesDeleteCascade-1259063873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:11:39 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-4b166b8b-87f4-4fc3-8736-3556211b4da3 tempest-VolumesDeleteCascade-1259063873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:11:39 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-4b166b8b-87f4-4fc3-8736-3556211b4da3 tempest-VolumesDeleteCascade-1259063873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:11:39 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-4b166b8b-87f4-4fc3-8736-3556211b4da3 tempest-VolumesDeleteCascade-1259063873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:11:39 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-4b166b8b-87f4-4fc3-8736-3556211b4da3 tempest-VolumesDeleteCascade-1259063873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:11:39 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-4b166b8b-87f4-4fc3-8736-3556211b4da3 tempest-VolumesDeleteCascade-1259063873 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:11:39 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-4b166b8b-87f4-4fc3-8736-3556211b4da3 tempest-VolumesDeleteCascade-1259063873 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:11:39 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4b166b8b-87f4-4fc3-8736-3556211b4da3 tempest-VolumesDeleteCascade-1259063873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-124c79dc-ac52-4c1a-99e7-e416869882cc 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:11:39 devstack sudo[96563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-124c79dc-ac52-4c1a-99e7-e416869882cc 1073741824 Jul 10 10:11:39 devstack sudo[96563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:11:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-78432434-c0e7-452c-b3f9-cca62b2172e7 tempest-VolumesSnapshotTestJSON-197741556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:11:40 devstack sudo[96563]: pam_unix(sudo:session): session closed for user root Jul 10 10:11:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4b166b8b-87f4-4fc3-8736-3556211b4da3 tempest-VolumesDeleteCascade-1259063873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-124c79dc-ac52-4c1a-99e7-e416869882cc 1073741824" returned: 0 in 0.943s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:11:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4b166b8b-87f4-4fc3-8736-3556211b4da3 tempest-VolumesDeleteCascade-1259063873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-124c79dc-ac52-4c1a-99e7-e416869882cc {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:11:40 devstack sudo[96569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-124c79dc-ac52-4c1a-99e7-e416869882cc Jul 10 10:11:40 devstack sudo[96569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:11:40 devstack sudo[96569]: pam_unix(sudo:session): session closed for user root Jul 10 10:11:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4b166b8b-87f4-4fc3-8736-3556211b4da3 tempest-VolumesDeleteCascade-1259063873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-124c79dc-ac52-4c1a-99e7-e416869882cc" returned: 0 in 0.664s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:11:40 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-4b166b8b-87f4-4fc3-8736-3556211b4da3 tempest-VolumesDeleteCascade-1259063873 None] <== create_volume: return (1648ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:11:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-4b166b8b-87f4-4fc3-8736-3556211b4da3 tempest-VolumesDeleteCascade-1259063873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.651s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:11:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-78432434-c0e7-452c-b3f9-cca62b2172e7 tempest-VolumesSnapshotTestJSON-197741556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.810s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:11:40 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4b166b8b-87f4-4fc3-8736-3556211b4da3 tempest-VolumesDeleteCascade-1259063873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70e6d8e5-b397-42df-9d74-32f842b671b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-124c79dc-ac52-4c1a-99e7-e416869882cc', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:11:40 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4b166b8b-87f4-4fc3-8736-3556211b4da3 tempest-VolumesDeleteCascade-1259063873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3e6200e-1002-410f-829e-d1cb32929323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:11:40 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-78432434-c0e7-452c-b3f9-cca62b2172e7 tempest-VolumesSnapshotTestJSON-197741556 None] Creating offline snapshot 9c631f1e-c0c9-4898-bc7b-5d282d4c358a of volume c952a096-ac09-4a11-b56c-d9a174e21edf {{(pid=87234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 10:11:40 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-4b166b8b-87f4-4fc3-8736-3556211b4da3 tempest-VolumesDeleteCascade-1259063873 None] Volume volume-124c79dc-ac52-4c1a-99e7-e416869882cc (124c79dc-ac52-4c1a-99e7-e416869882cc): created successfully Jul 10 10:11:40 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4b166b8b-87f4-4fc3-8736-3556211b4da3 tempest-VolumesDeleteCascade-1259063873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3e6200e-1002-410f-829e-d1cb32929323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:11:40 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4b166b8b-87f4-4fc3-8736-3556211b4da3 tempest-VolumesDeleteCascade-1259063873 None] Flow 'volume_create_manager' (f2532fb4-5b4b-4576-b05c-e7afd8a262ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:11:40 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a35d231-2101-4d84-8d4c-110ee47bf34c]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:11:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-78432434-c0e7-452c-b3f9-cca62b2172e7 tempest-VolumesSnapshotTestJSON-197741556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c952a096-ac09-4a11-b56c-d9a174e21edf {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:11:41 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-4b166b8b-87f4-4fc3-8736-3556211b4da3 tempest-VolumesDeleteCascade-1259063873 None] Created volume successfully. Jul 10 10:11:41 devstack sudo[96572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c952a096-ac09-4a11-b56c-d9a174e21edf Jul 10 10:11:41 devstack sudo[96572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:11:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-7e3dce1f-0b3b-40b9-8191-d24339e59ebc tempest-VolumesDeleteCascade-1259063873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:11:41 devstack sudo[96572]: pam_unix(sudo:session): session closed for user root Jul 10 10:11:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-78432434-c0e7-452c-b3f9-cca62b2172e7 tempest-VolumesSnapshotTestJSON-197741556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c952a096-ac09-4a11-b56c-d9a174e21edf" returned: 0 in 0.802s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:11:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-78432434-c0e7-452c-b3f9-cca62b2172e7 tempest-VolumesSnapshotTestJSON-197741556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c952a096-ac09-4a11-b56c-d9a174e21edf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c952a096-ac09-4a11-b56c-d9a174e21edf.9c631f1e-c0c9-4898-bc7b-5d282d4c358a 1G {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:11:41 devstack sudo[96577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c952a096-ac09-4a11-b56c-d9a174e21edf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c952a096-ac09-4a11-b56c-d9a174e21edf.9c631f1e-c0c9-4898-bc7b-5d282d4c358a 1G Jul 10 10:11:41 devstack sudo[96577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:11:42 devstack cinder-volume[87234]: DEBUG oslo_service.periodic_task [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 10:11:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:11:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:11:42 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:11:42 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:11:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:11:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:11:42 devstack sudo[96579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:11:42 devstack sudo[96579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:11:42 devstack sudo[96577]: pam_unix(sudo:session): session closed for user root Jul 10 10:11:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-78432434-c0e7-452c-b3f9-cca62b2172e7 tempest-VolumesSnapshotTestJSON-197741556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c952a096-ac09-4a11-b56c-d9a174e21edf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c952a096-ac09-4a11-b56c-d9a174e21edf.9c631f1e-c0c9-4898-bc7b-5d282d4c358a 1G" returned: 0 in 0.903s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:11:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-78432434-c0e7-452c-b3f9-cca62b2172e7 tempest-VolumesSnapshotTestJSON-197741556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c952a096-ac09-4a11-b56c-d9a174e21edf -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c952a096-ac09-4a11-b56c-d9a174e21edf.9c631f1e-c0c9-4898-bc7b-5d282d4c358a {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:11:42 devstack sudo[96588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c952a096-ac09-4a11-b56c-d9a174e21edf -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c952a096-ac09-4a11-b56c-d9a174e21edf.9c631f1e-c0c9-4898-bc7b-5d282d4c358a Jul 10 10:11:42 devstack sudo[96588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:11:42 devstack sudo[96579]: pam_unix(sudo:session): session closed for user root Jul 10 10:11:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.717s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:11:42 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:11:42 devstack cinder-volume[87234]: DEBUG oslo_service.periodic_task [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Running periodic task VolumeManager._thread_info {{(pid=87234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 10:11:42 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] thread count: 28 {{(pid=87234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 10:11:42 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] thread info: [<_MainThread(MainThread, started 131600773742720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 10:11:43 devstack sudo[96588]: pam_unix(sudo:session): session closed for user root Jul 10 10:11:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-78432434-c0e7-452c-b3f9-cca62b2172e7 tempest-VolumesSnapshotTestJSON-197741556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c952a096-ac09-4a11-b56c-d9a174e21edf -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c952a096-ac09-4a11-b56c-d9a174e21edf.9c631f1e-c0c9-4898-bc7b-5d282d4c358a" returned: 0 in 0.790s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:11:43 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-78432434-c0e7-452c-b3f9-cca62b2172e7 tempest-VolumesSnapshotTestJSON-197741556 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c952a096-ac09-4a11-b56c-d9a174e21edf.9c631f1e-c0c9-4898-bc7b-5d282d4c358a is being set with open permissions: ugo+rw Jul 10 10:11:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-78432434-c0e7-452c-b3f9-cca62b2172e7 tempest-VolumesSnapshotTestJSON-197741556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c952a096-ac09-4a11-b56c-d9a174e21edf.9c631f1e-c0c9-4898-bc7b-5d282d4c358a {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:11:43 devstack sudo[96593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c952a096-ac09-4a11-b56c-d9a174e21edf.9c631f1e-c0c9-4898-bc7b-5d282d4c358a Jul 10 10:11:43 devstack sudo[96593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:11:44 devstack sudo[96593]: pam_unix(sudo:session): session closed for user root Jul 10 10:11:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-78432434-c0e7-452c-b3f9-cca62b2172e7 tempest-VolumesSnapshotTestJSON-197741556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c952a096-ac09-4a11-b56c-d9a174e21edf.9c631f1e-c0c9-4898-bc7b-5d282d4c358a" returned: 0 in 0.895s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:11:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-78432434-c0e7-452c-b3f9-cca62b2172e7 tempest-VolumesSnapshotTestJSON-197741556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c952a096-ac09-4a11-b56c-d9a174e21edf.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:11:44 devstack sudo[96596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c952a096-ac09-4a11-b56c-d9a174e21edf.info Jul 10 10:11:44 devstack sudo[96596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:11:45 devstack sudo[96596]: pam_unix(sudo:session): session closed for user root Jul 10 10:11:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-78432434-c0e7-452c-b3f9-cca62b2172e7 tempest-VolumesSnapshotTestJSON-197741556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c952a096-ac09-4a11-b56c-d9a174e21edf.info" returned: 0 in 0.806s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:11:45 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-78432434-c0e7-452c-b3f9-cca62b2172e7 tempest-VolumesSnapshotTestJSON-197741556 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c952a096-ac09-4a11-b56c-d9a174e21edf.info is being set with open permissions: ugo+rw Jul 10 10:11:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-78432434-c0e7-452c-b3f9-cca62b2172e7 tempest-VolumesSnapshotTestJSON-197741556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c952a096-ac09-4a11-b56c-d9a174e21edf.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:11:45 devstack sudo[96613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c952a096-ac09-4a11-b56c-d9a174e21edf.info Jul 10 10:11:45 devstack sudo[96613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:11:45 devstack sudo[96613]: pam_unix(sudo:session): session closed for user root Jul 10 10:11:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-78432434-c0e7-452c-b3f9-cca62b2172e7 tempest-VolumesSnapshotTestJSON-197741556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c952a096-ac09-4a11-b56c-d9a174e21edf.info" returned: 0 in 0.663s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:11:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-78432434-c0e7-452c-b3f9-cca62b2172e7 tempest-VolumesSnapshotTestJSON-197741556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.985s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:11:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-7e3dce1f-0b3b-40b9-8191-d24339e59ebc tempest-VolumesDeleteCascade-1259063873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.453s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:11:45 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-7e3dce1f-0b3b-40b9-8191-d24339e59ebc tempest-VolumesDeleteCascade-1259063873 None] Creating offline snapshot 8b6cd607-e852-45e4-8b1f-897350989c84 of volume 124c79dc-ac52-4c1a-99e7-e416869882cc {{(pid=87234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 10:11:45 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-78432434-c0e7-452c-b3f9-cca62b2172e7 tempest-VolumesSnapshotTestJSON-197741556 None] Create snapshot completed successfully Jul 10 10:11:45 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5346381-9211-498a-88e3-d8dce645fa4b]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:11:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-7e3dce1f-0b3b-40b9-8191-d24339e59ebc tempest-VolumesDeleteCascade-1259063873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-124c79dc-ac52-4c1a-99e7-e416869882cc {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:11:46 devstack sudo[96618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-124c79dc-ac52-4c1a-99e7-e416869882cc Jul 10 10:11:46 devstack sudo[96618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:11:46 devstack sudo[96618]: pam_unix(sudo:session): session closed for user root Jul 10 10:11:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-7e3dce1f-0b3b-40b9-8191-d24339e59ebc tempest-VolumesDeleteCascade-1259063873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-124c79dc-ac52-4c1a-99e7-e416869882cc" returned: 0 in 0.890s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:11:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-7e3dce1f-0b3b-40b9-8191-d24339e59ebc tempest-VolumesDeleteCascade-1259063873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-124c79dc-ac52-4c1a-99e7-e416869882cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-124c79dc-ac52-4c1a-99e7-e416869882cc.8b6cd607-e852-45e4-8b1f-897350989c84 1G {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:11:46 devstack sudo[96630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-124c79dc-ac52-4c1a-99e7-e416869882cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-124c79dc-ac52-4c1a-99e7-e416869882cc.8b6cd607-e852-45e4-8b1f-897350989c84 1G Jul 10 10:11:46 devstack sudo[96630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:11:47 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb99cc1d-1246-4242-8fda-df0e75c2c951 tempest-VolumesSnapshotTestJSON-197741556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:11:47 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-bb99cc1d-1246-4242-8fda-df0e75c2c951 tempest-VolumesSnapshotTestJSON-197741556 None] Flow 'volume_create_manager' (f256d087-2fe6-4c8a-8dfc-7387c4e87d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:11:47 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-bb99cc1d-1246-4242-8fda-df0e75c2c951 tempest-VolumesSnapshotTestJSON-197741556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f54b83e-2adb-4b20-94f9-8c16824652af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:11:47 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-bb99cc1d-1246-4242-8fda-df0e75c2c951 tempest-VolumesSnapshotTestJSON-197741556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f54b83e-2adb-4b20-94f9-8c16824652af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:11:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-210786118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=019b5636-b836-4491-81f0-03c0431d9add,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='890f1b9b455349768dd4e3854511a17f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:11:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=9c631f1e-c0c9-4898-bc7b-5d282d4c358a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:11:47Z,use_quota=True,user_id='9935e5f7f72e46f6b6220bb497204fc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:11:47 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-bb99cc1d-1246-4242-8fda-df0e75c2c951 tempest-VolumesSnapshotTestJSON-197741556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38be5d46-065f-43e5-8064-cc4cbb5a2d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:11:47 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-bb99cc1d-1246-4242-8fda-df0e75c2c951 tempest-VolumesSnapshotTestJSON-197741556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38be5d46-065f-43e5-8064-cc4cbb5a2d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:11:47 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-bb99cc1d-1246-4242-8fda-df0e75c2c951 tempest-VolumesSnapshotTestJSON-197741556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1dce2d1-0505-4f9b-997c-39a7b9a157ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:11:47 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-bb99cc1d-1246-4242-8fda-df0e75c2c951 tempest-VolumesSnapshotTestJSON-197741556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1dce2d1-0505-4f9b-997c-39a7b9a157ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '019b5636-b836-4491-81f0-03c0431d9add', 'volume_name': 'volume-019b5636-b836-4491-81f0-03c0431d9add', 'volume_size': 2, 'snapshot_id': '9c631f1e-c0c9-4898-bc7b-5d282d4c358a'}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:11:47 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-bb99cc1d-1246-4242-8fda-df0e75c2c951 tempest-VolumesSnapshotTestJSON-197741556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7feda150-c6d5-417c-a097-5667a0c69ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:11:47 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-bb99cc1d-1246-4242-8fda-df0e75c2c951 tempest-VolumesSnapshotTestJSON-197741556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7feda150-c6d5-417c-a097-5667a0c69ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:11:47 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-bb99cc1d-1246-4242-8fda-df0e75c2c951 tempest-VolumesSnapshotTestJSON-197741556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a20edde9-3657-4790-8a6b-8167a6f7bf10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:11:47 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-bb99cc1d-1246-4242-8fda-df0e75c2c951 tempest-VolumesSnapshotTestJSON-197741556 None] Volume 019b5636-b836-4491-81f0-03c0431d9add: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-019b5636-b836-4491-81f0-03c0431d9add', 'volume_size': 2, 'snapshot_id': '9c631f1e-c0c9-4898-bc7b-5d282d4c358a'} Jul 10 10:11:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-bb99cc1d-1246-4242-8fda-df0e75c2c951 tempest-VolumesSnapshotTestJSON-197741556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:11:47 devstack sudo[96630]: pam_unix(sudo:session): session closed for user root Jul 10 10:11:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-7e3dce1f-0b3b-40b9-8191-d24339e59ebc tempest-VolumesDeleteCascade-1259063873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-124c79dc-ac52-4c1a-99e7-e416869882cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-124c79dc-ac52-4c1a-99e7-e416869882cc.8b6cd607-e852-45e4-8b1f-897350989c84 1G" returned: 0 in 1.002s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:11:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-7e3dce1f-0b3b-40b9-8191-d24339e59ebc tempest-VolumesDeleteCascade-1259063873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-124c79dc-ac52-4c1a-99e7-e416869882cc -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-124c79dc-ac52-4c1a-99e7-e416869882cc.8b6cd607-e852-45e4-8b1f-897350989c84 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:11:47 devstack sudo[96657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-124c79dc-ac52-4c1a-99e7-e416869882cc -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-124c79dc-ac52-4c1a-99e7-e416869882cc.8b6cd607-e852-45e4-8b1f-897350989c84 Jul 10 10:11:47 devstack sudo[96657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:11:49 devstack sudo[96657]: pam_unix(sudo:session): session closed for user root Jul 10 10:11:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-7e3dce1f-0b3b-40b9-8191-d24339e59ebc tempest-VolumesDeleteCascade-1259063873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-124c79dc-ac52-4c1a-99e7-e416869882cc -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-124c79dc-ac52-4c1a-99e7-e416869882cc.8b6cd607-e852-45e4-8b1f-897350989c84" returned: 0 in 1.300s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:11:49 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-7e3dce1f-0b3b-40b9-8191-d24339e59ebc tempest-VolumesDeleteCascade-1259063873 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-124c79dc-ac52-4c1a-99e7-e416869882cc.8b6cd607-e852-45e4-8b1f-897350989c84 is being set with open permissions: ugo+rw Jul 10 10:11:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-7e3dce1f-0b3b-40b9-8191-d24339e59ebc tempest-VolumesDeleteCascade-1259063873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-124c79dc-ac52-4c1a-99e7-e416869882cc.8b6cd607-e852-45e4-8b1f-897350989c84 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:11:49 devstack sudo[96705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-124c79dc-ac52-4c1a-99e7-e416869882cc.8b6cd607-e852-45e4-8b1f-897350989c84 Jul 10 10:11:49 devstack sudo[96705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:11:50 devstack sudo[96705]: pam_unix(sudo:session): session closed for user root Jul 10 10:11:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-7e3dce1f-0b3b-40b9-8191-d24339e59ebc tempest-VolumesDeleteCascade-1259063873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-124c79dc-ac52-4c1a-99e7-e416869882cc.8b6cd607-e852-45e4-8b1f-897350989c84" returned: 0 in 0.936s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:11:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-7e3dce1f-0b3b-40b9-8191-d24339e59ebc tempest-VolumesDeleteCascade-1259063873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-124c79dc-ac52-4c1a-99e7-e416869882cc.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:11:50 devstack sudo[96735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-124c79dc-ac52-4c1a-99e7-e416869882cc.info Jul 10 10:11:50 devstack sudo[96735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:11:50 devstack sudo[96735]: pam_unix(sudo:session): session closed for user root Jul 10 10:11:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-7e3dce1f-0b3b-40b9-8191-d24339e59ebc tempest-VolumesDeleteCascade-1259063873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-124c79dc-ac52-4c1a-99e7-e416869882cc.info" returned: 0 in 0.826s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:11:50 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-7e3dce1f-0b3b-40b9-8191-d24339e59ebc tempest-VolumesDeleteCascade-1259063873 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-124c79dc-ac52-4c1a-99e7-e416869882cc.info is being set with open permissions: ugo+rw Jul 10 10:11:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-7e3dce1f-0b3b-40b9-8191-d24339e59ebc tempest-VolumesDeleteCascade-1259063873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-124c79dc-ac52-4c1a-99e7-e416869882cc.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:11:51 devstack sudo[96738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-124c79dc-ac52-4c1a-99e7-e416869882cc.info Jul 10 10:11:51 devstack sudo[96738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:11:51 devstack sudo[96738]: pam_unix(sudo:session): session closed for user root Jul 10 10:11:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-7e3dce1f-0b3b-40b9-8191-d24339e59ebc tempest-VolumesDeleteCascade-1259063873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-124c79dc-ac52-4c1a-99e7-e416869882cc.info" returned: 0 in 0.709s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:11:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-7e3dce1f-0b3b-40b9-8191-d24339e59ebc tempest-VolumesDeleteCascade-1259063873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.796s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:11:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-bb99cc1d-1246-4242-8fda-df0e75c2c951 tempest-VolumesSnapshotTestJSON-197741556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.558s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:11:51 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-bb99cc1d-1246-4242-8fda-df0e75c2c951 tempest-VolumesSnapshotTestJSON-197741556 None] Acquiring lock "cinder-quobyte-9c631f1e-c0c9-4898-bc7b-5d282d4c358a-019b5636-b836-4491-81f0-03c0431d9add" by "_create_volume_from_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:11:51 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-bb99cc1d-1246-4242-8fda-df0e75c2c951 tempest-VolumesSnapshotTestJSON-197741556 None] Lock "cinder-quobyte-9c631f1e-c0c9-4898-bc7b-5d282d4c358a-019b5636-b836-4491-81f0-03c0431d9add" acquired by "_create_volume_from_snapshot" :: waited 0.044s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:11:51 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-bb99cc1d-1246-4242-8fda-df0e75c2c951 tempest-VolumesSnapshotTestJSON-197741556 None] Creating volume 019b5636-b836-4491-81f0-03c0431d9add from snapshot 9c631f1e-c0c9-4898-bc7b-5d282d4c358a {{(pid=87234) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 10:11:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-bb99cc1d-1246-4242-8fda-df0e75c2c951 tempest-VolumesSnapshotTestJSON-197741556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:11:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-bb99cc1d-1246-4242-8fda-df0e75c2c951 tempest-VolumesSnapshotTestJSON-197741556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:11:51 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-bb99cc1d-1246-4242-8fda-df0e75c2c951 tempest-VolumesSnapshotTestJSON-197741556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:11:51 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-bb99cc1d-1246-4242-8fda-df0e75c2c951 tempest-VolumesSnapshotTestJSON-197741556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:11:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-bb99cc1d-1246-4242-8fda-df0e75c2c951 tempest-VolumesSnapshotTestJSON-197741556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:11:51 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-bb99cc1d-1246-4242-8fda-df0e75c2c951 tempest-VolumesSnapshotTestJSON-197741556 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:11:51 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-bb99cc1d-1246-4242-8fda-df0e75c2c951 tempest-VolumesSnapshotTestJSON-197741556 None] Acquiring lock "cinder-quobyte-019b5636-b836-4491-81f0-03c0431d9add" by "_copy_volume_from_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:11:51 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-7e3dce1f-0b3b-40b9-8191-d24339e59ebc tempest-VolumesDeleteCascade-1259063873 None] Create snapshot completed successfully Jul 10 10:11:51 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-bb99cc1d-1246-4242-8fda-df0e75c2c951 tempest-VolumesSnapshotTestJSON-197741556 None] Lock "cinder-quobyte-019b5636-b836-4491-81f0-03c0431d9add" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:11:51 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-bb99cc1d-1246-4242-8fda-df0e75c2c951 tempest-VolumesSnapshotTestJSON-197741556 None] snapshot: 9c631f1e-c0c9-4898-bc7b-5d282d4c358a, volume: 019b5636-b836-4491-81f0-03c0431d9add, {{(pid=87234) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 10:11:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-bb99cc1d-1246-4242-8fda-df0e75c2c951 tempest-VolumesSnapshotTestJSON-197741556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:11:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-bb99cc1d-1246-4242-8fda-df0e75c2c951 tempest-VolumesSnapshotTestJSON-197741556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:11:51 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-bb99cc1d-1246-4242-8fda-df0e75c2c951 tempest-VolumesSnapshotTestJSON-197741556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:11:51 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-bb99cc1d-1246-4242-8fda-df0e75c2c951 tempest-VolumesSnapshotTestJSON-197741556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:11:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-bb99cc1d-1246-4242-8fda-df0e75c2c951 tempest-VolumesSnapshotTestJSON-197741556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:11:51 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba0c033-cd70-44ad-8ce5-67f6b99da59e]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:11:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-bb99cc1d-1246-4242-8fda-df0e75c2c951 tempest-VolumesSnapshotTestJSON-197741556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c952a096-ac09-4a11-b56c-d9a174e21edf.9c631f1e-c0c9-4898-bc7b-5d282d4c358a {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:11:52 devstack sudo[96743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c952a096-ac09-4a11-b56c-d9a174e21edf.9c631f1e-c0c9-4898-bc7b-5d282d4c358a Jul 10 10:11:52 devstack sudo[96743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:11:53 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-70cb001f-2105-4376-bfe7-5a1570315280 tempest-VolumesDeleteCascade-1259063873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:11:53 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-70cb001f-2105-4376-bfe7-5a1570315280 tempest-VolumesDeleteCascade-1259063873 None] Flow 'volume_create_manager' (97f9430c-f7bd-4ab2-a281-2a82645d5107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:11:53 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-70cb001f-2105-4376-bfe7-5a1570315280 tempest-VolumesDeleteCascade-1259063873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (323cb5f0-aa05-439a-9b3e-8e5c42fe251e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:11:53 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-70cb001f-2105-4376-bfe7-5a1570315280 tempest-VolumesDeleteCascade-1259063873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (323cb5f0-aa05-439a-9b3e-8e5c42fe251e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:11:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-255753335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7612ef5-af19-4a85-a571-7a680008e136,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='271189cec40041d38ae51354c096f46a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:11:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8b6cd607-e852-45e4-8b1f-897350989c84,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:11:53Z,use_quota=True,user_id='2623c56cb8fb46b1b82a7d248e8360f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:11:53 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-70cb001f-2105-4376-bfe7-5a1570315280 tempest-VolumesDeleteCascade-1259063873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f1c2378-9b1d-49ff-a335-87ac3c36a723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:11:53 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-70cb001f-2105-4376-bfe7-5a1570315280 tempest-VolumesDeleteCascade-1259063873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f1c2378-9b1d-49ff-a335-87ac3c36a723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:11:53 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-70cb001f-2105-4376-bfe7-5a1570315280 tempest-VolumesDeleteCascade-1259063873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (466a59a4-0032-4c9e-a05b-d3de3100fbc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:11:53 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-70cb001f-2105-4376-bfe7-5a1570315280 tempest-VolumesDeleteCascade-1259063873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (466a59a4-0032-4c9e-a05b-d3de3100fbc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c7612ef5-af19-4a85-a571-7a680008e136', 'volume_name': 'volume-c7612ef5-af19-4a85-a571-7a680008e136', 'volume_size': 1, 'snapshot_id': '8b6cd607-e852-45e4-8b1f-897350989c84'}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:11:53 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-70cb001f-2105-4376-bfe7-5a1570315280 tempest-VolumesDeleteCascade-1259063873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61e21e49-faf0-47f6-bea5-850914242f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:11:53 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-70cb001f-2105-4376-bfe7-5a1570315280 tempest-VolumesDeleteCascade-1259063873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61e21e49-faf0-47f6-bea5-850914242f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:11:53 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-70cb001f-2105-4376-bfe7-5a1570315280 tempest-VolumesDeleteCascade-1259063873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2981b556-e010-4f8b-8ab8-2fd852938c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:11:53 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-70cb001f-2105-4376-bfe7-5a1570315280 tempest-VolumesDeleteCascade-1259063873 None] Volume c7612ef5-af19-4a85-a571-7a680008e136: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c7612ef5-af19-4a85-a571-7a680008e136', 'volume_size': 1, 'snapshot_id': '8b6cd607-e852-45e4-8b1f-897350989c84'} Jul 10 10:11:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-70cb001f-2105-4376-bfe7-5a1570315280 tempest-VolumesDeleteCascade-1259063873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:11:53 devstack sudo[96743]: pam_unix(sudo:session): session closed for user root Jul 10 10:11:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-bb99cc1d-1246-4242-8fda-df0e75c2c951 tempest-VolumesSnapshotTestJSON-197741556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c952a096-ac09-4a11-b56c-d9a174e21edf.9c631f1e-c0c9-4898-bc7b-5d282d4c358a" returned: 0 in 1.348s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:11:53 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-bb99cc1d-1246-4242-8fda-df0e75c2c951 tempest-VolumesSnapshotTestJSON-197741556 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c952a096-ac09-4a11-b56c-d9a174e21edf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 10:11:53 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-bb99cc1d-1246-4242-8fda-df0e75c2c951 tempest-VolumesSnapshotTestJSON-197741556 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c952a096-ac09-4a11-b56c-d9a174e21edf {{(pid=87234) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 10:11:53 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-bb99cc1d-1246-4242-8fda-df0e75c2c951 tempest-VolumesSnapshotTestJSON-197741556 None] Creating direct copy from snapshot {{(pid=87234) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 10:11:53 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3752edd-8a0a-4aad-9f5f-47a23b45a242]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:11:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-bb99cc1d-1246-4242-8fda-df0e75c2c951 tempest-VolumesSnapshotTestJSON-197741556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c952a096-ac09-4a11-b56c-d9a174e21edf {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:11:53 devstack sudo[96748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c952a096-ac09-4a11-b56c-d9a174e21edf Jul 10 10:11:53 devstack sudo[96748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:11:54 devstack sudo[96748]: pam_unix(sudo:session): session closed for user root Jul 10 10:11:54 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-bb99cc1d-1246-4242-8fda-df0e75c2c951 tempest-VolumesSnapshotTestJSON-197741556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c952a096-ac09-4a11-b56c-d9a174e21edf" returned: 0 in 1.179s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:11:54 devstack cinder-volume[87234]: DEBUG cinder.utils [None req-bb99cc1d-1246-4242-8fda-df0e75c2c951 tempest-VolumesSnapshotTestJSON-197741556 None] Path /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-019b5636-b836-4491-81f0-03c0431d9add not found in is_blk_device check {{(pid=87234) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 10:11:54 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-bb99cc1d-1246-4242-8fda-df0e75c2c951 tempest-VolumesSnapshotTestJSON-197741556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c952a096-ac09-4a11-b56c-d9a174e21edf /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-019b5636-b836-4491-81f0-03c0431d9add {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:11:54 devstack sudo[96754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c952a096-ac09-4a11-b56c-d9a174e21edf /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-019b5636-b836-4491-81f0-03c0431d9add Jul 10 10:11:54 devstack sudo[96754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:12:02 devstack sudo[96754]: pam_unix(sudo:session): session closed for user root Jul 10 10:12:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-bb99cc1d-1246-4242-8fda-df0e75c2c951 tempest-VolumesSnapshotTestJSON-197741556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c952a096-ac09-4a11-b56c-d9a174e21edf /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-019b5636-b836-4491-81f0-03c0431d9add" returned: 0 in 7.841s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:12:02 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2daed5-ec10-4473-a8fa-0114bde3f064]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:12:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-bb99cc1d-1246-4242-8fda-df0e75c2c951 tempest-VolumesSnapshotTestJSON-197741556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c952a096-ac09-4a11-b56c-d9a174e21edf {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:12:02 devstack sudo[96790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c952a096-ac09-4a11-b56c-d9a174e21edf Jul 10 10:12:02 devstack sudo[96790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:12:03 devstack cinder-volume[87234]: DEBUG dbcounter [-] [87234] Writing DB stats cinder:SELECT=88,cinder:UPDATE=83,cinder:INSERT=24,cinder:DELETE=8 {{(pid=87234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 10:12:03 devstack cinder-volume[87234]: DEBUG dbcounter [-] [87234] Writing DB stats cinder:UPDATE=81,cinder:SELECT=78,cinder:INSERT=17,cinder:DELETE=7 {{(pid=87234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 10:12:03 devstack sudo[96790]: pam_unix(sudo:session): session closed for user root Jul 10 10:12:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-bb99cc1d-1246-4242-8fda-df0e75c2c951 tempest-VolumesSnapshotTestJSON-197741556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c952a096-ac09-4a11-b56c-d9a174e21edf" returned: 0 in 0.968s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:12:03 devstack cinder-volume[87234]: DEBUG cinder.image.image_utils [None req-bb99cc1d-1246-4242-8fda-df0e75c2c951 tempest-VolumesSnapshotTestJSON-197741556 None] Image conversion details: src /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c952a096-ac09-4a11-b56c-d9a174e21edf, size 1024.00 MB, duration 7.84 sec, destination /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-019b5636-b836-4491-81f0-03c0431d9add {{(pid=87234) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 10:12:03 devstack cinder-volume[87234]: INFO cinder.image.image_utils [None req-bb99cc1d-1246-4242-8fda-df0e75c2c951 tempest-VolumesSnapshotTestJSON-197741556 None] Converted 1024.00 MB image at 130.56 MB/s Jul 10 10:12:03 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-bb99cc1d-1246-4242-8fda-df0e75c2c951 tempest-VolumesSnapshotTestJSON-197741556 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-019b5636-b836-4491-81f0-03c0431d9add is being set with open permissions: ugo+rw Jul 10 10:12:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-bb99cc1d-1246-4242-8fda-df0e75c2c951 tempest-VolumesSnapshotTestJSON-197741556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-019b5636-b836-4491-81f0-03c0431d9add {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:12:03 devstack sudo[96795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-019b5636-b836-4491-81f0-03c0431d9add Jul 10 10:12:03 devstack sudo[96795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:12:03 devstack sudo[96795]: pam_unix(sudo:session): session closed for user root Jul 10 10:12:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-bb99cc1d-1246-4242-8fda-df0e75c2c951 tempest-VolumesSnapshotTestJSON-197741556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-019b5636-b836-4491-81f0-03c0431d9add" returned: 0 in 0.658s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:12:03 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-bb99cc1d-1246-4242-8fda-df0e75c2c951 tempest-VolumesSnapshotTestJSON-197741556 None] Lock "cinder-quobyte-019b5636-b836-4491-81f0-03c0431d9add" released by "_copy_volume_from_snapshot" :: held 12.130s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:12:03 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-bb99cc1d-1246-4242-8fda-df0e75c2c951 tempest-VolumesSnapshotTestJSON-197741556 None] Lock "cinder-quobyte-9c631f1e-c0c9-4898-bc7b-5d282d4c358a-019b5636-b836-4491-81f0-03c0431d9add" released by "_create_volume_from_snapshot" :: held 12.193s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:12:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-bb99cc1d-1246-4242-8fda-df0e75c2c951 tempest-VolumesSnapshotTestJSON-197741556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.239s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:12:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-70cb001f-2105-4376-bfe7-5a1570315280 tempest-VolumesDeleteCascade-1259063873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 10.817s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:12:03 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-70cb001f-2105-4376-bfe7-5a1570315280 tempest-VolumesDeleteCascade-1259063873 None] Acquiring lock "cinder-quobyte-8b6cd607-e852-45e4-8b1f-897350989c84-c7612ef5-af19-4a85-a571-7a680008e136" by "_create_volume_from_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:12:03 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-70cb001f-2105-4376-bfe7-5a1570315280 tempest-VolumesDeleteCascade-1259063873 None] Lock "cinder-quobyte-8b6cd607-e852-45e4-8b1f-897350989c84-c7612ef5-af19-4a85-a571-7a680008e136" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:12:03 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-70cb001f-2105-4376-bfe7-5a1570315280 tempest-VolumesDeleteCascade-1259063873 None] Creating volume c7612ef5-af19-4a85-a571-7a680008e136 from snapshot 8b6cd607-e852-45e4-8b1f-897350989c84 {{(pid=87234) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 10:12:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-70cb001f-2105-4376-bfe7-5a1570315280 tempest-VolumesDeleteCascade-1259063873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:12:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-70cb001f-2105-4376-bfe7-5a1570315280 tempest-VolumesDeleteCascade-1259063873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:12:03 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-70cb001f-2105-4376-bfe7-5a1570315280 tempest-VolumesDeleteCascade-1259063873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:12:04 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-70cb001f-2105-4376-bfe7-5a1570315280 tempest-VolumesDeleteCascade-1259063873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:12:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-70cb001f-2105-4376-bfe7-5a1570315280 tempest-VolumesDeleteCascade-1259063873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:12:04 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-70cb001f-2105-4376-bfe7-5a1570315280 tempest-VolumesDeleteCascade-1259063873 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:12:04 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-70cb001f-2105-4376-bfe7-5a1570315280 tempest-VolumesDeleteCascade-1259063873 None] Acquiring lock "cinder-quobyte-c7612ef5-af19-4a85-a571-7a680008e136" by "_copy_volume_from_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:12:04 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-bb99cc1d-1246-4242-8fda-df0e75c2c951 tempest-VolumesSnapshotTestJSON-197741556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a20edde9-3657-4790-8a6b-8167a6f7bf10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-019b5636-b836-4491-81f0-03c0431d9add', 'volume_size': 2, 'snapshot_id': '9c631f1e-c0c9-4898-bc7b-5d282d4c358a'}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:12:04 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-bb99cc1d-1246-4242-8fda-df0e75c2c951 tempest-VolumesSnapshotTestJSON-197741556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e430ff7-9d3d-424a-a82f-cca5f72a1f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:12:04 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-70cb001f-2105-4376-bfe7-5a1570315280 tempest-VolumesDeleteCascade-1259063873 None] Lock "cinder-quobyte-c7612ef5-af19-4a85-a571-7a680008e136" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:12:04 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-70cb001f-2105-4376-bfe7-5a1570315280 tempest-VolumesDeleteCascade-1259063873 None] snapshot: 8b6cd607-e852-45e4-8b1f-897350989c84, volume: c7612ef5-af19-4a85-a571-7a680008e136, {{(pid=87234) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 10:12:04 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-bb99cc1d-1246-4242-8fda-df0e75c2c951 tempest-VolumesSnapshotTestJSON-197741556 None] Volume volume-019b5636-b836-4491-81f0-03c0431d9add (019b5636-b836-4491-81f0-03c0431d9add): created successfully Jul 10 10:12:04 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-bb99cc1d-1246-4242-8fda-df0e75c2c951 tempest-VolumesSnapshotTestJSON-197741556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e430ff7-9d3d-424a-a82f-cca5f72a1f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:12:04 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-bb99cc1d-1246-4242-8fda-df0e75c2c951 tempest-VolumesSnapshotTestJSON-197741556 None] Flow 'volume_create_manager' (f256d087-2fe6-4c8a-8dfc-7387c4e87d46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:12:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-70cb001f-2105-4376-bfe7-5a1570315280 tempest-VolumesDeleteCascade-1259063873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:12:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-70cb001f-2105-4376-bfe7-5a1570315280 tempest-VolumesDeleteCascade-1259063873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:12:04 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-70cb001f-2105-4376-bfe7-5a1570315280 tempest-VolumesDeleteCascade-1259063873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:12:04 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-70cb001f-2105-4376-bfe7-5a1570315280 tempest-VolumesDeleteCascade-1259063873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:12:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-70cb001f-2105-4376-bfe7-5a1570315280 tempest-VolumesDeleteCascade-1259063873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:12:04 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-bb99cc1d-1246-4242-8fda-df0e75c2c951 tempest-VolumesSnapshotTestJSON-197741556 None] Created volume successfully. Jul 10 10:12:04 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbef6ec9-29e2-4655-95cb-719458cc3a72]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:12:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-70cb001f-2105-4376-bfe7-5a1570315280 tempest-VolumesDeleteCascade-1259063873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-124c79dc-ac52-4c1a-99e7-e416869882cc.8b6cd607-e852-45e4-8b1f-897350989c84 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:12:04 devstack sudo[96798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-124c79dc-ac52-4c1a-99e7-e416869882cc.8b6cd607-e852-45e4-8b1f-897350989c84 Jul 10 10:12:04 devstack sudo[96798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:12:04 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-de382729-fc37-40a5-8742-3583d84d0815 tempest-VolumesSnapshotTestJSON-197741556 None] Acquiring lock "cinder-019b5636-b836-4491-81f0-03c0431d9add-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:12:04 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-de382729-fc37-40a5-8742-3583d84d0815 tempest-VolumesSnapshotTestJSON-197741556 None] Lock "cinder-019b5636-b836-4491-81f0-03c0431d9add-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:12:04 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-de382729-fc37-40a5-8742-3583d84d0815 tempest-VolumesSnapshotTestJSON-197741556 None] Acquiring lock "cinder-quobyte-019b5636-b836-4491-81f0-03c0431d9add" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:12:04 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-de382729-fc37-40a5-8742-3583d84d0815 tempest-VolumesSnapshotTestJSON-197741556 None] Lock "cinder-quobyte-019b5636-b836-4491-81f0-03c0431d9add" acquired by "delete_volume" :: waited 0.025s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:12:04 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[064f08f5-a833-456d-bc9b-3325bc82a576]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:12:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-de382729-fc37-40a5-8742-3583d84d0815 tempest-VolumesSnapshotTestJSON-197741556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-019b5636-b836-4491-81f0-03c0431d9add {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:12:04 devstack sudo[96800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-019b5636-b836-4491-81f0-03c0431d9add Jul 10 10:12:04 devstack sudo[96800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:12:05 devstack sudo[96798]: pam_unix(sudo:session): session closed for user root Jul 10 10:12:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-70cb001f-2105-4376-bfe7-5a1570315280 tempest-VolumesDeleteCascade-1259063873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-124c79dc-ac52-4c1a-99e7-e416869882cc.8b6cd607-e852-45e4-8b1f-897350989c84" returned: 0 in 0.868s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:12:05 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-70cb001f-2105-4376-bfe7-5a1570315280 tempest-VolumesDeleteCascade-1259063873 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-124c79dc-ac52-4c1a-99e7-e416869882cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 10:12:05 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-70cb001f-2105-4376-bfe7-5a1570315280 tempest-VolumesDeleteCascade-1259063873 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-124c79dc-ac52-4c1a-99e7-e416869882cc {{(pid=87234) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 10:12:05 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-70cb001f-2105-4376-bfe7-5a1570315280 tempest-VolumesDeleteCascade-1259063873 None] Creating direct copy from snapshot {{(pid=87234) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 10:12:05 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ae32db-f949-49d6-9e14-9d1e18499a33]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:12:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-70cb001f-2105-4376-bfe7-5a1570315280 tempest-VolumesDeleteCascade-1259063873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-124c79dc-ac52-4c1a-99e7-e416869882cc {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:12:05 devstack sudo[96805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-124c79dc-ac52-4c1a-99e7-e416869882cc Jul 10 10:12:05 devstack sudo[96805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:12:05 devstack sudo[96800]: pam_unix(sudo:session): session closed for user root Jul 10 10:12:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-de382729-fc37-40a5-8742-3583d84d0815 tempest-VolumesSnapshotTestJSON-197741556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-019b5636-b836-4491-81f0-03c0431d9add" returned: 0 in 0.794s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:12:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-de382729-fc37-40a5-8742-3583d84d0815 tempest-VolumesSnapshotTestJSON-197741556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-019b5636-b836-4491-81f0-03c0431d9add {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:12:05 devstack sudo[96810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-019b5636-b836-4491-81f0-03c0431d9add Jul 10 10:12:05 devstack sudo[96810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:12:05 devstack sudo[96805]: pam_unix(sudo:session): session closed for user root Jul 10 10:12:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-70cb001f-2105-4376-bfe7-5a1570315280 tempest-VolumesDeleteCascade-1259063873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-124c79dc-ac52-4c1a-99e7-e416869882cc" returned: 0 in 0.867s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:12:05 devstack cinder-volume[87234]: DEBUG cinder.utils [None req-70cb001f-2105-4376-bfe7-5a1570315280 tempest-VolumesDeleteCascade-1259063873 None] Path /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c7612ef5-af19-4a85-a571-7a680008e136 not found in is_blk_device check {{(pid=87234) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 10:12:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-70cb001f-2105-4376-bfe7-5a1570315280 tempest-VolumesDeleteCascade-1259063873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-124c79dc-ac52-4c1a-99e7-e416869882cc /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c7612ef5-af19-4a85-a571-7a680008e136 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:12:05 devstack sudo[96815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-124c79dc-ac52-4c1a-99e7-e416869882cc /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c7612ef5-af19-4a85-a571-7a680008e136 Jul 10 10:12:05 devstack sudo[96815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:12:06 devstack sudo[96810]: pam_unix(sudo:session): session closed for user root Jul 10 10:12:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-de382729-fc37-40a5-8742-3583d84d0815 tempest-VolumesSnapshotTestJSON-197741556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-019b5636-b836-4491-81f0-03c0431d9add" returned: 0 in 0.763s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:12:06 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-de382729-fc37-40a5-8742-3583d84d0815 tempest-VolumesSnapshotTestJSON-197741556 None] Lock "cinder-quobyte-019b5636-b836-4491-81f0-03c0431d9add" released by "delete_volume" :: held 1.614s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:12:06 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-de382729-fc37-40a5-8742-3583d84d0815 tempest-VolumesSnapshotTestJSON-197741556 None] Created reservations ['5d6c5f46-36e0-4118-bd33-caa655c3f0b5', 'c9223efb-c09a-46a3-899a-6ad4aab2e5e0', 'e1726c00-ff26-4513-8211-466a0d839727', '854bf74d-16f1-4b57-9a4e-1598d3871cce'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:12:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-de382729-fc37-40a5-8742-3583d84d0815 tempest-VolumesSnapshotTestJSON-197741556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:12:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-de382729-fc37-40a5-8742-3583d84d0815 tempest-VolumesSnapshotTestJSON-197741556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:12:06 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-de382729-fc37-40a5-8742-3583d84d0815 tempest-VolumesSnapshotTestJSON-197741556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:12:06 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-de382729-fc37-40a5-8742-3583d84d0815 tempest-VolumesSnapshotTestJSON-197741556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:12:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-de382729-fc37-40a5-8742-3583d84d0815 tempest-VolumesSnapshotTestJSON-197741556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:12:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-de382729-fc37-40a5-8742-3583d84d0815 tempest-VolumesSnapshotTestJSON-197741556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:12:06 devstack sudo[96819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:12:06 devstack sudo[96819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:12:06 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-09efc9e5-1397-48bc-984f-d06306be57b6 tempest-VolumesSnapshotTestJSON-197741556 None] Acquiring lock "cinder-9c631f1e-c0c9-4898-bc7b-5d282d4c358a-delete_snapshot" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:12:07 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-09efc9e5-1397-48bc-984f-d06306be57b6 tempest-VolumesSnapshotTestJSON-197741556 None] Lock "cinder-9c631f1e-c0c9-4898-bc7b-5d282d4c358a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.057s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:12:07 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-09efc9e5-1397-48bc-984f-d06306be57b6 tempest-VolumesSnapshotTestJSON-197741556 None] Acquiring lock "cinder-quobyte-c952a096-ac09-4a11-b56c-d9a174e21edf" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:12:07 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-09efc9e5-1397-48bc-984f-d06306be57b6 tempest-VolumesSnapshotTestJSON-197741556 None] Lock "cinder-quobyte-c952a096-ac09-4a11-b56c-d9a174e21edf" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:12:07 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-09efc9e5-1397-48bc-984f-d06306be57b6 tempest-VolumesSnapshotTestJSON-197741556 None] Acquiring lock "cinder-quobyte-9c631f1e-c0c9-4898-bc7b-5d282d4c358a" by "_delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:12:07 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-09efc9e5-1397-48bc-984f-d06306be57b6 tempest-VolumesSnapshotTestJSON-197741556 None] Lock "cinder-quobyte-9c631f1e-c0c9-4898-bc7b-5d282d4c358a" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:12:07 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-09efc9e5-1397-48bc-984f-d06306be57b6 tempest-VolumesSnapshotTestJSON-197741556 None] Deleting offline snapshot 9c631f1e-c0c9-4898-bc7b-5d282d4c358a of volume c952a096-ac09-4a11-b56c-d9a174e21edf {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 10:12:07 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-09efc9e5-1397-48bc-984f-d06306be57b6 tempest-VolumesSnapshotTestJSON-197741556 None] snapshot_file for this snap is: volume-c952a096-ac09-4a11-b56c-d9a174e21edf.9c631f1e-c0c9-4898-bc7b-5d282d4c358a {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 10:12:07 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa1c8d7-f438-453c-afc0-9ef0fdf4eb5d]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:12:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-09efc9e5-1397-48bc-984f-d06306be57b6 tempest-VolumesSnapshotTestJSON-197741556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c952a096-ac09-4a11-b56c-d9a174e21edf.9c631f1e-c0c9-4898-bc7b-5d282d4c358a {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:12:07 devstack sudo[96819]: pam_unix(sudo:session): session closed for user root Jul 10 10:12:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-de382729-fc37-40a5-8742-3583d84d0815 tempest-VolumesSnapshotTestJSON-197741556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.997s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:12:07 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-de382729-fc37-40a5-8742-3583d84d0815 tempest-VolumesSnapshotTestJSON-197741556 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:12:07 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-de382729-fc37-40a5-8742-3583d84d0815 tempest-VolumesSnapshotTestJSON-197741556 None] Deleted volume successfully. Jul 10 10:12:07 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-de382729-fc37-40a5-8742-3583d84d0815 tempest-VolumesSnapshotTestJSON-197741556 None] Lock "cinder-019b5636-b836-4491-81f0-03c0431d9add-delete_volume" released by "delete_volume" :: held 2.902s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:12:07 devstack sudo[96849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c952a096-ac09-4a11-b56c-d9a174e21edf.9c631f1e-c0c9-4898-bc7b-5d282d4c358a Jul 10 10:12:07 devstack sudo[96849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:12:08 devstack sudo[96849]: pam_unix(sudo:session): session closed for user root Jul 10 10:12:08 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-09efc9e5-1397-48bc-984f-d06306be57b6 tempest-VolumesSnapshotTestJSON-197741556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c952a096-ac09-4a11-b56c-d9a174e21edf.9c631f1e-c0c9-4898-bc7b-5d282d4c358a" returned: 0 in 1.615s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:12:08 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-09efc9e5-1397-48bc-984f-d06306be57b6 tempest-VolumesSnapshotTestJSON-197741556 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c952a096-ac09-4a11-b56c-d9a174e21edf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 10:12:08 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d0f71a-ff42-4eef-82d5-9b706e11eb4b]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:12:08 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-09efc9e5-1397-48bc-984f-d06306be57b6 tempest-VolumesSnapshotTestJSON-197741556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c952a096-ac09-4a11-b56c-d9a174e21edf {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:12:09 devstack sudo[96855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c952a096-ac09-4a11-b56c-d9a174e21edf Jul 10 10:12:09 devstack sudo[96855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:12:10 devstack sudo[96855]: pam_unix(sudo:session): session closed for user root Jul 10 10:12:10 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-09efc9e5-1397-48bc-984f-d06306be57b6 tempest-VolumesSnapshotTestJSON-197741556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c952a096-ac09-4a11-b56c-d9a174e21edf" returned: 0 in 1.530s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:12:10 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-09efc9e5-1397-48bc-984f-d06306be57b6 tempest-VolumesSnapshotTestJSON-197741556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c952a096-ac09-4a11-b56c-d9a174e21edf.9c631f1e-c0c9-4898-bc7b-5d282d4c358a {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:12:10 devstack sudo[96861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c952a096-ac09-4a11-b56c-d9a174e21edf.9c631f1e-c0c9-4898-bc7b-5d282d4c358a Jul 10 10:12:10 devstack sudo[96861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:12:11 devstack sudo[96815]: pam_unix(sudo:session): session closed for user root Jul 10 10:12:11 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-70cb001f-2105-4376-bfe7-5a1570315280 tempest-VolumesDeleteCascade-1259063873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-124c79dc-ac52-4c1a-99e7-e416869882cc /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c7612ef5-af19-4a85-a571-7a680008e136" returned: 0 in 5.744s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:12:11 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f08c70-6f18-4634-b61a-2b53de3c0167]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:12:11 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-70cb001f-2105-4376-bfe7-5a1570315280 tempest-VolumesDeleteCascade-1259063873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-124c79dc-ac52-4c1a-99e7-e416869882cc {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:12:11 devstack sudo[96867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-124c79dc-ac52-4c1a-99e7-e416869882cc Jul 10 10:12:11 devstack sudo[96867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:12:11 devstack sudo[96861]: pam_unix(sudo:session): session closed for user root Jul 10 10:12:11 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-09efc9e5-1397-48bc-984f-d06306be57b6 tempest-VolumesSnapshotTestJSON-197741556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c952a096-ac09-4a11-b56c-d9a174e21edf.9c631f1e-c0c9-4898-bc7b-5d282d4c358a" returned: 0 in 1.487s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:12:11 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-09efc9e5-1397-48bc-984f-d06306be57b6 tempest-VolumesSnapshotTestJSON-197741556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c952a096-ac09-4a11-b56c-d9a174e21edf.9c631f1e-c0c9-4898-bc7b-5d282d4c358a {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:12:11 devstack sudo[96873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c952a096-ac09-4a11-b56c-d9a174e21edf.9c631f1e-c0c9-4898-bc7b-5d282d4c358a Jul 10 10:12:11 devstack sudo[96873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:12:12 devstack sudo[96873]: pam_unix(sudo:session): session closed for user root Jul 10 10:12:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-09efc9e5-1397-48bc-984f-d06306be57b6 tempest-VolumesSnapshotTestJSON-197741556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c952a096-ac09-4a11-b56c-d9a174e21edf.9c631f1e-c0c9-4898-bc7b-5d282d4c358a" returned: 0 in 0.864s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:12:12 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-09efc9e5-1397-48bc-984f-d06306be57b6 tempest-VolumesSnapshotTestJSON-197741556 None] Lock "cinder-quobyte-9c631f1e-c0c9-4898-bc7b-5d282d4c358a" released by "_delete_snapshot" :: held 5.726s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:12:12 devstack sudo[96867]: pam_unix(sudo:session): session closed for user root Jul 10 10:12:12 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-09efc9e5-1397-48bc-984f-d06306be57b6 tempest-VolumesSnapshotTestJSON-197741556 None] Lock "cinder-quobyte-c952a096-ac09-4a11-b56c-d9a174e21edf" released by "delete_snapshot" :: held 5.770s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:12:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-70cb001f-2105-4376-bfe7-5a1570315280 tempest-VolumesDeleteCascade-1259063873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-124c79dc-ac52-4c1a-99e7-e416869882cc" returned: 0 in 1.216s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:12:12 devstack cinder-volume[87234]: DEBUG cinder.image.image_utils [None req-70cb001f-2105-4376-bfe7-5a1570315280 tempest-VolumesDeleteCascade-1259063873 None] Image conversion details: src /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-124c79dc-ac52-4c1a-99e7-e416869882cc, size 1024.00 MB, duration 5.75 sec, destination /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c7612ef5-af19-4a85-a571-7a680008e136 {{(pid=87234) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 10:12:12 devstack cinder-volume[87234]: INFO cinder.image.image_utils [None req-70cb001f-2105-4376-bfe7-5a1570315280 tempest-VolumesDeleteCascade-1259063873 None] Converted 1024.00 MB image at 178.20 MB/s Jul 10 10:12:12 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-70cb001f-2105-4376-bfe7-5a1570315280 tempest-VolumesDeleteCascade-1259063873 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c7612ef5-af19-4a85-a571-7a680008e136 is being set with open permissions: ugo+rw Jul 10 10:12:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-70cb001f-2105-4376-bfe7-5a1570315280 tempest-VolumesDeleteCascade-1259063873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c7612ef5-af19-4a85-a571-7a680008e136 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:12:12 devstack sudo[96916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c7612ef5-af19-4a85-a571-7a680008e136 Jul 10 10:12:12 devstack sudo[96916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:12:12 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-09efc9e5-1397-48bc-984f-d06306be57b6 tempest-VolumesSnapshotTestJSON-197741556 None] Created reservations ['520842ca-a506-44f0-b589-879c0e68129e', '069575b8-f890-40b5-bc2b-630ddc3b4874', 'd49bafee-d154-4b78-8ebb-c3bbf26ab682', '63d3578f-377c-4fac-8904-661eeee0c82b'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:12:13 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-09efc9e5-1397-48bc-984f-d06306be57b6 tempest-VolumesSnapshotTestJSON-197741556 None] Delete snapshot completed successfully. Jul 10 10:12:13 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-09efc9e5-1397-48bc-984f-d06306be57b6 tempest-VolumesSnapshotTestJSON-197741556 None] Lock "cinder-9c631f1e-c0c9-4898-bc7b-5d282d4c358a-delete_snapshot" released by "delete_snapshot" :: held 6.054s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:12:13 devstack sudo[96916]: pam_unix(sudo:session): session closed for user root Jul 10 10:12:13 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-70cb001f-2105-4376-bfe7-5a1570315280 tempest-VolumesDeleteCascade-1259063873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c7612ef5-af19-4a85-a571-7a680008e136" returned: 0 in 0.778s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:12:13 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-70cb001f-2105-4376-bfe7-5a1570315280 tempest-VolumesDeleteCascade-1259063873 None] Lock "cinder-quobyte-c7612ef5-af19-4a85-a571-7a680008e136" released by "_copy_volume_from_snapshot" :: held 9.636s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:12:13 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-70cb001f-2105-4376-bfe7-5a1570315280 tempest-VolumesDeleteCascade-1259063873 None] Lock "cinder-quobyte-8b6cd607-e852-45e4-8b1f-897350989c84-c7612ef5-af19-4a85-a571-7a680008e136" released by "_create_volume_from_snapshot" :: held 9.695s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:12:13 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-70cb001f-2105-4376-bfe7-5a1570315280 tempest-VolumesDeleteCascade-1259063873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.726s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:12:13 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-70cb001f-2105-4376-bfe7-5a1570315280 tempest-VolumesDeleteCascade-1259063873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2981b556-e010-4f8b-8ab8-2fd852938c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7612ef5-af19-4a85-a571-7a680008e136', 'volume_size': 1, 'snapshot_id': '8b6cd607-e852-45e4-8b1f-897350989c84'}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:12:13 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-70cb001f-2105-4376-bfe7-5a1570315280 tempest-VolumesDeleteCascade-1259063873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8be14870-e496-4fb6-898b-791dc7c9c884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:12:13 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-ee9fa6a9-36dd-48f6-bb2e-f95badbbe0b7 tempest-VolumesSnapshotTestJSON-197741556 None] Acquiring lock "cinder-c952a096-ac09-4a11-b56c-d9a174e21edf-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:12:13 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-70cb001f-2105-4376-bfe7-5a1570315280 tempest-VolumesDeleteCascade-1259063873 None] Volume volume-c7612ef5-af19-4a85-a571-7a680008e136 (c7612ef5-af19-4a85-a571-7a680008e136): created successfully Jul 10 10:12:13 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-70cb001f-2105-4376-bfe7-5a1570315280 tempest-VolumesDeleteCascade-1259063873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8be14870-e496-4fb6-898b-791dc7c9c884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:12:13 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-70cb001f-2105-4376-bfe7-5a1570315280 tempest-VolumesDeleteCascade-1259063873 None] Flow 'volume_create_manager' (97f9430c-f7bd-4ab2-a281-2a82645d5107) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:12:13 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-ee9fa6a9-36dd-48f6-bb2e-f95badbbe0b7 tempest-VolumesSnapshotTestJSON-197741556 None] Lock "cinder-c952a096-ac09-4a11-b56c-d9a174e21edf-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:12:13 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-70cb001f-2105-4376-bfe7-5a1570315280 tempest-VolumesDeleteCascade-1259063873 None] Created volume successfully. Jul 10 10:12:13 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-ee9fa6a9-36dd-48f6-bb2e-f95badbbe0b7 tempest-VolumesSnapshotTestJSON-197741556 None] Acquiring lock "cinder-quobyte-c952a096-ac09-4a11-b56c-d9a174e21edf" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:12:13 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-ee9fa6a9-36dd-48f6-bb2e-f95badbbe0b7 tempest-VolumesSnapshotTestJSON-197741556 None] Lock "cinder-quobyte-c952a096-ac09-4a11-b56c-d9a174e21edf" acquired by "delete_volume" :: waited 0.021s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:12:13 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd5d8ca-0523-49c5-9071-2cffa626bf93]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:12:13 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ee9fa6a9-36dd-48f6-bb2e-f95badbbe0b7 tempest-VolumesSnapshotTestJSON-197741556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c952a096-ac09-4a11-b56c-d9a174e21edf {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:12:14 devstack sudo[96923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c952a096-ac09-4a11-b56c-d9a174e21edf Jul 10 10:12:14 devstack sudo[96923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:12:14 devstack sudo[96923]: pam_unix(sudo:session): session closed for user root Jul 10 10:12:14 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ee9fa6a9-36dd-48f6-bb2e-f95badbbe0b7 tempest-VolumesSnapshotTestJSON-197741556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c952a096-ac09-4a11-b56c-d9a174e21edf" returned: 0 in 0.778s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:12:14 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ee9fa6a9-36dd-48f6-bb2e-f95badbbe0b7 tempest-VolumesSnapshotTestJSON-197741556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c952a096-ac09-4a11-b56c-d9a174e21edf {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:12:14 devstack sudo[96929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c952a096-ac09-4a11-b56c-d9a174e21edf Jul 10 10:12:14 devstack sudo[96929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:12:14 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-3e24cde1-bb84-4aac-9c2e-5c5341ba0f04 tempest-VolumesDeleteCascade-1259063873 None] Acquiring lock "cinder-124c79dc-ac52-4c1a-99e7-e416869882cc-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:12:15 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-3e24cde1-bb84-4aac-9c2e-5c5341ba0f04 tempest-VolumesDeleteCascade-1259063873 None] Lock "cinder-124c79dc-ac52-4c1a-99e7-e416869882cc-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:12:15 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3e24cde1-bb84-4aac-9c2e-5c5341ba0f04 tempest-VolumesDeleteCascade-1259063873 None] Performing cascade delete. {{(pid=87234) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 10 10:12:15 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-3e24cde1-bb84-4aac-9c2e-5c5341ba0f04 tempest-VolumesDeleteCascade-1259063873 None] Acquiring lock "cinder-8b6cd607-e852-45e4-8b1f-897350989c84-delete_snapshot" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:12:15 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-3e24cde1-bb84-4aac-9c2e-5c5341ba0f04 tempest-VolumesDeleteCascade-1259063873 None] Lock "cinder-8b6cd607-e852-45e4-8b1f-897350989c84-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:12:15 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-3e24cde1-bb84-4aac-9c2e-5c5341ba0f04 tempest-VolumesDeleteCascade-1259063873 None] Acquiring lock "cinder-quobyte-124c79dc-ac52-4c1a-99e7-e416869882cc" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:12:15 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-3e24cde1-bb84-4aac-9c2e-5c5341ba0f04 tempest-VolumesDeleteCascade-1259063873 None] Lock "cinder-quobyte-124c79dc-ac52-4c1a-99e7-e416869882cc" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:12:15 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-3e24cde1-bb84-4aac-9c2e-5c5341ba0f04 tempest-VolumesDeleteCascade-1259063873 None] Acquiring lock "cinder-quobyte-8b6cd607-e852-45e4-8b1f-897350989c84" by "_delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:12:15 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-3e24cde1-bb84-4aac-9c2e-5c5341ba0f04 tempest-VolumesDeleteCascade-1259063873 None] Lock "cinder-quobyte-8b6cd607-e852-45e4-8b1f-897350989c84" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:12:15 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-3e24cde1-bb84-4aac-9c2e-5c5341ba0f04 tempest-VolumesDeleteCascade-1259063873 None] Deleting offline snapshot 8b6cd607-e852-45e4-8b1f-897350989c84 of volume 124c79dc-ac52-4c1a-99e7-e416869882cc {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 10:12:15 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-3e24cde1-bb84-4aac-9c2e-5c5341ba0f04 tempest-VolumesDeleteCascade-1259063873 None] snapshot_file for this snap is: volume-124c79dc-ac52-4c1a-99e7-e416869882cc.8b6cd607-e852-45e4-8b1f-897350989c84 {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 10:12:15 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a62308b-99bc-45ee-a7b1-8285aa249551]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:12:15 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3e24cde1-bb84-4aac-9c2e-5c5341ba0f04 tempest-VolumesDeleteCascade-1259063873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-124c79dc-ac52-4c1a-99e7-e416869882cc.8b6cd607-e852-45e4-8b1f-897350989c84 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:12:15 devstack sudo[96931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-124c79dc-ac52-4c1a-99e7-e416869882cc.8b6cd607-e852-45e4-8b1f-897350989c84 Jul 10 10:12:15 devstack sudo[96931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:12:15 devstack sudo[96929]: pam_unix(sudo:session): session closed for user root Jul 10 10:12:15 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ee9fa6a9-36dd-48f6-bb2e-f95badbbe0b7 tempest-VolumesSnapshotTestJSON-197741556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c952a096-ac09-4a11-b56c-d9a174e21edf" returned: 0 in 0.789s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:12:15 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-ee9fa6a9-36dd-48f6-bb2e-f95badbbe0b7 tempest-VolumesSnapshotTestJSON-197741556 None] Lock "cinder-quobyte-c952a096-ac09-4a11-b56c-d9a174e21edf" released by "delete_volume" :: held 1.634s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:12:15 devstack cinder-volume[87234]: INFO cinder.volume.manager [req-fc709442-e135-4b3c-b92e-3884a524fc14 req-0e4cd532-06da-4bbb-bb58-058956862e6c tempest-TestMinimumBasicScenario-1075697663 None] Terminate volume connection completed successfully. Jul 10 10:12:15 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [req-fc709442-e135-4b3c-b92e-3884a524fc14 req-0e4cd532-06da-4bbb-bb58-058956862e6c tempest-TestMinimumBasicScenario-1075697663 None] Deleting attachment a703bbda-e150-44f4-a7cd-afbac7b37d88. {{(pid=87234) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 10:12:15 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-ee9fa6a9-36dd-48f6-bb2e-f95badbbe0b7 tempest-VolumesSnapshotTestJSON-197741556 None] Created reservations ['14e03a73-65e4-4dfb-a9af-c4f1b362b2b9', '9e33dada-a866-4571-b6ed-6487c8c5fa9c', '5fc7b545-5561-42b7-b23a-09731639f913', 'f77258f9-6181-4890-bf6a-9bac5726067f'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:12:15 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-ee9fa6a9-36dd-48f6-bb2e-f95badbbe0b7 tempest-VolumesSnapshotTestJSON-197741556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:12:15 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-ee9fa6a9-36dd-48f6-bb2e-f95badbbe0b7 tempest-VolumesSnapshotTestJSON-197741556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:12:15 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-ee9fa6a9-36dd-48f6-bb2e-f95badbbe0b7 tempest-VolumesSnapshotTestJSON-197741556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:12:15 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-ee9fa6a9-36dd-48f6-bb2e-f95badbbe0b7 tempest-VolumesSnapshotTestJSON-197741556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:12:15 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-ee9fa6a9-36dd-48f6-bb2e-f95badbbe0b7 tempest-VolumesSnapshotTestJSON-197741556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:12:15 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ee9fa6a9-36dd-48f6-bb2e-f95badbbe0b7 tempest-VolumesSnapshotTestJSON-197741556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:12:15 devstack sudo[96938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:12:15 devstack sudo[96938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:12:16 devstack sudo[96931]: pam_unix(sudo:session): session closed for user root Jul 10 10:12:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3e24cde1-bb84-4aac-9c2e-5c5341ba0f04 tempest-VolumesDeleteCascade-1259063873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-124c79dc-ac52-4c1a-99e7-e416869882cc.8b6cd607-e852-45e4-8b1f-897350989c84" returned: 0 in 1.037s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:12:16 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-3e24cde1-bb84-4aac-9c2e-5c5341ba0f04 tempest-VolumesDeleteCascade-1259063873 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-124c79dc-ac52-4c1a-99e7-e416869882cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 10:12:16 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[885fbbdf-31a6-451b-a7d1-a941cc8aa63f]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:12:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3e24cde1-bb84-4aac-9c2e-5c5341ba0f04 tempest-VolumesDeleteCascade-1259063873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-124c79dc-ac52-4c1a-99e7-e416869882cc {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:12:16 devstack sudo[96943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-124c79dc-ac52-4c1a-99e7-e416869882cc Jul 10 10:12:16 devstack sudo[96943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:12:16 devstack sudo[96938]: pam_unix(sudo:session): session closed for user root Jul 10 10:12:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ee9fa6a9-36dd-48f6-bb2e-f95badbbe0b7 tempest-VolumesSnapshotTestJSON-197741556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.890s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:12:16 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-ee9fa6a9-36dd-48f6-bb2e-f95badbbe0b7 tempest-VolumesSnapshotTestJSON-197741556 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:12:16 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-ee9fa6a9-36dd-48f6-bb2e-f95badbbe0b7 tempest-VolumesSnapshotTestJSON-197741556 None] Deleted volume successfully. Jul 10 10:12:16 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-ee9fa6a9-36dd-48f6-bb2e-f95badbbe0b7 tempest-VolumesSnapshotTestJSON-197741556 None] Lock "cinder-c952a096-ac09-4a11-b56c-d9a174e21edf-delete_volume" released by "delete_volume" :: held 2.879s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:12:16 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7ace854-5732-44e0-aadf-e31d427a583b tempest-VolumesSnapshotTestJSON-197741556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:12:16 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a7ace854-5732-44e0-aadf-e31d427a583b tempest-VolumesSnapshotTestJSON-197741556 None] Flow 'volume_create_manager' (a2bca03b-598c-496d-97bc-2ad9928b34ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:12:16 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a7ace854-5732-44e0-aadf-e31d427a583b tempest-VolumesSnapshotTestJSON-197741556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58fbc47e-5830-49fd-ac7b-773d352e2a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:12:16 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a7ace854-5732-44e0-aadf-e31d427a583b tempest-VolumesSnapshotTestJSON-197741556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58fbc47e-5830-49fd-ac7b-773d352e2a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:12:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1138918641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d32211e-ec83-4939-9511-94ac98b374b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='890f1b9b455349768dd4e3854511a17f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:12:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:12:17Z,use_quota=True,user_id='9935e5f7f72e46f6b6220bb497204fc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:12:16 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a7ace854-5732-44e0-aadf-e31d427a583b tempest-VolumesSnapshotTestJSON-197741556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b48e7b08-40d5-4fb0-944b-8f5718638041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:12:16 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a7ace854-5732-44e0-aadf-e31d427a583b tempest-VolumesSnapshotTestJSON-197741556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b48e7b08-40d5-4fb0-944b-8f5718638041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:12:16 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a7ace854-5732-44e0-aadf-e31d427a583b tempest-VolumesSnapshotTestJSON-197741556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ef75c13-a043-43a3-966b-debd2d660bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:12:16 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a7ace854-5732-44e0-aadf-e31d427a583b tempest-VolumesSnapshotTestJSON-197741556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ef75c13-a043-43a3-966b-debd2d660bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d32211e-ec83-4939-9511-94ac98b374b9', 'volume_name': 'volume-9d32211e-ec83-4939-9511-94ac98b374b9', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:12:16 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a7ace854-5732-44e0-aadf-e31d427a583b tempest-VolumesSnapshotTestJSON-197741556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc3dc15e-a42e-4ec5-a973-4393c3ccf0bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:12:16 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a7ace854-5732-44e0-aadf-e31d427a583b tempest-VolumesSnapshotTestJSON-197741556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc3dc15e-a42e-4ec5-a973-4393c3ccf0bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:12:16 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a7ace854-5732-44e0-aadf-e31d427a583b tempest-VolumesSnapshotTestJSON-197741556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3247adb-dd5c-4660-938b-a9d1b2a4f5bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:12:16 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-a7ace854-5732-44e0-aadf-e31d427a583b tempest-VolumesSnapshotTestJSON-197741556 None] Volume 9d32211e-ec83-4939-9511-94ac98b374b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d32211e-ec83-4939-9511-94ac98b374b9', 'volume_size': 1} Jul 10 10:12:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-a7ace854-5732-44e0-aadf-e31d427a583b tempest-VolumesSnapshotTestJSON-197741556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:12:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-a7ace854-5732-44e0-aadf-e31d427a583b tempest-VolumesSnapshotTestJSON-197741556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:12:16 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-a7ace854-5732-44e0-aadf-e31d427a583b tempest-VolumesSnapshotTestJSON-197741556 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:12:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1138918641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d32211e-ec83-4939-9511-94ac98b374b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='890f1b9b455349768dd4e3854511a17f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:12:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:12:17Z,use_quota=True,user_id='9935e5f7f72e46f6b6220bb497204fc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:12:16 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-a7ace854-5732-44e0-aadf-e31d427a583b tempest-VolumesSnapshotTestJSON-197741556 None] Creating volume 9d32211e-ec83-4939-9511-94ac98b374b9 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:12:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-a7ace854-5732-44e0-aadf-e31d427a583b tempest-VolumesSnapshotTestJSON-197741556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:12:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-a7ace854-5732-44e0-aadf-e31d427a583b tempest-VolumesSnapshotTestJSON-197741556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:12:16 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-a7ace854-5732-44e0-aadf-e31d427a583b tempest-VolumesSnapshotTestJSON-197741556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:12:16 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-a7ace854-5732-44e0-aadf-e31d427a583b tempest-VolumesSnapshotTestJSON-197741556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:12:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-a7ace854-5732-44e0-aadf-e31d427a583b tempest-VolumesSnapshotTestJSON-197741556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:12:16 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-a7ace854-5732-44e0-aadf-e31d427a583b tempest-VolumesSnapshotTestJSON-197741556 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:12:16 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-a7ace854-5732-44e0-aadf-e31d427a583b tempest-VolumesSnapshotTestJSON-197741556 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:12:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a7ace854-5732-44e0-aadf-e31d427a583b tempest-VolumesSnapshotTestJSON-197741556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-9d32211e-ec83-4939-9511-94ac98b374b9 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:12:16 devstack sudo[96947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-9d32211e-ec83-4939-9511-94ac98b374b9 1073741824 Jul 10 10:12:16 devstack sudo[96947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:12:17 devstack sudo[96943]: pam_unix(sudo:session): session closed for user root Jul 10 10:12:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3e24cde1-bb84-4aac-9c2e-5c5341ba0f04 tempest-VolumesDeleteCascade-1259063873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-124c79dc-ac52-4c1a-99e7-e416869882cc" returned: 0 in 0.895s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:12:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3e24cde1-bb84-4aac-9c2e-5c5341ba0f04 tempest-VolumesDeleteCascade-1259063873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-124c79dc-ac52-4c1a-99e7-e416869882cc.8b6cd607-e852-45e4-8b1f-897350989c84 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:12:17 devstack sudo[96952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-124c79dc-ac52-4c1a-99e7-e416869882cc.8b6cd607-e852-45e4-8b1f-897350989c84 Jul 10 10:12:17 devstack sudo[96952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:12:17 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-1af8b35a-b3dc-4eef-8332-2b39a7215fec tempest-TestMinimumBasicScenario-1075697663 None] Acquiring lock "cinder-20996cbe-3a07-4778-b9fe-f30d73b17dbc-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:12:17 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-1af8b35a-b3dc-4eef-8332-2b39a7215fec tempest-TestMinimumBasicScenario-1075697663 None] Lock "cinder-20996cbe-3a07-4778-b9fe-f30d73b17dbc-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:12:17 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-1af8b35a-b3dc-4eef-8332-2b39a7215fec tempest-TestMinimumBasicScenario-1075697663 None] Acquiring lock "cinder-quobyte-20996cbe-3a07-4778-b9fe-f30d73b17dbc" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:12:17 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-1af8b35a-b3dc-4eef-8332-2b39a7215fec tempest-TestMinimumBasicScenario-1075697663 None] Lock "cinder-quobyte-20996cbe-3a07-4778-b9fe-f30d73b17dbc" acquired by "delete_volume" :: waited 0.036s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:12:17 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[539762b6-a33e-4381-9fb0-806c854dcbb1]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:12:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1af8b35a-b3dc-4eef-8332-2b39a7215fec tempest-TestMinimumBasicScenario-1075697663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-20996cbe-3a07-4778-b9fe-f30d73b17dbc {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:12:18 devstack sudo[96947]: pam_unix(sudo:session): session closed for user root Jul 10 10:12:18 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a7ace854-5732-44e0-aadf-e31d427a583b tempest-VolumesSnapshotTestJSON-197741556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-9d32211e-ec83-4939-9511-94ac98b374b9 1073741824" returned: 0 in 1.157s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:12:18 devstack sudo[96960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-20996cbe-3a07-4778-b9fe-f30d73b17dbc Jul 10 10:12:18 devstack sudo[96960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:12:18 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a7ace854-5732-44e0-aadf-e31d427a583b tempest-VolumesSnapshotTestJSON-197741556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-9d32211e-ec83-4939-9511-94ac98b374b9 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:12:18 devstack sudo[96965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-9d32211e-ec83-4939-9511-94ac98b374b9 Jul 10 10:12:18 devstack sudo[96965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:12:18 devstack sudo[96952]: pam_unix(sudo:session): session closed for user root Jul 10 10:12:18 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3e24cde1-bb84-4aac-9c2e-5c5341ba0f04 tempest-VolumesDeleteCascade-1259063873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-124c79dc-ac52-4c1a-99e7-e416869882cc.8b6cd607-e852-45e4-8b1f-897350989c84" returned: 0 in 1.054s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:12:18 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3e24cde1-bb84-4aac-9c2e-5c5341ba0f04 tempest-VolumesDeleteCascade-1259063873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-124c79dc-ac52-4c1a-99e7-e416869882cc.8b6cd607-e852-45e4-8b1f-897350989c84 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:12:18 devstack sudo[96967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-124c79dc-ac52-4c1a-99e7-e416869882cc.8b6cd607-e852-45e4-8b1f-897350989c84 Jul 10 10:12:18 devstack sudo[96967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:12:18 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba3bb5d6-42cb-4320-b8fd-20f6495aa5ca tempest-AttachVolumeNegativeTest-1243032650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:12:18 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ba3bb5d6-42cb-4320-b8fd-20f6495aa5ca tempest-AttachVolumeNegativeTest-1243032650 None] Flow 'volume_create_manager' (c92246ea-5609-46ee-a547-c02e17dc417a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:12:18 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ba3bb5d6-42cb-4320-b8fd-20f6495aa5ca tempest-AttachVolumeNegativeTest-1243032650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d645eb2d-9195-49a4-b27b-ff57c2a5030a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:12:18 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ba3bb5d6-42cb-4320-b8fd-20f6495aa5ca tempest-AttachVolumeNegativeTest-1243032650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d645eb2d-9195-49a4-b27b-ff57c2a5030a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:12:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1421317113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3da148d-8156-426c-b0d4-f2b4ea794e43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e45ed030cc4a4542858731861ac6abd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:12:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:12:18Z,use_quota=True,user_id='0cbeaefb02e34b5896c041bba985deb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:12:18 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ba3bb5d6-42cb-4320-b8fd-20f6495aa5ca tempest-AttachVolumeNegativeTest-1243032650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4efb5aee-dbe5-4a2d-96f7-4ec1d915fa95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:12:18 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ba3bb5d6-42cb-4320-b8fd-20f6495aa5ca tempest-AttachVolumeNegativeTest-1243032650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4efb5aee-dbe5-4a2d-96f7-4ec1d915fa95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:12:18 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ba3bb5d6-42cb-4320-b8fd-20f6495aa5ca tempest-AttachVolumeNegativeTest-1243032650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baf2f03a-8b9c-4191-b187-dbc42d50856c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:12:18 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ba3bb5d6-42cb-4320-b8fd-20f6495aa5ca tempest-AttachVolumeNegativeTest-1243032650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baf2f03a-8b9c-4191-b187-dbc42d50856c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3da148d-8156-426c-b0d4-f2b4ea794e43', 'volume_name': 'volume-d3da148d-8156-426c-b0d4-f2b4ea794e43', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:12:18 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ba3bb5d6-42cb-4320-b8fd-20f6495aa5ca tempest-AttachVolumeNegativeTest-1243032650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d78c4742-74be-445f-84ad-4485af2a8353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:12:18 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ba3bb5d6-42cb-4320-b8fd-20f6495aa5ca tempest-AttachVolumeNegativeTest-1243032650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d78c4742-74be-445f-84ad-4485af2a8353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:12:18 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ba3bb5d6-42cb-4320-b8fd-20f6495aa5ca tempest-AttachVolumeNegativeTest-1243032650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb11a867-fbc8-4e3f-b9d5-ce713bdfdae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:12:18 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-ba3bb5d6-42cb-4320-b8fd-20f6495aa5ca tempest-AttachVolumeNegativeTest-1243032650 None] Volume d3da148d-8156-426c-b0d4-f2b4ea794e43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3da148d-8156-426c-b0d4-f2b4ea794e43', 'volume_size': 1} Jul 10 10:12:18 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-ba3bb5d6-42cb-4320-b8fd-20f6495aa5ca tempest-AttachVolumeNegativeTest-1243032650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:12:18 devstack sudo[96960]: pam_unix(sudo:session): session closed for user root Jul 10 10:12:18 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1af8b35a-b3dc-4eef-8332-2b39a7215fec tempest-TestMinimumBasicScenario-1075697663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-20996cbe-3a07-4778-b9fe-f30d73b17dbc" returned: 0 in 0.870s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:12:18 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1af8b35a-b3dc-4eef-8332-2b39a7215fec tempest-TestMinimumBasicScenario-1075697663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-20996cbe-3a07-4778-b9fe-f30d73b17dbc {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:12:18 devstack sudo[96974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-20996cbe-3a07-4778-b9fe-f30d73b17dbc Jul 10 10:12:18 devstack sudo[96974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:12:18 devstack sudo[96965]: pam_unix(sudo:session): session closed for user root Jul 10 10:12:18 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a7ace854-5732-44e0-aadf-e31d427a583b tempest-VolumesSnapshotTestJSON-197741556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-9d32211e-ec83-4939-9511-94ac98b374b9" returned: 0 in 0.783s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:12:18 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-a7ace854-5732-44e0-aadf-e31d427a583b tempest-VolumesSnapshotTestJSON-197741556 None] <== create_volume: return (2005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:12:18 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-a7ace854-5732-44e0-aadf-e31d427a583b tempest-VolumesSnapshotTestJSON-197741556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.008s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:12:18 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-ba3bb5d6-42cb-4320-b8fd-20f6495aa5ca tempest-AttachVolumeNegativeTest-1243032650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.201s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:12:18 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-ba3bb5d6-42cb-4320-b8fd-20f6495aa5ca tempest-AttachVolumeNegativeTest-1243032650 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:12:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1421317113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3da148d-8156-426c-b0d4-f2b4ea794e43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e45ed030cc4a4542858731861ac6abd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:12:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:12:18Z,use_quota=True,user_id='0cbeaefb02e34b5896c041bba985deb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:12:18 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-ba3bb5d6-42cb-4320-b8fd-20f6495aa5ca tempest-AttachVolumeNegativeTest-1243032650 None] Creating volume d3da148d-8156-426c-b0d4-f2b4ea794e43 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:12:18 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-ba3bb5d6-42cb-4320-b8fd-20f6495aa5ca tempest-AttachVolumeNegativeTest-1243032650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:12:18 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-ba3bb5d6-42cb-4320-b8fd-20f6495aa5ca tempest-AttachVolumeNegativeTest-1243032650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:12:18 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-ba3bb5d6-42cb-4320-b8fd-20f6495aa5ca tempest-AttachVolumeNegativeTest-1243032650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:12:18 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-ba3bb5d6-42cb-4320-b8fd-20f6495aa5ca tempest-AttachVolumeNegativeTest-1243032650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:12:18 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-ba3bb5d6-42cb-4320-b8fd-20f6495aa5ca tempest-AttachVolumeNegativeTest-1243032650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:12:18 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-ba3bb5d6-42cb-4320-b8fd-20f6495aa5ca tempest-AttachVolumeNegativeTest-1243032650 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:12:18 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-ba3bb5d6-42cb-4320-b8fd-20f6495aa5ca tempest-AttachVolumeNegativeTest-1243032650 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:12:18 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ba3bb5d6-42cb-4320-b8fd-20f6495aa5ca tempest-AttachVolumeNegativeTest-1243032650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d3da148d-8156-426c-b0d4-f2b4ea794e43 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:12:18 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a7ace854-5732-44e0-aadf-e31d427a583b tempest-VolumesSnapshotTestJSON-197741556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3247adb-dd5c-4660-938b-a9d1b2a4f5bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d32211e-ec83-4939-9511-94ac98b374b9', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:12:18 devstack sudo[96976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d3da148d-8156-426c-b0d4-f2b4ea794e43 1073741824 Jul 10 10:12:18 devstack sudo[96976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:12:18 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a7ace854-5732-44e0-aadf-e31d427a583b tempest-VolumesSnapshotTestJSON-197741556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d2ef4dc-c427-4cc5-be06-db79ea3ae04b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:12:18 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-a7ace854-5732-44e0-aadf-e31d427a583b tempest-VolumesSnapshotTestJSON-197741556 None] Volume volume-9d32211e-ec83-4939-9511-94ac98b374b9 (9d32211e-ec83-4939-9511-94ac98b374b9): created successfully Jul 10 10:12:18 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a7ace854-5732-44e0-aadf-e31d427a583b tempest-VolumesSnapshotTestJSON-197741556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d2ef4dc-c427-4cc5-be06-db79ea3ae04b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:12:18 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a7ace854-5732-44e0-aadf-e31d427a583b tempest-VolumesSnapshotTestJSON-197741556 None] Flow 'volume_create_manager' (a2bca03b-598c-496d-97bc-2ad9928b34ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:12:18 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-a7ace854-5732-44e0-aadf-e31d427a583b tempest-VolumesSnapshotTestJSON-197741556 None] Created volume successfully. Jul 10 10:12:19 devstack sudo[96967]: pam_unix(sudo:session): session closed for user root Jul 10 10:12:19 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3e24cde1-bb84-4aac-9c2e-5c5341ba0f04 tempest-VolumesDeleteCascade-1259063873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-124c79dc-ac52-4c1a-99e7-e416869882cc.8b6cd607-e852-45e4-8b1f-897350989c84" returned: 0 in 0.796s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:12:19 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-3e24cde1-bb84-4aac-9c2e-5c5341ba0f04 tempest-VolumesDeleteCascade-1259063873 None] Lock "cinder-quobyte-8b6cd607-e852-45e4-8b1f-897350989c84" released by "_delete_snapshot" :: held 3.986s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:12:19 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-3e24cde1-bb84-4aac-9c2e-5c5341ba0f04 tempest-VolumesDeleteCascade-1259063873 None] Lock "cinder-quobyte-124c79dc-ac52-4c1a-99e7-e416869882cc" released by "delete_snapshot" :: held 4.015s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:12:19 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-3e24cde1-bb84-4aac-9c2e-5c5341ba0f04 tempest-VolumesDeleteCascade-1259063873 None] Created reservations ['661f359e-acfc-47db-bb95-a70706b2fc65', '8ccd2c10-9cc6-4270-aa02-980641063333', 'dcd23528-147c-4601-8709-89780cc6761e', 'bbd7feef-9348-4e34-bfc2-c44fc2267729'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:12:19 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-3e24cde1-bb84-4aac-9c2e-5c5341ba0f04 tempest-VolumesDeleteCascade-1259063873 None] Delete snapshot completed successfully. Jul 10 10:12:19 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-3e24cde1-bb84-4aac-9c2e-5c5341ba0f04 tempest-VolumesDeleteCascade-1259063873 None] Lock "cinder-8b6cd607-e852-45e4-8b1f-897350989c84-delete_snapshot" released by "delete_snapshot" :: held 4.177s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:12:19 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3e24cde1-bb84-4aac-9c2e-5c5341ba0f04 tempest-VolumesDeleteCascade-1259063873 None] Snapshots deleted, issuing volume delete {{(pid=87234) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 10 10:12:19 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-3e24cde1-bb84-4aac-9c2e-5c5341ba0f04 tempest-VolumesDeleteCascade-1259063873 None] Acquiring lock "cinder-quobyte-124c79dc-ac52-4c1a-99e7-e416869882cc" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:12:19 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-3e24cde1-bb84-4aac-9c2e-5c5341ba0f04 tempest-VolumesDeleteCascade-1259063873 None] Lock "cinder-quobyte-124c79dc-ac52-4c1a-99e7-e416869882cc" acquired by "delete_volume" :: waited 0.017s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:12:19 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d914ee-d86f-449d-9352-80a3c301e668]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:12:19 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3e24cde1-bb84-4aac-9c2e-5c5341ba0f04 tempest-VolumesDeleteCascade-1259063873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-124c79dc-ac52-4c1a-99e7-e416869882cc {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:12:19 devstack sudo[96979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-124c79dc-ac52-4c1a-99e7-e416869882cc Jul 10 10:12:19 devstack sudo[96979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:12:19 devstack sudo[96974]: pam_unix(sudo:session): session closed for user root Jul 10 10:12:19 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1af8b35a-b3dc-4eef-8332-2b39a7215fec tempest-TestMinimumBasicScenario-1075697663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-20996cbe-3a07-4778-b9fe-f30d73b17dbc" returned: 0 in 0.744s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:12:19 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-1af8b35a-b3dc-4eef-8332-2b39a7215fec tempest-TestMinimumBasicScenario-1075697663 None] Lock "cinder-quobyte-20996cbe-3a07-4778-b9fe-f30d73b17dbc" released by "delete_volume" :: held 1.664s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:12:19 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-1af8b35a-b3dc-4eef-8332-2b39a7215fec tempest-TestMinimumBasicScenario-1075697663 None] Created reservations ['98171448-06cd-4cf3-a7d7-6cb8d1b879cf', '13945c8b-76f0-42e7-a557-ce4962237f6a', 'c995d9ac-2f22-4e44-9a26-32a5a0a506a3', '9c09d3c6-15d4-48a0-b21f-6cec552dcd43'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:12:19 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-1af8b35a-b3dc-4eef-8332-2b39a7215fec tempest-TestMinimumBasicScenario-1075697663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:12:19 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-1af8b35a-b3dc-4eef-8332-2b39a7215fec tempest-TestMinimumBasicScenario-1075697663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:12:19 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-1af8b35a-b3dc-4eef-8332-2b39a7215fec tempest-TestMinimumBasicScenario-1075697663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:12:19 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-1af8b35a-b3dc-4eef-8332-2b39a7215fec tempest-TestMinimumBasicScenario-1075697663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:12:19 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-1af8b35a-b3dc-4eef-8332-2b39a7215fec tempest-TestMinimumBasicScenario-1075697663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:12:19 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1af8b35a-b3dc-4eef-8332-2b39a7215fec tempest-TestMinimumBasicScenario-1075697663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:12:19 devstack sudo[96986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:12:19 devstack sudo[96986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:12:19 devstack sudo[96976]: pam_unix(sudo:session): session closed for user root Jul 10 10:12:19 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ba3bb5d6-42cb-4320-b8fd-20f6495aa5ca tempest-AttachVolumeNegativeTest-1243032650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d3da148d-8156-426c-b0d4-f2b4ea794e43 1073741824" returned: 0 in 0.926s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:12:19 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ba3bb5d6-42cb-4320-b8fd-20f6495aa5ca tempest-AttachVolumeNegativeTest-1243032650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d3da148d-8156-426c-b0d4-f2b4ea794e43 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:12:19 devstack sudo[96988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d3da148d-8156-426c-b0d4-f2b4ea794e43 Jul 10 10:12:19 devstack sudo[96988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:12:20 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-5186c9ee-e7b0-4f76-99ee-485415ce9300 tempest-VolumesSnapshotTestJSON-197741556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:12:20 devstack sudo[96979]: pam_unix(sudo:session): session closed for user root Jul 10 10:12:20 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3e24cde1-bb84-4aac-9c2e-5c5341ba0f04 tempest-VolumesDeleteCascade-1259063873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-124c79dc-ac52-4c1a-99e7-e416869882cc" returned: 0 in 1.010s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:12:20 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3e24cde1-bb84-4aac-9c2e-5c5341ba0f04 tempest-VolumesDeleteCascade-1259063873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-124c79dc-ac52-4c1a-99e7-e416869882cc {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:12:20 devstack sudo[96995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-124c79dc-ac52-4c1a-99e7-e416869882cc Jul 10 10:12:20 devstack sudo[96995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:12:20 devstack sudo[96986]: pam_unix(sudo:session): session closed for user root Jul 10 10:12:20 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1af8b35a-b3dc-4eef-8332-2b39a7215fec tempest-TestMinimumBasicScenario-1075697663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.754s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:12:20 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-1af8b35a-b3dc-4eef-8332-2b39a7215fec tempest-TestMinimumBasicScenario-1075697663 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:12:20 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-1af8b35a-b3dc-4eef-8332-2b39a7215fec tempest-TestMinimumBasicScenario-1075697663 None] Deleted volume successfully. Jul 10 10:12:20 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-1af8b35a-b3dc-4eef-8332-2b39a7215fec tempest-TestMinimumBasicScenario-1075697663 None] Lock "cinder-20996cbe-3a07-4778-b9fe-f30d73b17dbc-delete_volume" released by "delete_volume" :: held 2.698s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:12:20 devstack sudo[96988]: pam_unix(sudo:session): session closed for user root Jul 10 10:12:20 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ba3bb5d6-42cb-4320-b8fd-20f6495aa5ca tempest-AttachVolumeNegativeTest-1243032650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d3da148d-8156-426c-b0d4-f2b4ea794e43" returned: 0 in 0.947s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:12:20 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-ba3bb5d6-42cb-4320-b8fd-20f6495aa5ca tempest-AttachVolumeNegativeTest-1243032650 None] <== create_volume: return (1931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:12:20 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-ba3bb5d6-42cb-4320-b8fd-20f6495aa5ca tempest-AttachVolumeNegativeTest-1243032650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.934s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:12:20 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-5186c9ee-e7b0-4f76-99ee-485415ce9300 tempest-VolumesSnapshotTestJSON-197741556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.597s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:12:20 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-5186c9ee-e7b0-4f76-99ee-485415ce9300 tempest-VolumesSnapshotTestJSON-197741556 None] Creating offline snapshot 23ed6dc4-b90d-4021-ba36-0c8d26832d53 of volume 9d32211e-ec83-4939-9511-94ac98b374b9 {{(pid=87234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 10:12:20 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ba3bb5d6-42cb-4320-b8fd-20f6495aa5ca tempest-AttachVolumeNegativeTest-1243032650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb11a867-fbc8-4e3f-b9d5-ce713bdfdae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3da148d-8156-426c-b0d4-f2b4ea794e43', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:12:20 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ba3bb5d6-42cb-4320-b8fd-20f6495aa5ca tempest-AttachVolumeNegativeTest-1243032650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (466e4f38-febd-4171-b1fa-e03bb2da3101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:12:20 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6107e56-d5af-45ca-8733-e30aba6d1202]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:12:20 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5186c9ee-e7b0-4f76-99ee-485415ce9300 tempest-VolumesSnapshotTestJSON-197741556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-9d32211e-ec83-4939-9511-94ac98b374b9 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:12:20 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-ba3bb5d6-42cb-4320-b8fd-20f6495aa5ca tempest-AttachVolumeNegativeTest-1243032650 None] Volume volume-d3da148d-8156-426c-b0d4-f2b4ea794e43 (d3da148d-8156-426c-b0d4-f2b4ea794e43): created successfully Jul 10 10:12:20 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ba3bb5d6-42cb-4320-b8fd-20f6495aa5ca tempest-AttachVolumeNegativeTest-1243032650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (466e4f38-febd-4171-b1fa-e03bb2da3101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:12:20 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ba3bb5d6-42cb-4320-b8fd-20f6495aa5ca tempest-AttachVolumeNegativeTest-1243032650 None] Flow 'volume_create_manager' (c92246ea-5609-46ee-a547-c02e17dc417a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:12:20 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-ba3bb5d6-42cb-4320-b8fd-20f6495aa5ca tempest-AttachVolumeNegativeTest-1243032650 None] Created volume successfully. Jul 10 10:12:20 devstack sudo[96998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-9d32211e-ec83-4939-9511-94ac98b374b9 Jul 10 10:12:20 devstack sudo[96998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:12:21 devstack sudo[96995]: pam_unix(sudo:session): session closed for user root Jul 10 10:12:21 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3e24cde1-bb84-4aac-9c2e-5c5341ba0f04 tempest-VolumesDeleteCascade-1259063873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-124c79dc-ac52-4c1a-99e7-e416869882cc" returned: 0 in 0.758s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:12:21 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-3e24cde1-bb84-4aac-9c2e-5c5341ba0f04 tempest-VolumesDeleteCascade-1259063873 None] Lock "cinder-quobyte-124c79dc-ac52-4c1a-99e7-e416869882cc" released by "delete_volume" :: held 1.825s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:12:21 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-3e24cde1-bb84-4aac-9c2e-5c5341ba0f04 tempest-VolumesDeleteCascade-1259063873 None] Created reservations ['791e9341-c81c-4515-8955-a05f7e3031a0', '5732064b-3864-418e-8782-b06029cb0482', 'bc2a471d-0a1a-4e11-bdf2-4880c91c34d8', '15a943c3-a64b-4825-b748-5783c769d3c8'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:12:21 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-3e24cde1-bb84-4aac-9c2e-5c5341ba0f04 tempest-VolumesDeleteCascade-1259063873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:12:21 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-3e24cde1-bb84-4aac-9c2e-5c5341ba0f04 tempest-VolumesDeleteCascade-1259063873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:12:21 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-3e24cde1-bb84-4aac-9c2e-5c5341ba0f04 tempest-VolumesDeleteCascade-1259063873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:12:21 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-3e24cde1-bb84-4aac-9c2e-5c5341ba0f04 tempest-VolumesDeleteCascade-1259063873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:12:21 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-3e24cde1-bb84-4aac-9c2e-5c5341ba0f04 tempest-VolumesDeleteCascade-1259063873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:12:21 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3e24cde1-bb84-4aac-9c2e-5c5341ba0f04 tempest-VolumesDeleteCascade-1259063873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:12:21 devstack sudo[97001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:12:21 devstack sudo[97001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:12:21 devstack sudo[96998]: pam_unix(sudo:session): session closed for user root Jul 10 10:12:21 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5186c9ee-e7b0-4f76-99ee-485415ce9300 tempest-VolumesSnapshotTestJSON-197741556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-9d32211e-ec83-4939-9511-94ac98b374b9" returned: 0 in 0.854s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:12:21 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5186c9ee-e7b0-4f76-99ee-485415ce9300 tempest-VolumesSnapshotTestJSON-197741556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-9d32211e-ec83-4939-9511-94ac98b374b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-9d32211e-ec83-4939-9511-94ac98b374b9.23ed6dc4-b90d-4021-ba36-0c8d26832d53 1G {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:12:21 devstack sudo[97011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-9d32211e-ec83-4939-9511-94ac98b374b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-9d32211e-ec83-4939-9511-94ac98b374b9.23ed6dc4-b90d-4021-ba36-0c8d26832d53 1G Jul 10 10:12:21 devstack sudo[97011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:12:21 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-52cc1dde-fad5-4de8-93f4-ac86cdeb40a9 tempest-VolumesDeleteCascade-1259063873 None] Acquiring lock "cinder-c7612ef5-af19-4a85-a571-7a680008e136-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:12:21 devstack sudo[97001]: pam_unix(sudo:session): session closed for user root Jul 10 10:12:21 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-52cc1dde-fad5-4de8-93f4-ac86cdeb40a9 tempest-VolumesDeleteCascade-1259063873 None] Lock "cinder-c7612ef5-af19-4a85-a571-7a680008e136-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:12:21 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3e24cde1-bb84-4aac-9c2e-5c5341ba0f04 tempest-VolumesDeleteCascade-1259063873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.754s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:12:21 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-3e24cde1-bb84-4aac-9c2e-5c5341ba0f04 tempest-VolumesDeleteCascade-1259063873 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:12:21 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-3e24cde1-bb84-4aac-9c2e-5c5341ba0f04 tempest-VolumesDeleteCascade-1259063873 None] Deleted volume successfully. Jul 10 10:12:22 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-3e24cde1-bb84-4aac-9c2e-5c5341ba0f04 tempest-VolumesDeleteCascade-1259063873 None] Lock "cinder-124c79dc-ac52-4c1a-99e7-e416869882cc-delete_volume" released by "delete_volume" :: held 7.051s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:12:22 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-52cc1dde-fad5-4de8-93f4-ac86cdeb40a9 tempest-VolumesDeleteCascade-1259063873 None] Acquiring lock "cinder-quobyte-c7612ef5-af19-4a85-a571-7a680008e136" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:12:22 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-52cc1dde-fad5-4de8-93f4-ac86cdeb40a9 tempest-VolumesDeleteCascade-1259063873 None] Lock "cinder-quobyte-c7612ef5-af19-4a85-a571-7a680008e136" acquired by "delete_volume" :: waited 0.047s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:12:22 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb3f006b-5f31-4e1b-a593-efa9d208b931]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:12:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-52cc1dde-fad5-4de8-93f4-ac86cdeb40a9 tempest-VolumesDeleteCascade-1259063873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c7612ef5-af19-4a85-a571-7a680008e136 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:12:22 devstack sudo[97028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c7612ef5-af19-4a85-a571-7a680008e136 Jul 10 10:12:22 devstack sudo[97028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:12:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5186c9ee-e7b0-4f76-99ee-485415ce9300 tempest-VolumesSnapshotTestJSON-197741556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-9d32211e-ec83-4939-9511-94ac98b374b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-9d32211e-ec83-4939-9511-94ac98b374b9.23ed6dc4-b90d-4021-ba36-0c8d26832d53 1G" returned: 0 in 1.138s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:12:22 devstack sudo[97011]: pam_unix(sudo:session): session closed for user root Jul 10 10:12:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5186c9ee-e7b0-4f76-99ee-485415ce9300 tempest-VolumesSnapshotTestJSON-197741556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d32211e-ec83-4939-9511-94ac98b374b9 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-9d32211e-ec83-4939-9511-94ac98b374b9.23ed6dc4-b90d-4021-ba36-0c8d26832d53 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:12:22 devstack sudo[97043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d32211e-ec83-4939-9511-94ac98b374b9 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-9d32211e-ec83-4939-9511-94ac98b374b9.23ed6dc4-b90d-4021-ba36-0c8d26832d53 Jul 10 10:12:22 devstack sudo[97043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:12:23 devstack sudo[97028]: pam_unix(sudo:session): session closed for user root Jul 10 10:12:23 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-52cc1dde-fad5-4de8-93f4-ac86cdeb40a9 tempest-VolumesDeleteCascade-1259063873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c7612ef5-af19-4a85-a571-7a680008e136" returned: 0 in 0.955s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:12:23 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-52cc1dde-fad5-4de8-93f4-ac86cdeb40a9 tempest-VolumesDeleteCascade-1259063873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c7612ef5-af19-4a85-a571-7a680008e136 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:12:23 devstack sudo[97048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c7612ef5-af19-4a85-a571-7a680008e136 Jul 10 10:12:23 devstack sudo[97048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:12:23 devstack sudo[97043]: pam_unix(sudo:session): session closed for user root Jul 10 10:12:23 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5186c9ee-e7b0-4f76-99ee-485415ce9300 tempest-VolumesSnapshotTestJSON-197741556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d32211e-ec83-4939-9511-94ac98b374b9 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-9d32211e-ec83-4939-9511-94ac98b374b9.23ed6dc4-b90d-4021-ba36-0c8d26832d53" returned: 0 in 0.795s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:12:23 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-5186c9ee-e7b0-4f76-99ee-485415ce9300 tempest-VolumesSnapshotTestJSON-197741556 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-9d32211e-ec83-4939-9511-94ac98b374b9.23ed6dc4-b90d-4021-ba36-0c8d26832d53 is being set with open permissions: ugo+rw Jul 10 10:12:23 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5186c9ee-e7b0-4f76-99ee-485415ce9300 tempest-VolumesSnapshotTestJSON-197741556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-9d32211e-ec83-4939-9511-94ac98b374b9.23ed6dc4-b90d-4021-ba36-0c8d26832d53 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:12:23 devstack sudo[97054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-9d32211e-ec83-4939-9511-94ac98b374b9.23ed6dc4-b90d-4021-ba36-0c8d26832d53 Jul 10 10:12:23 devstack sudo[97054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:12:23 devstack sudo[97048]: pam_unix(sudo:session): session closed for user root Jul 10 10:12:23 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-52cc1dde-fad5-4de8-93f4-ac86cdeb40a9 tempest-VolumesDeleteCascade-1259063873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c7612ef5-af19-4a85-a571-7a680008e136" returned: 0 in 0.760s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:12:23 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-52cc1dde-fad5-4de8-93f4-ac86cdeb40a9 tempest-VolumesDeleteCascade-1259063873 None] Lock "cinder-quobyte-c7612ef5-af19-4a85-a571-7a680008e136" released by "delete_volume" :: held 1.817s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:12:24 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-52cc1dde-fad5-4de8-93f4-ac86cdeb40a9 tempest-VolumesDeleteCascade-1259063873 None] Created reservations ['e800df53-6de5-4815-87d5-be1a8fca33d7', 'be5bc1f0-f822-4cbc-bb91-70d8392ba648', '872b891e-477e-4fef-a7f7-d60e64f06e6b', '9a646277-782e-4131-990a-5b881f08d738'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:12:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-52cc1dde-fad5-4de8-93f4-ac86cdeb40a9 tempest-VolumesDeleteCascade-1259063873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:12:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-52cc1dde-fad5-4de8-93f4-ac86cdeb40a9 tempest-VolumesDeleteCascade-1259063873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:12:24 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-52cc1dde-fad5-4de8-93f4-ac86cdeb40a9 tempest-VolumesDeleteCascade-1259063873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:12:24 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-52cc1dde-fad5-4de8-93f4-ac86cdeb40a9 tempest-VolumesDeleteCascade-1259063873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:12:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-52cc1dde-fad5-4de8-93f4-ac86cdeb40a9 tempest-VolumesDeleteCascade-1259063873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:12:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-52cc1dde-fad5-4de8-93f4-ac86cdeb40a9 tempest-VolumesDeleteCascade-1259063873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:12:24 devstack sudo[97057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:12:24 devstack sudo[97057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:12:24 devstack sudo[97054]: pam_unix(sudo:session): session closed for user root Jul 10 10:12:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5186c9ee-e7b0-4f76-99ee-485415ce9300 tempest-VolumesSnapshotTestJSON-197741556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-9d32211e-ec83-4939-9511-94ac98b374b9.23ed6dc4-b90d-4021-ba36-0c8d26832d53" returned: 0 in 0.706s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:12:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5186c9ee-e7b0-4f76-99ee-485415ce9300 tempest-VolumesSnapshotTestJSON-197741556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-9d32211e-ec83-4939-9511-94ac98b374b9.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:12:24 devstack sudo[97060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-9d32211e-ec83-4939-9511-94ac98b374b9.info Jul 10 10:12:24 devstack sudo[97060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:12:24 devstack sudo[97057]: pam_unix(sudo:session): session closed for user root Jul 10 10:12:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-52cc1dde-fad5-4de8-93f4-ac86cdeb40a9 tempest-VolumesDeleteCascade-1259063873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.818s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:12:24 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-52cc1dde-fad5-4de8-93f4-ac86cdeb40a9 tempest-VolumesDeleteCascade-1259063873 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:12:24 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-52cc1dde-fad5-4de8-93f4-ac86cdeb40a9 tempest-VolumesDeleteCascade-1259063873 None] Deleted volume successfully. Jul 10 10:12:24 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-52cc1dde-fad5-4de8-93f4-ac86cdeb40a9 tempest-VolumesDeleteCascade-1259063873 None] Lock "cinder-c7612ef5-af19-4a85-a571-7a680008e136-delete_volume" released by "delete_volume" :: held 3.008s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:12:25 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-ac837a88-5cbe-4dee-9ace-26517c46e7fb req-582634a0-3d6d-40c5-a1d9-744cf71056bc tempest-AttachVolumeNegativeTest-1243032650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:12:25 devstack sudo[97060]: pam_unix(sudo:session): session closed for user root Jul 10 10:12:25 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5186c9ee-e7b0-4f76-99ee-485415ce9300 tempest-VolumesSnapshotTestJSON-197741556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-9d32211e-ec83-4939-9511-94ac98b374b9.info" returned: 0 in 0.903s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:12:25 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-5186c9ee-e7b0-4f76-99ee-485415ce9300 tempest-VolumesSnapshotTestJSON-197741556 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-9d32211e-ec83-4939-9511-94ac98b374b9.info is being set with open permissions: ugo+rw Jul 10 10:12:25 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5186c9ee-e7b0-4f76-99ee-485415ce9300 tempest-VolumesSnapshotTestJSON-197741556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-9d32211e-ec83-4939-9511-94ac98b374b9.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:12:25 devstack sudo[97072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-9d32211e-ec83-4939-9511-94ac98b374b9.info Jul 10 10:12:25 devstack sudo[97072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:12:26 devstack sudo[97072]: pam_unix(sudo:session): session closed for user root Jul 10 10:12:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5186c9ee-e7b0-4f76-99ee-485415ce9300 tempest-VolumesSnapshotTestJSON-197741556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-9d32211e-ec83-4939-9511-94ac98b374b9.info" returned: 0 in 0.730s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:12:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-5186c9ee-e7b0-4f76-99ee-485415ce9300 tempest-VolumesSnapshotTestJSON-197741556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.266s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:12:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-ac837a88-5cbe-4dee-9ace-26517c46e7fb req-582634a0-3d6d-40c5-a1d9-744cf71056bc tempest-AttachVolumeNegativeTest-1243032650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.997s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:12:26 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[46162480-813c-4ea5-895a-c10215daeb77]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:12:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-ac837a88-5cbe-4dee-9ace-26517c46e7fb req-582634a0-3d6d-40c5-a1d9-744cf71056bc tempest-AttachVolumeNegativeTest-1243032650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d3da148d-8156-426c-b0d4-f2b4ea794e43 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:12:26 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-5186c9ee-e7b0-4f76-99ee-485415ce9300 tempest-VolumesSnapshotTestJSON-197741556 None] Create snapshot completed successfully Jul 10 10:12:26 devstack sudo[97075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d3da148d-8156-426c-b0d4-f2b4ea794e43 Jul 10 10:12:26 devstack sudo[97075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:12:26 devstack sudo[97075]: pam_unix(sudo:session): session closed for user root Jul 10 10:12:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-ac837a88-5cbe-4dee-9ace-26517c46e7fb req-582634a0-3d6d-40c5-a1d9-744cf71056bc tempest-AttachVolumeNegativeTest-1243032650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d3da148d-8156-426c-b0d4-f2b4ea794e43" returned: 0 in 0.882s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:12:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-ac837a88-5cbe-4dee-9ace-26517c46e7fb req-582634a0-3d6d-40c5-a1d9-744cf71056bc tempest-AttachVolumeNegativeTest-1243032650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.910s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:12:27 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [req-ac837a88-5cbe-4dee-9ace-26517c46e7fb req-582634a0-3d6d-40c5-a1d9-744cf71056bc tempest-AttachVolumeNegativeTest-1243032650 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091', 'name': 'volume-d3da148d-8156-426c-b0d4-f2b4ea794e43', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b3159772-da0a-4ca9-9367-b4ed5ecd98c8', 'enforce_multipath': True} {{(pid=87234) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 10:12:27 devstack cinder-volume[87234]: INFO cinder.volume.manager [req-ac837a88-5cbe-4dee-9ace-26517c46e7fb req-582634a0-3d6d-40c5-a1d9-744cf71056bc tempest-AttachVolumeNegativeTest-1243032650 None] attachment_update completed successfully. Jul 10 10:12:27 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fefa231-107d-4f26-8ce1-9133040a6e76 tempest-VolumesSnapshotTestJSON-197741556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:12:27 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-6fefa231-107d-4f26-8ce1-9133040a6e76 tempest-VolumesSnapshotTestJSON-197741556 None] Flow 'volume_create_manager' (b75a4948-5973-43c7-86d0-96ba17945aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:12:27 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-6fefa231-107d-4f26-8ce1-9133040a6e76 tempest-VolumesSnapshotTestJSON-197741556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3286f57f-e8e8-4a2a-8bfb-5f66404c35af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:12:27 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-6fefa231-107d-4f26-8ce1-9133040a6e76 tempest-VolumesSnapshotTestJSON-197741556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3286f57f-e8e8-4a2a-8bfb-5f66404c35af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:12:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-848063981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e62dc34-c8d8-46bf-8762-2a3b90de711d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='890f1b9b455349768dd4e3854511a17f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:12:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=23ed6dc4-b90d-4021-ba36-0c8d26832d53,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:12:27Z,use_quota=True,user_id='9935e5f7f72e46f6b6220bb497204fc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:12:27 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-6fefa231-107d-4f26-8ce1-9133040a6e76 tempest-VolumesSnapshotTestJSON-197741556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d28a6350-5b83-413f-8391-a5834df8882e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:12:27 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-6fefa231-107d-4f26-8ce1-9133040a6e76 tempest-VolumesSnapshotTestJSON-197741556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d28a6350-5b83-413f-8391-a5834df8882e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:12:27 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-6fefa231-107d-4f26-8ce1-9133040a6e76 tempest-VolumesSnapshotTestJSON-197741556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e60bdaa-7882-47d9-92d8-5e2b2aaf25b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:12:27 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-6fefa231-107d-4f26-8ce1-9133040a6e76 tempest-VolumesSnapshotTestJSON-197741556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e60bdaa-7882-47d9-92d8-5e2b2aaf25b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2e62dc34-c8d8-46bf-8762-2a3b90de711d', 'volume_name': 'volume-2e62dc34-c8d8-46bf-8762-2a3b90de711d', 'volume_size': 1, 'snapshot_id': '23ed6dc4-b90d-4021-ba36-0c8d26832d53'}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:12:27 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-6fefa231-107d-4f26-8ce1-9133040a6e76 tempest-VolumesSnapshotTestJSON-197741556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8179e98-f6d8-4565-8e8b-13c29a88999a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:12:27 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-6fefa231-107d-4f26-8ce1-9133040a6e76 tempest-VolumesSnapshotTestJSON-197741556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8179e98-f6d8-4565-8e8b-13c29a88999a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:12:27 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-6fefa231-107d-4f26-8ce1-9133040a6e76 tempest-VolumesSnapshotTestJSON-197741556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ef70bf5-2295-433f-ac82-6c94b2825b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:12:27 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-6fefa231-107d-4f26-8ce1-9133040a6e76 tempest-VolumesSnapshotTestJSON-197741556 None] Volume 2e62dc34-c8d8-46bf-8762-2a3b90de711d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2e62dc34-c8d8-46bf-8762-2a3b90de711d', 'volume_size': 1, 'snapshot_id': '23ed6dc4-b90d-4021-ba36-0c8d26832d53'} Jul 10 10:12:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-6fefa231-107d-4f26-8ce1-9133040a6e76 tempest-VolumesSnapshotTestJSON-197741556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:12:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-6fefa231-107d-4f26-8ce1-9133040a6e76 tempest-VolumesSnapshotTestJSON-197741556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:12:27 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-6fefa231-107d-4f26-8ce1-9133040a6e76 tempest-VolumesSnapshotTestJSON-197741556 None] Acquiring lock "cinder-quobyte-23ed6dc4-b90d-4021-ba36-0c8d26832d53-2e62dc34-c8d8-46bf-8762-2a3b90de711d" by "_create_volume_from_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:12:27 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-6fefa231-107d-4f26-8ce1-9133040a6e76 tempest-VolumesSnapshotTestJSON-197741556 None] Lock "cinder-quobyte-23ed6dc4-b90d-4021-ba36-0c8d26832d53-2e62dc34-c8d8-46bf-8762-2a3b90de711d" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:12:27 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-6fefa231-107d-4f26-8ce1-9133040a6e76 tempest-VolumesSnapshotTestJSON-197741556 None] Creating volume 2e62dc34-c8d8-46bf-8762-2a3b90de711d from snapshot 23ed6dc4-b90d-4021-ba36-0c8d26832d53 {{(pid=87234) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 10:12:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-6fefa231-107d-4f26-8ce1-9133040a6e76 tempest-VolumesSnapshotTestJSON-197741556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:12:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-6fefa231-107d-4f26-8ce1-9133040a6e76 tempest-VolumesSnapshotTestJSON-197741556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:12:27 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-6fefa231-107d-4f26-8ce1-9133040a6e76 tempest-VolumesSnapshotTestJSON-197741556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:12:27 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-6fefa231-107d-4f26-8ce1-9133040a6e76 tempest-VolumesSnapshotTestJSON-197741556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:12:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-6fefa231-107d-4f26-8ce1-9133040a6e76 tempest-VolumesSnapshotTestJSON-197741556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:12:27 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-6fefa231-107d-4f26-8ce1-9133040a6e76 tempest-VolumesSnapshotTestJSON-197741556 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:12:27 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-6fefa231-107d-4f26-8ce1-9133040a6e76 tempest-VolumesSnapshotTestJSON-197741556 None] Acquiring lock "cinder-quobyte-2e62dc34-c8d8-46bf-8762-2a3b90de711d" by "_copy_volume_from_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:12:27 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-6fefa231-107d-4f26-8ce1-9133040a6e76 tempest-VolumesSnapshotTestJSON-197741556 None] Lock "cinder-quobyte-2e62dc34-c8d8-46bf-8762-2a3b90de711d" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:12:27 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-6fefa231-107d-4f26-8ce1-9133040a6e76 tempest-VolumesSnapshotTestJSON-197741556 None] snapshot: 23ed6dc4-b90d-4021-ba36-0c8d26832d53, volume: 2e62dc34-c8d8-46bf-8762-2a3b90de711d, {{(pid=87234) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 10:12:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-6fefa231-107d-4f26-8ce1-9133040a6e76 tempest-VolumesSnapshotTestJSON-197741556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:12:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-6fefa231-107d-4f26-8ce1-9133040a6e76 tempest-VolumesSnapshotTestJSON-197741556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:12:27 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-6fefa231-107d-4f26-8ce1-9133040a6e76 tempest-VolumesSnapshotTestJSON-197741556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:12:27 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-6fefa231-107d-4f26-8ce1-9133040a6e76 tempest-VolumesSnapshotTestJSON-197741556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:12:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-6fefa231-107d-4f26-8ce1-9133040a6e76 tempest-VolumesSnapshotTestJSON-197741556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:12:27 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe6f84d-ea78-4ebb-91e9-5ade7cc810b2]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:12:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-6fefa231-107d-4f26-8ce1-9133040a6e76 tempest-VolumesSnapshotTestJSON-197741556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-9d32211e-ec83-4939-9511-94ac98b374b9.23ed6dc4-b90d-4021-ba36-0c8d26832d53 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:12:27 devstack sudo[97081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-9d32211e-ec83-4939-9511-94ac98b374b9.23ed6dc4-b90d-4021-ba36-0c8d26832d53 Jul 10 10:12:27 devstack sudo[97081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:12:28 devstack sudo[97081]: pam_unix(sudo:session): session closed for user root Jul 10 10:12:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-6fefa231-107d-4f26-8ce1-9133040a6e76 tempest-VolumesSnapshotTestJSON-197741556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-9d32211e-ec83-4939-9511-94ac98b374b9.23ed6dc4-b90d-4021-ba36-0c8d26832d53" returned: 0 in 0.930s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:12:28 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-6fefa231-107d-4f26-8ce1-9133040a6e76 tempest-VolumesSnapshotTestJSON-197741556 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d32211e-ec83-4939-9511-94ac98b374b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 10:12:28 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-6fefa231-107d-4f26-8ce1-9133040a6e76 tempest-VolumesSnapshotTestJSON-197741556 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-9d32211e-ec83-4939-9511-94ac98b374b9 {{(pid=87234) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 10:12:28 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-6fefa231-107d-4f26-8ce1-9133040a6e76 tempest-VolumesSnapshotTestJSON-197741556 None] Creating direct copy from snapshot {{(pid=87234) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 10:12:28 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[e854e14e-5a5d-4a7a-895e-5b73cc90c26c]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:12:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-6fefa231-107d-4f26-8ce1-9133040a6e76 tempest-VolumesSnapshotTestJSON-197741556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-9d32211e-ec83-4939-9511-94ac98b374b9 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:12:28 devstack sudo[97153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-9d32211e-ec83-4939-9511-94ac98b374b9 Jul 10 10:12:28 devstack sudo[97153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:12:29 devstack sudo[97153]: pam_unix(sudo:session): session closed for user root Jul 10 10:12:29 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-6fefa231-107d-4f26-8ce1-9133040a6e76 tempest-VolumesSnapshotTestJSON-197741556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-9d32211e-ec83-4939-9511-94ac98b374b9" returned: 0 in 0.951s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:12:29 devstack cinder-volume[87234]: DEBUG cinder.utils [None req-6fefa231-107d-4f26-8ce1-9133040a6e76 tempest-VolumesSnapshotTestJSON-197741556 None] Path /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2e62dc34-c8d8-46bf-8762-2a3b90de711d not found in is_blk_device check {{(pid=87234) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 10:12:29 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-6fefa231-107d-4f26-8ce1-9133040a6e76 tempest-VolumesSnapshotTestJSON-197741556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-9d32211e-ec83-4939-9511-94ac98b374b9 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2e62dc34-c8d8-46bf-8762-2a3b90de711d {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:12:29 devstack sudo[97480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-9d32211e-ec83-4939-9511-94ac98b374b9 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2e62dc34-c8d8-46bf-8762-2a3b90de711d Jul 10 10:12:29 devstack sudo[97480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:12:29 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-24058954-0a9c-4b1c-ad3b-0af4d9571ae9 tempest-VolumesTransfersTest-778669855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:12:29 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-24058954-0a9c-4b1c-ad3b-0af4d9571ae9 tempest-VolumesTransfersTest-778669855 None] Flow 'volume_create_manager' (b377ee8d-c40d-4d6a-9a09-bc8f28cc3f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:12:29 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-24058954-0a9c-4b1c-ad3b-0af4d9571ae9 tempest-VolumesTransfersTest-778669855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99e4385f-9145-424d-a49b-13ba35fbf984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:12:29 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-24058954-0a9c-4b1c-ad3b-0af4d9571ae9 tempest-VolumesTransfersTest-778669855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99e4385f-9145-424d-a49b-13ba35fbf984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:12:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-909168109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c1f068b-26a7-40b1-9b25-425406f7753b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e8ec92c5a8445329225cfbea823be86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:12:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:12:29Z,use_quota=True,user_id='106b71df6a7c44e085db07f735d86da4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:12:29 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-24058954-0a9c-4b1c-ad3b-0af4d9571ae9 tempest-VolumesTransfersTest-778669855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e60ba772-0102-4ede-9705-49365417723d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:12:29 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-24058954-0a9c-4b1c-ad3b-0af4d9571ae9 tempest-VolumesTransfersTest-778669855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e60ba772-0102-4ede-9705-49365417723d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:12:29 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-24058954-0a9c-4b1c-ad3b-0af4d9571ae9 tempest-VolumesTransfersTest-778669855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7769c9a7-3232-40ba-96ba-5352789e12cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:12:29 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-24058954-0a9c-4b1c-ad3b-0af4d9571ae9 tempest-VolumesTransfersTest-778669855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7769c9a7-3232-40ba-96ba-5352789e12cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c1f068b-26a7-40b1-9b25-425406f7753b', 'volume_name': 'volume-7c1f068b-26a7-40b1-9b25-425406f7753b', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:12:29 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-24058954-0a9c-4b1c-ad3b-0af4d9571ae9 tempest-VolumesTransfersTest-778669855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (558b6a23-ec60-49c4-8b56-0206b6779da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:12:29 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-24058954-0a9c-4b1c-ad3b-0af4d9571ae9 tempest-VolumesTransfersTest-778669855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (558b6a23-ec60-49c4-8b56-0206b6779da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:12:29 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-24058954-0a9c-4b1c-ad3b-0af4d9571ae9 tempest-VolumesTransfersTest-778669855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ee72f9a-a7e9-490e-826e-e338cd893ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:12:29 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-24058954-0a9c-4b1c-ad3b-0af4d9571ae9 tempest-VolumesTransfersTest-778669855 None] Volume 7c1f068b-26a7-40b1-9b25-425406f7753b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c1f068b-26a7-40b1-9b25-425406f7753b', 'volume_size': 1} Jul 10 10:12:29 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-24058954-0a9c-4b1c-ad3b-0af4d9571ae9 tempest-VolumesTransfersTest-778669855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:12:35 devstack sudo[97480]: pam_unix(sudo:session): session closed for user root Jul 10 10:12:35 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-6fefa231-107d-4f26-8ce1-9133040a6e76 tempest-VolumesSnapshotTestJSON-197741556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-9d32211e-ec83-4939-9511-94ac98b374b9 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2e62dc34-c8d8-46bf-8762-2a3b90de711d" returned: 0 in 6.106s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:12:35 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[3366906f-970c-43f8-a971-ad4366f244fc]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:12:35 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-6fefa231-107d-4f26-8ce1-9133040a6e76 tempest-VolumesSnapshotTestJSON-197741556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-9d32211e-ec83-4939-9511-94ac98b374b9 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:12:35 devstack sudo[97495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-9d32211e-ec83-4939-9511-94ac98b374b9 Jul 10 10:12:35 devstack sudo[97495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:12:36 devstack sudo[97495]: pam_unix(sudo:session): session closed for user root Jul 10 10:12:36 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-6fefa231-107d-4f26-8ce1-9133040a6e76 tempest-VolumesSnapshotTestJSON-197741556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-9d32211e-ec83-4939-9511-94ac98b374b9" returned: 0 in 1.085s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:12:36 devstack cinder-volume[87234]: DEBUG cinder.image.image_utils [None req-6fefa231-107d-4f26-8ce1-9133040a6e76 tempest-VolumesSnapshotTestJSON-197741556 None] Image conversion details: src /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-9d32211e-ec83-4939-9511-94ac98b374b9, size 1024.00 MB, duration 6.11 sec, destination /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2e62dc34-c8d8-46bf-8762-2a3b90de711d {{(pid=87234) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 10:12:36 devstack cinder-volume[87234]: INFO cinder.image.image_utils [None req-6fefa231-107d-4f26-8ce1-9133040a6e76 tempest-VolumesSnapshotTestJSON-197741556 None] Converted 1024.00 MB image at 167.67 MB/s Jul 10 10:12:36 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-6fefa231-107d-4f26-8ce1-9133040a6e76 tempest-VolumesSnapshotTestJSON-197741556 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2e62dc34-c8d8-46bf-8762-2a3b90de711d is being set with open permissions: ugo+rw Jul 10 10:12:36 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-6fefa231-107d-4f26-8ce1-9133040a6e76 tempest-VolumesSnapshotTestJSON-197741556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2e62dc34-c8d8-46bf-8762-2a3b90de711d {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:12:36 devstack sudo[97501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2e62dc34-c8d8-46bf-8762-2a3b90de711d Jul 10 10:12:36 devstack sudo[97501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:12:37 devstack sudo[97501]: pam_unix(sudo:session): session closed for user root Jul 10 10:12:37 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-6fefa231-107d-4f26-8ce1-9133040a6e76 tempest-VolumesSnapshotTestJSON-197741556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2e62dc34-c8d8-46bf-8762-2a3b90de711d" returned: 0 in 0.690s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:12:37 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-6fefa231-107d-4f26-8ce1-9133040a6e76 tempest-VolumesSnapshotTestJSON-197741556 None] Lock "cinder-quobyte-2e62dc34-c8d8-46bf-8762-2a3b90de711d" released by "_copy_volume_from_snapshot" :: held 9.893s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:12:37 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-6fefa231-107d-4f26-8ce1-9133040a6e76 tempest-VolumesSnapshotTestJSON-197741556 None] Lock "cinder-quobyte-23ed6dc4-b90d-4021-ba36-0c8d26832d53-2e62dc34-c8d8-46bf-8762-2a3b90de711d" released by "_create_volume_from_snapshot" :: held 9.927s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:12:37 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-6fefa231-107d-4f26-8ce1-9133040a6e76 tempest-VolumesSnapshotTestJSON-197741556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.950s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:12:37 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-24058954-0a9c-4b1c-ad3b-0af4d9571ae9 tempest-VolumesTransfersTest-778669855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.674s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:12:37 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-24058954-0a9c-4b1c-ad3b-0af4d9571ae9 tempest-VolumesTransfersTest-778669855 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:12:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-909168109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c1f068b-26a7-40b1-9b25-425406f7753b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e8ec92c5a8445329225cfbea823be86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:12:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:12:29Z,use_quota=True,user_id='106b71df6a7c44e085db07f735d86da4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:12:37 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-24058954-0a9c-4b1c-ad3b-0af4d9571ae9 tempest-VolumesTransfersTest-778669855 None] Creating volume 7c1f068b-26a7-40b1-9b25-425406f7753b {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:12:37 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-24058954-0a9c-4b1c-ad3b-0af4d9571ae9 tempest-VolumesTransfersTest-778669855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:12:37 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-24058954-0a9c-4b1c-ad3b-0af4d9571ae9 tempest-VolumesTransfersTest-778669855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:12:37 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-24058954-0a9c-4b1c-ad3b-0af4d9571ae9 tempest-VolumesTransfersTest-778669855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:12:37 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-24058954-0a9c-4b1c-ad3b-0af4d9571ae9 tempest-VolumesTransfersTest-778669855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:12:37 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-24058954-0a9c-4b1c-ad3b-0af4d9571ae9 tempest-VolumesTransfersTest-778669855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:12:37 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-24058954-0a9c-4b1c-ad3b-0af4d9571ae9 tempest-VolumesTransfersTest-778669855 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:12:37 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-24058954-0a9c-4b1c-ad3b-0af4d9571ae9 tempest-VolumesTransfersTest-778669855 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:12:37 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-24058954-0a9c-4b1c-ad3b-0af4d9571ae9 tempest-VolumesTransfersTest-778669855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7c1f068b-26a7-40b1-9b25-425406f7753b 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:12:37 devstack sudo[97505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7c1f068b-26a7-40b1-9b25-425406f7753b 1073741824 Jul 10 10:12:37 devstack sudo[97505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:12:37 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-6fefa231-107d-4f26-8ce1-9133040a6e76 tempest-VolumesSnapshotTestJSON-197741556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ef70bf5-2295-433f-ac82-6c94b2825b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e62dc34-c8d8-46bf-8762-2a3b90de711d', 'volume_size': 1, 'snapshot_id': '23ed6dc4-b90d-4021-ba36-0c8d26832d53'}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:12:37 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-6fefa231-107d-4f26-8ce1-9133040a6e76 tempest-VolumesSnapshotTestJSON-197741556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa9f4168-bf41-44e2-aa74-146de8f70290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:12:37 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-6fefa231-107d-4f26-8ce1-9133040a6e76 tempest-VolumesSnapshotTestJSON-197741556 None] Volume volume-2e62dc34-c8d8-46bf-8762-2a3b90de711d (2e62dc34-c8d8-46bf-8762-2a3b90de711d): created successfully Jul 10 10:12:37 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-6fefa231-107d-4f26-8ce1-9133040a6e76 tempest-VolumesSnapshotTestJSON-197741556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa9f4168-bf41-44e2-aa74-146de8f70290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:12:37 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-6fefa231-107d-4f26-8ce1-9133040a6e76 tempest-VolumesSnapshotTestJSON-197741556 None] Flow 'volume_create_manager' (b75a4948-5973-43c7-86d0-96ba17945aaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:12:37 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-6fefa231-107d-4f26-8ce1-9133040a6e76 tempest-VolumesSnapshotTestJSON-197741556 None] Created volume successfully. Jul 10 10:12:38 devstack sudo[97505]: pam_unix(sudo:session): session closed for user root Jul 10 10:12:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-24058954-0a9c-4b1c-ad3b-0af4d9571ae9 tempest-VolumesTransfersTest-778669855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7c1f068b-26a7-40b1-9b25-425406f7753b 1073741824" returned: 0 in 1.136s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:12:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-24058954-0a9c-4b1c-ad3b-0af4d9571ae9 tempest-VolumesTransfersTest-778669855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7c1f068b-26a7-40b1-9b25-425406f7753b {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:12:38 devstack sudo[97514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7c1f068b-26a7-40b1-9b25-425406f7753b Jul 10 10:12:38 devstack sudo[97514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:12:38 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-65daeb91-f09f-41c7-98b9-722a85f71fed tempest-VolumesSnapshotTestJSON-197741556 None] Acquiring lock "cinder-2e62dc34-c8d8-46bf-8762-2a3b90de711d-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:12:38 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-65daeb91-f09f-41c7-98b9-722a85f71fed tempest-VolumesSnapshotTestJSON-197741556 None] Lock "cinder-2e62dc34-c8d8-46bf-8762-2a3b90de711d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:12:38 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-65daeb91-f09f-41c7-98b9-722a85f71fed tempest-VolumesSnapshotTestJSON-197741556 None] Acquiring lock "cinder-quobyte-2e62dc34-c8d8-46bf-8762-2a3b90de711d" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:12:38 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-65daeb91-f09f-41c7-98b9-722a85f71fed tempest-VolumesSnapshotTestJSON-197741556 None] Lock "cinder-quobyte-2e62dc34-c8d8-46bf-8762-2a3b90de711d" acquired by "delete_volume" :: waited 0.035s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:12:38 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa0a6604-beb0-48f3-9d7d-4d615508baae]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:12:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-65daeb91-f09f-41c7-98b9-722a85f71fed tempest-VolumesSnapshotTestJSON-197741556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2e62dc34-c8d8-46bf-8762-2a3b90de711d {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:12:39 devstack sudo[97517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2e62dc34-c8d8-46bf-8762-2a3b90de711d Jul 10 10:12:39 devstack sudo[97517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:12:39 devstack sudo[97514]: pam_unix(sudo:session): session closed for user root Jul 10 10:12:39 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-24058954-0a9c-4b1c-ad3b-0af4d9571ae9 tempest-VolumesTransfersTest-778669855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7c1f068b-26a7-40b1-9b25-425406f7753b" returned: 0 in 0.850s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:12:39 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-24058954-0a9c-4b1c-ad3b-0af4d9571ae9 tempest-VolumesTransfersTest-778669855 None] <== create_volume: return (2030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:12:39 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-24058954-0a9c-4b1c-ad3b-0af4d9571ae9 tempest-VolumesTransfersTest-778669855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.037s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:12:39 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-24058954-0a9c-4b1c-ad3b-0af4d9571ae9 tempest-VolumesTransfersTest-778669855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ee72f9a-a7e9-490e-826e-e338cd893ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c1f068b-26a7-40b1-9b25-425406f7753b', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:12:39 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-24058954-0a9c-4b1c-ad3b-0af4d9571ae9 tempest-VolumesTransfersTest-778669855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (704cd614-2b82-477e-8811-83126522f0e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:12:39 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-24058954-0a9c-4b1c-ad3b-0af4d9571ae9 tempest-VolumesTransfersTest-778669855 None] Volume volume-7c1f068b-26a7-40b1-9b25-425406f7753b (7c1f068b-26a7-40b1-9b25-425406f7753b): created successfully Jul 10 10:12:39 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-24058954-0a9c-4b1c-ad3b-0af4d9571ae9 tempest-VolumesTransfersTest-778669855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (704cd614-2b82-477e-8811-83126522f0e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:12:39 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-24058954-0a9c-4b1c-ad3b-0af4d9571ae9 tempest-VolumesTransfersTest-778669855 None] Flow 'volume_create_manager' (b377ee8d-c40d-4d6a-9a09-bc8f28cc3f68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:12:39 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-24058954-0a9c-4b1c-ad3b-0af4d9571ae9 tempest-VolumesTransfersTest-778669855 None] Created volume successfully. Jul 10 10:12:39 devstack sudo[97517]: pam_unix(sudo:session): session closed for user root Jul 10 10:12:39 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-65daeb91-f09f-41c7-98b9-722a85f71fed tempest-VolumesSnapshotTestJSON-197741556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2e62dc34-c8d8-46bf-8762-2a3b90de711d" returned: 0 in 0.874s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:12:39 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-65daeb91-f09f-41c7-98b9-722a85f71fed tempest-VolumesSnapshotTestJSON-197741556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2e62dc34-c8d8-46bf-8762-2a3b90de711d {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:12:39 devstack sudo[97523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2e62dc34-c8d8-46bf-8762-2a3b90de711d Jul 10 10:12:39 devstack sudo[97523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:12:40 devstack sudo[97523]: pam_unix(sudo:session): session closed for user root Jul 10 10:12:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-65daeb91-f09f-41c7-98b9-722a85f71fed tempest-VolumesSnapshotTestJSON-197741556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2e62dc34-c8d8-46bf-8762-2a3b90de711d" returned: 0 in 0.817s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:12:40 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-65daeb91-f09f-41c7-98b9-722a85f71fed tempest-VolumesSnapshotTestJSON-197741556 None] Lock "cinder-quobyte-2e62dc34-c8d8-46bf-8762-2a3b90de711d" released by "delete_volume" :: held 1.771s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:12:40 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-a1f56fcc-a5e2-49ce-87a5-43e83b38074d tempest-VolumesTransfersTest-1714419921 None] Transfer volume completed successfully. Jul 10 10:12:40 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-65daeb91-f09f-41c7-98b9-722a85f71fed tempest-VolumesSnapshotTestJSON-197741556 None] Created reservations ['3ca4cb3d-98c6-4dd3-82a2-0052e48d15a0', '9088da0d-cc2b-4c91-94e3-116963636d1d', '52b1e6ad-a583-435d-9b06-cf83cf86a767', '150e10c1-b64a-454e-9ffd-6f0bf9c68448'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:12:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-65daeb91-f09f-41c7-98b9-722a85f71fed tempest-VolumesSnapshotTestJSON-197741556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:12:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-65daeb91-f09f-41c7-98b9-722a85f71fed tempest-VolumesSnapshotTestJSON-197741556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:12:40 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-65daeb91-f09f-41c7-98b9-722a85f71fed tempest-VolumesSnapshotTestJSON-197741556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:12:40 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-65daeb91-f09f-41c7-98b9-722a85f71fed tempest-VolumesSnapshotTestJSON-197741556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:12:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-65daeb91-f09f-41c7-98b9-722a85f71fed tempest-VolumesSnapshotTestJSON-197741556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:12:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-65daeb91-f09f-41c7-98b9-722a85f71fed tempest-VolumesSnapshotTestJSON-197741556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:12:40 devstack sudo[97526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:12:40 devstack sudo[97526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:12:41 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-4bcc028b-0312-4a76-b6d7-0d737f120f42 tempest-VolumesSnapshotTestJSON-197741556 None] Acquiring lock "cinder-23ed6dc4-b90d-4021-ba36-0c8d26832d53-delete_snapshot" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:12:41 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-4bcc028b-0312-4a76-b6d7-0d737f120f42 tempest-VolumesSnapshotTestJSON-197741556 None] Lock "cinder-23ed6dc4-b90d-4021-ba36-0c8d26832d53-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:12:41 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-4bcc028b-0312-4a76-b6d7-0d737f120f42 tempest-VolumesSnapshotTestJSON-197741556 None] Acquiring lock "cinder-quobyte-9d32211e-ec83-4939-9511-94ac98b374b9" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:12:41 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-4bcc028b-0312-4a76-b6d7-0d737f120f42 tempest-VolumesSnapshotTestJSON-197741556 None] Lock "cinder-quobyte-9d32211e-ec83-4939-9511-94ac98b374b9" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:12:41 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-4bcc028b-0312-4a76-b6d7-0d737f120f42 tempest-VolumesSnapshotTestJSON-197741556 None] Acquiring lock "cinder-quobyte-23ed6dc4-b90d-4021-ba36-0c8d26832d53" by "_delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:12:41 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-4bcc028b-0312-4a76-b6d7-0d737f120f42 tempest-VolumesSnapshotTestJSON-197741556 None] Lock "cinder-quobyte-23ed6dc4-b90d-4021-ba36-0c8d26832d53" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:12:41 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-4bcc028b-0312-4a76-b6d7-0d737f120f42 tempest-VolumesSnapshotTestJSON-197741556 None] Deleting offline snapshot 23ed6dc4-b90d-4021-ba36-0c8d26832d53 of volume 9d32211e-ec83-4939-9511-94ac98b374b9 {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 10:12:41 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-4bcc028b-0312-4a76-b6d7-0d737f120f42 tempest-VolumesSnapshotTestJSON-197741556 None] snapshot_file for this snap is: volume-9d32211e-ec83-4939-9511-94ac98b374b9.23ed6dc4-b90d-4021-ba36-0c8d26832d53 {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 10:12:41 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[7732f30e-0e4a-4334-90f9-4eabd92cab8c]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:12:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4bcc028b-0312-4a76-b6d7-0d737f120f42 tempest-VolumesSnapshotTestJSON-197741556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-9d32211e-ec83-4939-9511-94ac98b374b9.23ed6dc4-b90d-4021-ba36-0c8d26832d53 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:12:41 devstack sudo[97528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-9d32211e-ec83-4939-9511-94ac98b374b9.23ed6dc4-b90d-4021-ba36-0c8d26832d53 Jul 10 10:12:41 devstack sudo[97528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:12:41 devstack sudo[97526]: pam_unix(sudo:session): session closed for user root Jul 10 10:12:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-65daeb91-f09f-41c7-98b9-722a85f71fed tempest-VolumesSnapshotTestJSON-197741556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.806s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:12:41 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-65daeb91-f09f-41c7-98b9-722a85f71fed tempest-VolumesSnapshotTestJSON-197741556 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:12:41 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-65daeb91-f09f-41c7-98b9-722a85f71fed tempest-VolumesSnapshotTestJSON-197741556 None] Deleted volume successfully. Jul 10 10:12:41 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-65daeb91-f09f-41c7-98b9-722a85f71fed tempest-VolumesSnapshotTestJSON-197741556 None] Lock "cinder-2e62dc34-c8d8-46bf-8762-2a3b90de711d-delete_volume" released by "delete_volume" :: held 2.843s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:12:41 devstack sudo[97528]: pam_unix(sudo:session): session closed for user root Jul 10 10:12:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4bcc028b-0312-4a76-b6d7-0d737f120f42 tempest-VolumesSnapshotTestJSON-197741556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-9d32211e-ec83-4939-9511-94ac98b374b9.23ed6dc4-b90d-4021-ba36-0c8d26832d53" returned: 0 in 0.856s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:12:41 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-4bcc028b-0312-4a76-b6d7-0d737f120f42 tempest-VolumesSnapshotTestJSON-197741556 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d32211e-ec83-4939-9511-94ac98b374b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 10:12:42 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f9d256-14cb-4266-b258-22eef4893075]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:12:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4bcc028b-0312-4a76-b6d7-0d737f120f42 tempest-VolumesSnapshotTestJSON-197741556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-9d32211e-ec83-4939-9511-94ac98b374b9 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:12:42 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-e703ffe6-cbe5-4561-9a8a-312d2e51a696 tempest-VolumesTransfersTest-1414702203 None] Acquiring lock "cinder-7c1f068b-26a7-40b1-9b25-425406f7753b-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:12:42 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-e703ffe6-cbe5-4561-9a8a-312d2e51a696 tempest-VolumesTransfersTest-1414702203 None] Lock "cinder-7c1f068b-26a7-40b1-9b25-425406f7753b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:12:42 devstack cinder-volume[87234]: DEBUG oslo_service.periodic_task [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 10:12:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:12:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:12:42 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:12:42 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:12:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:12:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:12:42 devstack sudo[97535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:12:42 devstack sudo[97535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:12:42 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-e703ffe6-cbe5-4561-9a8a-312d2e51a696 tempest-VolumesTransfersTest-1414702203 None] Acquiring lock "cinder-quobyte-7c1f068b-26a7-40b1-9b25-425406f7753b" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:12:42 devstack sudo[97534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-9d32211e-ec83-4939-9511-94ac98b374b9 Jul 10 10:12:42 devstack sudo[97534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:12:42 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-e703ffe6-cbe5-4561-9a8a-312d2e51a696 tempest-VolumesTransfersTest-1414702203 None] Lock "cinder-quobyte-7c1f068b-26a7-40b1-9b25-425406f7753b" acquired by "delete_volume" :: waited 0.030s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:12:42 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7916e90-8b03-43b3-8929-da2228754ff7]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:12:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e703ffe6-cbe5-4561-9a8a-312d2e51a696 tempest-VolumesTransfersTest-1414702203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7c1f068b-26a7-40b1-9b25-425406f7753b {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:12:42 devstack sudo[97538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7c1f068b-26a7-40b1-9b25-425406f7753b Jul 10 10:12:42 devstack sudo[97538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:12:43 devstack sudo[97535]: pam_unix(sudo:session): session closed for user root Jul 10 10:12:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.993s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:12:43 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:12:43 devstack cinder-volume[87234]: DEBUG oslo_service.periodic_task [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Running periodic task VolumeManager._thread_info {{(pid=87234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 10:12:43 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] thread count: 28 {{(pid=87234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 10:12:43 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] thread info: [<_MainThread(MainThread, started 131600773742720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 10:12:43 devstack sudo[97538]: pam_unix(sudo:session): session closed for user root Jul 10 10:12:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e703ffe6-cbe5-4561-9a8a-312d2e51a696 tempest-VolumesTransfersTest-1414702203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7c1f068b-26a7-40b1-9b25-425406f7753b" returned: 0 in 1.005s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:12:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e703ffe6-cbe5-4561-9a8a-312d2e51a696 tempest-VolumesTransfersTest-1414702203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7c1f068b-26a7-40b1-9b25-425406f7753b {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:12:43 devstack sudo[97547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7c1f068b-26a7-40b1-9b25-425406f7753b Jul 10 10:12:43 devstack sudo[97547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:12:43 devstack sudo[97534]: pam_unix(sudo:session): session closed for user root Jul 10 10:12:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4bcc028b-0312-4a76-b6d7-0d737f120f42 tempest-VolumesSnapshotTestJSON-197741556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-9d32211e-ec83-4939-9511-94ac98b374b9" returned: 0 in 1.338s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:12:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4bcc028b-0312-4a76-b6d7-0d737f120f42 tempest-VolumesSnapshotTestJSON-197741556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-9d32211e-ec83-4939-9511-94ac98b374b9.23ed6dc4-b90d-4021-ba36-0c8d26832d53 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:12:43 devstack sudo[97549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-9d32211e-ec83-4939-9511-94ac98b374b9.23ed6dc4-b90d-4021-ba36-0c8d26832d53 Jul 10 10:12:43 devstack sudo[97549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:12:44 devstack sudo[97547]: pam_unix(sudo:session): session closed for user root Jul 10 10:12:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e703ffe6-cbe5-4561-9a8a-312d2e51a696 tempest-VolumesTransfersTest-1414702203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7c1f068b-26a7-40b1-9b25-425406f7753b" returned: 0 in 0.834s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:12:44 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-e703ffe6-cbe5-4561-9a8a-312d2e51a696 tempest-VolumesTransfersTest-1414702203 None] Lock "cinder-quobyte-7c1f068b-26a7-40b1-9b25-425406f7753b" released by "delete_volume" :: held 1.909s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:12:44 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-e703ffe6-cbe5-4561-9a8a-312d2e51a696 tempest-VolumesTransfersTest-1414702203 None] Created reservations ['6b7717df-1d32-49dc-83f4-7bcd8aa6cc0a', 'e6ecf98e-51f9-48ff-9e94-22b1e746c022', 'fbbaa28e-e137-4c5f-b60d-42036eea93f7', 'dc792c33-5a2d-490f-aee4-be241036a9b2'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:12:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-e703ffe6-cbe5-4561-9a8a-312d2e51a696 tempest-VolumesTransfersTest-1414702203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:12:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-e703ffe6-cbe5-4561-9a8a-312d2e51a696 tempest-VolumesTransfersTest-1414702203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:12:44 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-e703ffe6-cbe5-4561-9a8a-312d2e51a696 tempest-VolumesTransfersTest-1414702203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:12:44 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-e703ffe6-cbe5-4561-9a8a-312d2e51a696 tempest-VolumesTransfersTest-1414702203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:12:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-e703ffe6-cbe5-4561-9a8a-312d2e51a696 tempest-VolumesTransfersTest-1414702203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:12:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e703ffe6-cbe5-4561-9a8a-312d2e51a696 tempest-VolumesTransfersTest-1414702203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:12:44 devstack sudo[97557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:12:44 devstack sudo[97557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:12:44 devstack sudo[97549]: pam_unix(sudo:session): session closed for user root Jul 10 10:12:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4bcc028b-0312-4a76-b6d7-0d737f120f42 tempest-VolumesSnapshotTestJSON-197741556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-9d32211e-ec83-4939-9511-94ac98b374b9.23ed6dc4-b90d-4021-ba36-0c8d26832d53" returned: 0 in 1.333s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:12:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4bcc028b-0312-4a76-b6d7-0d737f120f42 tempest-VolumesSnapshotTestJSON-197741556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-9d32211e-ec83-4939-9511-94ac98b374b9.23ed6dc4-b90d-4021-ba36-0c8d26832d53 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:12:44 devstack sudo[97562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-9d32211e-ec83-4939-9511-94ac98b374b9.23ed6dc4-b90d-4021-ba36-0c8d26832d53 Jul 10 10:12:44 devstack sudo[97562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:12:45 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-5638591b-4d13-4a1e-b889-b063bed7746d tempest-VolumesTransfersTest-778669855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:12:45 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5638591b-4d13-4a1e-b889-b063bed7746d tempest-VolumesTransfersTest-778669855 None] Flow 'volume_create_manager' (25cb76ad-b36e-4557-a4a5-3c8aa5c4a3d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:12:45 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5638591b-4d13-4a1e-b889-b063bed7746d tempest-VolumesTransfersTest-778669855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be9802fb-9d36-4ac0-b79a-132de6ac71ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:12:45 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5638591b-4d13-4a1e-b889-b063bed7746d tempest-VolumesTransfersTest-778669855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be9802fb-9d36-4ac0-b79a-132de6ac71ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:12:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1957690260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9f314a9-217d-4d8a-a6e1-2ae7d5d7ae25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e8ec92c5a8445329225cfbea823be86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:12:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:12:45Z,use_quota=True,user_id='106b71df6a7c44e085db07f735d86da4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:12:45 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5638591b-4d13-4a1e-b889-b063bed7746d tempest-VolumesTransfersTest-778669855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (683742f4-2107-4fe3-965f-96bbd14d6fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:12:45 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5638591b-4d13-4a1e-b889-b063bed7746d tempest-VolumesTransfersTest-778669855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (683742f4-2107-4fe3-965f-96bbd14d6fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:12:45 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5638591b-4d13-4a1e-b889-b063bed7746d tempest-VolumesTransfersTest-778669855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (951d301d-0280-4acb-97b1-8b97aa754397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:12:45 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5638591b-4d13-4a1e-b889-b063bed7746d tempest-VolumesTransfersTest-778669855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (951d301d-0280-4acb-97b1-8b97aa754397) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9f314a9-217d-4d8a-a6e1-2ae7d5d7ae25', 'volume_name': 'volume-e9f314a9-217d-4d8a-a6e1-2ae7d5d7ae25', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:12:45 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5638591b-4d13-4a1e-b889-b063bed7746d tempest-VolumesTransfersTest-778669855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3bb6c29-96ca-4731-9cf4-3a10e52cf24d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:12:45 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5638591b-4d13-4a1e-b889-b063bed7746d tempest-VolumesTransfersTest-778669855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3bb6c29-96ca-4731-9cf4-3a10e52cf24d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:12:45 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5638591b-4d13-4a1e-b889-b063bed7746d tempest-VolumesTransfersTest-778669855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (596e56d2-c959-4603-999a-a9d012652ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:12:45 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-5638591b-4d13-4a1e-b889-b063bed7746d tempest-VolumesTransfersTest-778669855 None] Volume e9f314a9-217d-4d8a-a6e1-2ae7d5d7ae25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9f314a9-217d-4d8a-a6e1-2ae7d5d7ae25', 'volume_size': 1} Jul 10 10:12:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-5638591b-4d13-4a1e-b889-b063bed7746d tempest-VolumesTransfersTest-778669855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:12:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-5638591b-4d13-4a1e-b889-b063bed7746d tempest-VolumesTransfersTest-778669855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:12:45 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-5638591b-4d13-4a1e-b889-b063bed7746d tempest-VolumesTransfersTest-778669855 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:12:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1957690260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9f314a9-217d-4d8a-a6e1-2ae7d5d7ae25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e8ec92c5a8445329225cfbea823be86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:12:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:12:45Z,use_quota=True,user_id='106b71df6a7c44e085db07f735d86da4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:12:45 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-5638591b-4d13-4a1e-b889-b063bed7746d tempest-VolumesTransfersTest-778669855 None] Creating volume e9f314a9-217d-4d8a-a6e1-2ae7d5d7ae25 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:12:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-5638591b-4d13-4a1e-b889-b063bed7746d tempest-VolumesTransfersTest-778669855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:12:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-5638591b-4d13-4a1e-b889-b063bed7746d tempest-VolumesTransfersTest-778669855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:12:45 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-5638591b-4d13-4a1e-b889-b063bed7746d tempest-VolumesTransfersTest-778669855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:12:45 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-5638591b-4d13-4a1e-b889-b063bed7746d tempest-VolumesTransfersTest-778669855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:12:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-5638591b-4d13-4a1e-b889-b063bed7746d tempest-VolumesTransfersTest-778669855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:12:45 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-5638591b-4d13-4a1e-b889-b063bed7746d tempest-VolumesTransfersTest-778669855 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:12:45 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-5638591b-4d13-4a1e-b889-b063bed7746d tempest-VolumesTransfersTest-778669855 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:12:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5638591b-4d13-4a1e-b889-b063bed7746d tempest-VolumesTransfersTest-778669855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e9f314a9-217d-4d8a-a6e1-2ae7d5d7ae25 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:12:45 devstack sudo[97574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e9f314a9-217d-4d8a-a6e1-2ae7d5d7ae25 1073741824 Jul 10 10:12:45 devstack sudo[97574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:12:45 devstack sudo[97557]: pam_unix(sudo:session): session closed for user root Jul 10 10:12:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e703ffe6-cbe5-4561-9a8a-312d2e51a696 tempest-VolumesTransfersTest-1414702203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 1.220s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:12:45 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-e703ffe6-cbe5-4561-9a8a-312d2e51a696 tempest-VolumesTransfersTest-1414702203 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:12:45 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-e703ffe6-cbe5-4561-9a8a-312d2e51a696 tempest-VolumesTransfersTest-1414702203 None] Deleted volume successfully. Jul 10 10:12:45 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-e703ffe6-cbe5-4561-9a8a-312d2e51a696 tempest-VolumesTransfersTest-1414702203 None] Lock "cinder-7c1f068b-26a7-40b1-9b25-425406f7753b-delete_volume" released by "delete_volume" :: held 3.545s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:12:45 devstack sudo[97562]: pam_unix(sudo:session): session closed for user root Jul 10 10:12:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4bcc028b-0312-4a76-b6d7-0d737f120f42 tempest-VolumesSnapshotTestJSON-197741556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-9d32211e-ec83-4939-9511-94ac98b374b9.23ed6dc4-b90d-4021-ba36-0c8d26832d53" returned: 0 in 1.292s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:12:46 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-4bcc028b-0312-4a76-b6d7-0d737f120f42 tempest-VolumesSnapshotTestJSON-197741556 None] Lock "cinder-quobyte-23ed6dc4-b90d-4021-ba36-0c8d26832d53" released by "_delete_snapshot" :: held 4.947s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:12:46 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-4bcc028b-0312-4a76-b6d7-0d737f120f42 tempest-VolumesSnapshotTestJSON-197741556 None] Lock "cinder-quobyte-9d32211e-ec83-4939-9511-94ac98b374b9" released by "delete_snapshot" :: held 4.973s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:12:46 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-4bcc028b-0312-4a76-b6d7-0d737f120f42 tempest-VolumesSnapshotTestJSON-197741556 None] Created reservations ['a59b8020-e5ee-408a-a957-69571e9b6dda', '609f256e-3e2e-4390-8bf7-e74cdcde7b56', 'b9031296-df61-4af8-a21a-a7f7a9e2ee91', '79e69f22-79a1-4e5f-8093-c1fb4d143b42'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:12:46 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-4bcc028b-0312-4a76-b6d7-0d737f120f42 tempest-VolumesSnapshotTestJSON-197741556 None] Delete snapshot completed successfully. Jul 10 10:12:46 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-4bcc028b-0312-4a76-b6d7-0d737f120f42 tempest-VolumesSnapshotTestJSON-197741556 None] Lock "cinder-23ed6dc4-b90d-4021-ba36-0c8d26832d53-delete_snapshot" released by "delete_snapshot" :: held 5.178s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:12:46 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-ae4ca3cc-b642-43a1-ae4d-d32fd2871a55 tempest-VolumesSnapshotTestJSON-197741556 None] Acquiring lock "cinder-9d32211e-ec83-4939-9511-94ac98b374b9-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:12:46 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-ae4ca3cc-b642-43a1-ae4d-d32fd2871a55 tempest-VolumesSnapshotTestJSON-197741556 None] Lock "cinder-9d32211e-ec83-4939-9511-94ac98b374b9-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:12:46 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-ae4ca3cc-b642-43a1-ae4d-d32fd2871a55 tempest-VolumesSnapshotTestJSON-197741556 None] Acquiring lock "cinder-quobyte-9d32211e-ec83-4939-9511-94ac98b374b9" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:12:46 devstack sudo[97574]: pam_unix(sudo:session): session closed for user root Jul 10 10:12:46 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-ae4ca3cc-b642-43a1-ae4d-d32fd2871a55 tempest-VolumesSnapshotTestJSON-197741556 None] Lock "cinder-quobyte-9d32211e-ec83-4939-9511-94ac98b374b9" acquired by "delete_volume" :: waited 0.019s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:12:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5638591b-4d13-4a1e-b889-b063bed7746d tempest-VolumesTransfersTest-778669855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e9f314a9-217d-4d8a-a6e1-2ae7d5d7ae25 1073741824" returned: 0 in 1.264s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:12:46 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b53d6a-686c-43b2-9ae9-279c04810ed7]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:12:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ae4ca3cc-b642-43a1-ae4d-d32fd2871a55 tempest-VolumesSnapshotTestJSON-197741556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-9d32211e-ec83-4939-9511-94ac98b374b9 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:12:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5638591b-4d13-4a1e-b889-b063bed7746d tempest-VolumesTransfersTest-778669855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e9f314a9-217d-4d8a-a6e1-2ae7d5d7ae25 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:12:46 devstack sudo[97588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e9f314a9-217d-4d8a-a6e1-2ae7d5d7ae25 Jul 10 10:12:46 devstack sudo[97588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:12:46 devstack sudo[97587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-9d32211e-ec83-4939-9511-94ac98b374b9 Jul 10 10:12:46 devstack sudo[97587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:12:47 devstack sudo[97588]: pam_unix(sudo:session): session closed for user root Jul 10 10:12:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5638591b-4d13-4a1e-b889-b063bed7746d tempest-VolumesTransfersTest-778669855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e9f314a9-217d-4d8a-a6e1-2ae7d5d7ae25" returned: 0 in 0.881s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:12:47 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-5638591b-4d13-4a1e-b889-b063bed7746d tempest-VolumesTransfersTest-778669855 None] <== create_volume: return (2222ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:12:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-5638591b-4d13-4a1e-b889-b063bed7746d tempest-VolumesTransfersTest-778669855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.229s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:12:47 devstack sudo[97587]: pam_unix(sudo:session): session closed for user root Jul 10 10:12:47 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5638591b-4d13-4a1e-b889-b063bed7746d tempest-VolumesTransfersTest-778669855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (596e56d2-c959-4603-999a-a9d012652ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9f314a9-217d-4d8a-a6e1-2ae7d5d7ae25', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:12:47 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5638591b-4d13-4a1e-b889-b063bed7746d tempest-VolumesTransfersTest-778669855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94a48de1-de20-4e12-9c73-4160b28864f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:12:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ae4ca3cc-b642-43a1-ae4d-d32fd2871a55 tempest-VolumesSnapshotTestJSON-197741556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-9d32211e-ec83-4939-9511-94ac98b374b9" returned: 0 in 0.954s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:12:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ae4ca3cc-b642-43a1-ae4d-d32fd2871a55 tempest-VolumesSnapshotTestJSON-197741556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-9d32211e-ec83-4939-9511-94ac98b374b9 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:12:47 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-5638591b-4d13-4a1e-b889-b063bed7746d tempest-VolumesTransfersTest-778669855 None] Volume volume-e9f314a9-217d-4d8a-a6e1-2ae7d5d7ae25 (e9f314a9-217d-4d8a-a6e1-2ae7d5d7ae25): created successfully Jul 10 10:12:47 devstack sudo[97596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-9d32211e-ec83-4939-9511-94ac98b374b9 Jul 10 10:12:47 devstack sudo[97596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:12:47 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5638591b-4d13-4a1e-b889-b063bed7746d tempest-VolumesTransfersTest-778669855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94a48de1-de20-4e12-9c73-4160b28864f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:12:47 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5638591b-4d13-4a1e-b889-b063bed7746d tempest-VolumesTransfersTest-778669855 None] Flow 'volume_create_manager' (25cb76ad-b36e-4557-a4a5-3c8aa5c4a3d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:12:47 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-5638591b-4d13-4a1e-b889-b063bed7746d tempest-VolumesTransfersTest-778669855 None] Created volume successfully. Jul 10 10:12:48 devstack sudo[97596]: pam_unix(sudo:session): session closed for user root Jul 10 10:12:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ae4ca3cc-b642-43a1-ae4d-d32fd2871a55 tempest-VolumesSnapshotTestJSON-197741556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-9d32211e-ec83-4939-9511-94ac98b374b9" returned: 0 in 0.696s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:12:48 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-ae4ca3cc-b642-43a1-ae4d-d32fd2871a55 tempest-VolumesSnapshotTestJSON-197741556 None] Lock "cinder-quobyte-9d32211e-ec83-4939-9511-94ac98b374b9" released by "delete_volume" :: held 1.730s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:12:48 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-ae4ca3cc-b642-43a1-ae4d-d32fd2871a55 tempest-VolumesSnapshotTestJSON-197741556 None] Created reservations ['c27db875-c681-486e-9138-f8dc9bfe6a36', '1956bb21-e14b-4428-9142-101a77423be6', '8104c1a9-5181-4749-beba-e3ce254514b8', '0afa18f0-6455-4600-8ec0-e179e208ca5d'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:12:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-ae4ca3cc-b642-43a1-ae4d-d32fd2871a55 tempest-VolumesSnapshotTestJSON-197741556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:12:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-ae4ca3cc-b642-43a1-ae4d-d32fd2871a55 tempest-VolumesSnapshotTestJSON-197741556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:12:48 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-ae4ca3cc-b642-43a1-ae4d-d32fd2871a55 tempest-VolumesSnapshotTestJSON-197741556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:12:48 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-ae4ca3cc-b642-43a1-ae4d-d32fd2871a55 tempest-VolumesSnapshotTestJSON-197741556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:12:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-ae4ca3cc-b642-43a1-ae4d-d32fd2871a55 tempest-VolumesSnapshotTestJSON-197741556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.051s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:12:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ae4ca3cc-b642-43a1-ae4d-d32fd2871a55 tempest-VolumesSnapshotTestJSON-197741556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:12:48 devstack sudo[97625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:12:48 devstack sudo[97625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:12:48 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-369b48be-ba83-4bf4-ba57-8c9f19630074 tempest-VolumesSnapshotTestJSON-197741556 None] Acquiring lock "cinder-ba142020-ef9e-4ae9-86d2-5377e7060492-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:12:49 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-369b48be-ba83-4bf4-ba57-8c9f19630074 tempest-VolumesSnapshotTestJSON-197741556 None] Lock "cinder-ba142020-ef9e-4ae9-86d2-5377e7060492-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:12:49 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-d689535c-1713-436c-94ec-e452a5722323 tempest-VolumesTransfersTest-1414702203 None] Acquiring lock "cinder-e9f314a9-217d-4d8a-a6e1-2ae7d5d7ae25-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:12:49 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-d689535c-1713-436c-94ec-e452a5722323 tempest-VolumesTransfersTest-1414702203 None] Lock "cinder-e9f314a9-217d-4d8a-a6e1-2ae7d5d7ae25-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:12:49 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-369b48be-ba83-4bf4-ba57-8c9f19630074 tempest-VolumesSnapshotTestJSON-197741556 None] Acquiring lock "cinder-quobyte-ba142020-ef9e-4ae9-86d2-5377e7060492" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:12:49 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-369b48be-ba83-4bf4-ba57-8c9f19630074 tempest-VolumesSnapshotTestJSON-197741556 None] Lock "cinder-quobyte-ba142020-ef9e-4ae9-86d2-5377e7060492" acquired by "delete_volume" :: waited 0.029s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:12:49 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[c71bef06-a975-44eb-8f05-6c1e8e538d03]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:12:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-369b48be-ba83-4bf4-ba57-8c9f19630074 tempest-VolumesSnapshotTestJSON-197741556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ba142020-ef9e-4ae9-86d2-5377e7060492 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:12:49 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-d689535c-1713-436c-94ec-e452a5722323 tempest-VolumesTransfersTest-1414702203 None] Acquiring lock "cinder-quobyte-e9f314a9-217d-4d8a-a6e1-2ae7d5d7ae25" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:12:49 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-d689535c-1713-436c-94ec-e452a5722323 tempest-VolumesTransfersTest-1414702203 None] Lock "cinder-quobyte-e9f314a9-217d-4d8a-a6e1-2ae7d5d7ae25" acquired by "delete_volume" :: waited 0.032s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:12:49 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[387aceb2-8813-4a68-874f-1a0fe0d5a97f]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:12:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-d689535c-1713-436c-94ec-e452a5722323 tempest-VolumesTransfersTest-1414702203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e9f314a9-217d-4d8a-a6e1-2ae7d5d7ae25 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:12:49 devstack sudo[97627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ba142020-ef9e-4ae9-86d2-5377e7060492 Jul 10 10:12:49 devstack sudo[97627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:12:49 devstack sudo[97631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e9f314a9-217d-4d8a-a6e1-2ae7d5d7ae25 Jul 10 10:12:49 devstack sudo[97631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:12:49 devstack sudo[97625]: pam_unix(sudo:session): session closed for user root Jul 10 10:12:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ae4ca3cc-b642-43a1-ae4d-d32fd2871a55 tempest-VolumesSnapshotTestJSON-197741556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 1.050s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:12:49 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-ae4ca3cc-b642-43a1-ae4d-d32fd2871a55 tempest-VolumesSnapshotTestJSON-197741556 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:12:49 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-ae4ca3cc-b642-43a1-ae4d-d32fd2871a55 tempest-VolumesSnapshotTestJSON-197741556 None] Deleted volume successfully. Jul 10 10:12:49 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-ae4ca3cc-b642-43a1-ae4d-d32fd2871a55 tempest-VolumesSnapshotTestJSON-197741556 None] Lock "cinder-9d32211e-ec83-4939-9511-94ac98b374b9-delete_volume" released by "delete_volume" :: held 3.148s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:12:50 devstack sudo[97631]: pam_unix(sudo:session): session closed for user root Jul 10 10:12:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-d689535c-1713-436c-94ec-e452a5722323 tempest-VolumesTransfersTest-1414702203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e9f314a9-217d-4d8a-a6e1-2ae7d5d7ae25" returned: 0 in 1.327s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:12:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-d689535c-1713-436c-94ec-e452a5722323 tempest-VolumesTransfersTest-1414702203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e9f314a9-217d-4d8a-a6e1-2ae7d5d7ae25 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:12:50 devstack sudo[97660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e9f314a9-217d-4d8a-a6e1-2ae7d5d7ae25 Jul 10 10:12:50 devstack sudo[97660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:12:50 devstack sudo[97627]: pam_unix(sudo:session): session closed for user root Jul 10 10:12:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-369b48be-ba83-4bf4-ba57-8c9f19630074 tempest-VolumesSnapshotTestJSON-197741556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ba142020-ef9e-4ae9-86d2-5377e7060492" returned: 0 in 1.512s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:12:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-369b48be-ba83-4bf4-ba57-8c9f19630074 tempest-VolumesSnapshotTestJSON-197741556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ba142020-ef9e-4ae9-86d2-5377e7060492 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:12:50 devstack sudo[97662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ba142020-ef9e-4ae9-86d2-5377e7060492 Jul 10 10:12:50 devstack sudo[97662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:12:51 devstack sudo[97660]: pam_unix(sudo:session): session closed for user root Jul 10 10:12:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-d689535c-1713-436c-94ec-e452a5722323 tempest-VolumesTransfersTest-1414702203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e9f314a9-217d-4d8a-a6e1-2ae7d5d7ae25" returned: 0 in 1.048s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:12:51 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-d689535c-1713-436c-94ec-e452a5722323 tempest-VolumesTransfersTest-1414702203 None] Lock "cinder-quobyte-e9f314a9-217d-4d8a-a6e1-2ae7d5d7ae25" released by "delete_volume" :: held 2.462s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:12:51 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-d689535c-1713-436c-94ec-e452a5722323 tempest-VolumesTransfersTest-1414702203 None] Created reservations ['b7e8dcfa-d6a7-4b3e-a861-937f4ca95467', '7e6b3124-8e1c-406f-b23c-2689f0d26209', '7bbf8cb6-632c-424f-9711-736a66ffba74', '43ba9198-7311-453a-8d3f-ea61daf707de'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:12:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-d689535c-1713-436c-94ec-e452a5722323 tempest-VolumesTransfersTest-1414702203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:12:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-d689535c-1713-436c-94ec-e452a5722323 tempest-VolumesTransfersTest-1414702203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:12:51 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-d689535c-1713-436c-94ec-e452a5722323 tempest-VolumesTransfersTest-1414702203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:12:51 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-d689535c-1713-436c-94ec-e452a5722323 tempest-VolumesTransfersTest-1414702203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:12:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-d689535c-1713-436c-94ec-e452a5722323 tempest-VolumesTransfersTest-1414702203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:12:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-d689535c-1713-436c-94ec-e452a5722323 tempest-VolumesTransfersTest-1414702203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:12:51 devstack sudo[97662]: pam_unix(sudo:session): session closed for user root Jul 10 10:12:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-369b48be-ba83-4bf4-ba57-8c9f19630074 tempest-VolumesSnapshotTestJSON-197741556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ba142020-ef9e-4ae9-86d2-5377e7060492" returned: 0 in 1.276s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:12:52 devstack sudo[97686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:12:52 devstack sudo[97686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:12:52 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-369b48be-ba83-4bf4-ba57-8c9f19630074 tempest-VolumesSnapshotTestJSON-197741556 None] Lock "cinder-quobyte-ba142020-ef9e-4ae9-86d2-5377e7060492" released by "delete_volume" :: held 2.893s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:12:52 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-369b48be-ba83-4bf4-ba57-8c9f19630074 tempest-VolumesSnapshotTestJSON-197741556 None] Created reservations ['cb032402-7bf7-4c1d-9ace-1c59b410e578', '49321999-0469-45ef-8b09-15d42c343eb5', '5312950a-07ec-48dc-a978-d5589f06bd37', 'b6cdb6a1-fb7b-43eb-8dd7-66001d11938f'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:12:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-369b48be-ba83-4bf4-ba57-8c9f19630074 tempest-VolumesSnapshotTestJSON-197741556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:12:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-369b48be-ba83-4bf4-ba57-8c9f19630074 tempest-VolumesSnapshotTestJSON-197741556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:12:52 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-369b48be-ba83-4bf4-ba57-8c9f19630074 tempest-VolumesSnapshotTestJSON-197741556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:12:52 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-369b48be-ba83-4bf4-ba57-8c9f19630074 tempest-VolumesSnapshotTestJSON-197741556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:12:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-369b48be-ba83-4bf4-ba57-8c9f19630074 tempest-VolumesSnapshotTestJSON-197741556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:12:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-369b48be-ba83-4bf4-ba57-8c9f19630074 tempest-VolumesSnapshotTestJSON-197741556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:12:52 devstack sudo[97688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:12:52 devstack sudo[97688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:12:53 devstack sudo[97688]: pam_unix(sudo:session): session closed for user root Jul 10 10:12:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-369b48be-ba83-4bf4-ba57-8c9f19630074 tempest-VolumesSnapshotTestJSON-197741556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 1.287s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:12:53 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-369b48be-ba83-4bf4-ba57-8c9f19630074 tempest-VolumesSnapshotTestJSON-197741556 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:12:53 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-369b48be-ba83-4bf4-ba57-8c9f19630074 tempest-VolumesSnapshotTestJSON-197741556 None] Deleted volume successfully. Jul 10 10:12:53 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-369b48be-ba83-4bf4-ba57-8c9f19630074 tempest-VolumesSnapshotTestJSON-197741556 None] Lock "cinder-ba142020-ef9e-4ae9-86d2-5377e7060492-delete_volume" released by "delete_volume" :: held 4.545s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:12:53 devstack sudo[97686]: pam_unix(sudo:session): session closed for user root Jul 10 10:12:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-d689535c-1713-436c-94ec-e452a5722323 tempest-VolumesTransfersTest-1414702203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 1.762s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:12:53 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-d689535c-1713-436c-94ec-e452a5722323 tempest-VolumesTransfersTest-1414702203 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:12:53 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-d689535c-1713-436c-94ec-e452a5722323 tempest-VolumesTransfersTest-1414702203 None] Deleted volume successfully. Jul 10 10:12:53 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-d689535c-1713-436c-94ec-e452a5722323 tempest-VolumesTransfersTest-1414702203 None] Lock "cinder-e9f314a9-217d-4d8a-a6e1-2ae7d5d7ae25-delete_volume" released by "delete_volume" :: held 4.691s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:13:03 devstack cinder-volume[87234]: DEBUG dbcounter [-] [87234] Writing DB stats cinder:UPDATE=114,cinder:DELETE=11,cinder:SELECT=84,cinder:INSERT=24 {{(pid=87234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 10:13:03 devstack cinder-volume[87234]: DEBUG dbcounter [-] [87234] Writing DB stats cinder:SELECT=94,cinder:UPDATE=119,cinder:INSERT=33,cinder:DELETE=7 {{(pid=87234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 10:13:07 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a365481-11cd-4883-8b54-a34571e3e2bd tempest-VolumesTransfersV355Test-1976305099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:13:07 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-0a365481-11cd-4883-8b54-a34571e3e2bd tempest-VolumesTransfersV355Test-1976305099 None] Flow 'volume_create_manager' (14cc87aa-e59a-4bd6-a2e7-cc81442489fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:13:07 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-0a365481-11cd-4883-8b54-a34571e3e2bd tempest-VolumesTransfersV355Test-1976305099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e46c724-4d4f-4906-8b22-4689ec9eee69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:13:07 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-0a365481-11cd-4883-8b54-a34571e3e2bd tempest-VolumesTransfersV355Test-1976305099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e46c724-4d4f-4906-8b22-4689ec9eee69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:13:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-481864311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51f267d2-615e-4f5c-888b-540b17f53c3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffe372d26f124e57bdf1bdfe5e8dee9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:13:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:13:07Z,use_quota=True,user_id='285d476455c042cb8986bdcb9ada68f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:13:07 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-0a365481-11cd-4883-8b54-a34571e3e2bd tempest-VolumesTransfersV355Test-1976305099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (221d96ad-d12d-41b1-9d7f-3783731ca54e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:13:07 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-0a365481-11cd-4883-8b54-a34571e3e2bd tempest-VolumesTransfersV355Test-1976305099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (221d96ad-d12d-41b1-9d7f-3783731ca54e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:13:07 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-0a365481-11cd-4883-8b54-a34571e3e2bd tempest-VolumesTransfersV355Test-1976305099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be2769ac-4bd4-4a73-bb75-09de54da7e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:13:07 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-0a365481-11cd-4883-8b54-a34571e3e2bd tempest-VolumesTransfersV355Test-1976305099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be2769ac-4bd4-4a73-bb75-09de54da7e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51f267d2-615e-4f5c-888b-540b17f53c3b', 'volume_name': 'volume-51f267d2-615e-4f5c-888b-540b17f53c3b', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:13:07 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-0a365481-11cd-4883-8b54-a34571e3e2bd tempest-VolumesTransfersV355Test-1976305099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0d29818-8169-4c5a-a2c4-4b5102b9c11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:13:07 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-0a365481-11cd-4883-8b54-a34571e3e2bd tempest-VolumesTransfersV355Test-1976305099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0d29818-8169-4c5a-a2c4-4b5102b9c11a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:13:07 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-0a365481-11cd-4883-8b54-a34571e3e2bd tempest-VolumesTransfersV355Test-1976305099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b5197b1-ff97-4cbb-97ff-ea243c4b2729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:13:07 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-0a365481-11cd-4883-8b54-a34571e3e2bd tempest-VolumesTransfersV355Test-1976305099 None] Volume 51f267d2-615e-4f5c-888b-540b17f53c3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51f267d2-615e-4f5c-888b-540b17f53c3b', 'volume_size': 1} Jul 10 10:13:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-0a365481-11cd-4883-8b54-a34571e3e2bd tempest-VolumesTransfersV355Test-1976305099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:13:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-0a365481-11cd-4883-8b54-a34571e3e2bd tempest-VolumesTransfersV355Test-1976305099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:13:07 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-0a365481-11cd-4883-8b54-a34571e3e2bd tempest-VolumesTransfersV355Test-1976305099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:13:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-481864311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51f267d2-615e-4f5c-888b-540b17f53c3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffe372d26f124e57bdf1bdfe5e8dee9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:13:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:13:07Z,use_quota=True,user_id='285d476455c042cb8986bdcb9ada68f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:13:07 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-0a365481-11cd-4883-8b54-a34571e3e2bd tempest-VolumesTransfersV355Test-1976305099 None] Creating volume 51f267d2-615e-4f5c-888b-540b17f53c3b {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:13:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-0a365481-11cd-4883-8b54-a34571e3e2bd tempest-VolumesTransfersV355Test-1976305099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:13:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-0a365481-11cd-4883-8b54-a34571e3e2bd tempest-VolumesTransfersV355Test-1976305099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:13:07 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-0a365481-11cd-4883-8b54-a34571e3e2bd tempest-VolumesTransfersV355Test-1976305099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:13:07 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-0a365481-11cd-4883-8b54-a34571e3e2bd tempest-VolumesTransfersV355Test-1976305099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:13:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-0a365481-11cd-4883-8b54-a34571e3e2bd tempest-VolumesTransfersV355Test-1976305099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:13:07 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-0a365481-11cd-4883-8b54-a34571e3e2bd tempest-VolumesTransfersV355Test-1976305099 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:13:07 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-0a365481-11cd-4883-8b54-a34571e3e2bd tempest-VolumesTransfersV355Test-1976305099 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:13:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0a365481-11cd-4883-8b54-a34571e3e2bd tempest-VolumesTransfersV355Test-1976305099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-51f267d2-615e-4f5c-888b-540b17f53c3b 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:13:07 devstack sudo[97739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-51f267d2-615e-4f5c-888b-540b17f53c3b 1073741824 Jul 10 10:13:07 devstack sudo[97739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:13:08 devstack sudo[97739]: pam_unix(sudo:session): session closed for user root Jul 10 10:13:08 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0a365481-11cd-4883-8b54-a34571e3e2bd tempest-VolumesTransfersV355Test-1976305099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-51f267d2-615e-4f5c-888b-540b17f53c3b 1073741824" returned: 0 in 1.022s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:13:08 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0a365481-11cd-4883-8b54-a34571e3e2bd tempest-VolumesTransfersV355Test-1976305099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-51f267d2-615e-4f5c-888b-540b17f53c3b {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:13:08 devstack sudo[97745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-51f267d2-615e-4f5c-888b-540b17f53c3b Jul 10 10:13:08 devstack sudo[97745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:13:09 devstack sudo[97745]: pam_unix(sudo:session): session closed for user root Jul 10 10:13:09 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0a365481-11cd-4883-8b54-a34571e3e2bd tempest-VolumesTransfersV355Test-1976305099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-51f267d2-615e-4f5c-888b-540b17f53c3b" returned: 0 in 0.794s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:13:09 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-0a365481-11cd-4883-8b54-a34571e3e2bd tempest-VolumesTransfersV355Test-1976305099 None] <== create_volume: return (1866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:13:09 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-0a365481-11cd-4883-8b54-a34571e3e2bd tempest-VolumesTransfersV355Test-1976305099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.873s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:13:09 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-0a365481-11cd-4883-8b54-a34571e3e2bd tempest-VolumesTransfersV355Test-1976305099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b5197b1-ff97-4cbb-97ff-ea243c4b2729) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51f267d2-615e-4f5c-888b-540b17f53c3b', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:13:09 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-0a365481-11cd-4883-8b54-a34571e3e2bd tempest-VolumesTransfersV355Test-1976305099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2450f45-f6da-487b-b2ee-7ff71d05fbb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:13:09 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-0a365481-11cd-4883-8b54-a34571e3e2bd tempest-VolumesTransfersV355Test-1976305099 None] Volume volume-51f267d2-615e-4f5c-888b-540b17f53c3b (51f267d2-615e-4f5c-888b-540b17f53c3b): created successfully Jul 10 10:13:09 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-0a365481-11cd-4883-8b54-a34571e3e2bd tempest-VolumesTransfersV355Test-1976305099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2450f45-f6da-487b-b2ee-7ff71d05fbb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:13:09 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-0a365481-11cd-4883-8b54-a34571e3e2bd tempest-VolumesTransfersV355Test-1976305099 None] Flow 'volume_create_manager' (14cc87aa-e59a-4bd6-a2e7-cc81442489fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:13:09 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-0a365481-11cd-4883-8b54-a34571e3e2bd tempest-VolumesTransfersV355Test-1976305099 None] Created volume successfully. Jul 10 10:13:10 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3f064ed-f8ae-40c2-9179-f7a6a3f46445 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:13:10 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-d3f064ed-f8ae-40c2-9179-f7a6a3f46445 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Flow 'volume_create_manager' (727152de-7332-4cf5-98b4-fa296785f701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:13:10 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-d3f064ed-f8ae-40c2-9179-f7a6a3f46445 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83a0d2cd-54ad-4e75-8ba5-7f2a0c5b51c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:13:10 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-d3f064ed-f8ae-40c2-9179-f7a6a3f46445 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83a0d2cd-54ad-4e75-8ba5-7f2a0c5b51c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-712375010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffaeaff6-8169-48c7-a10e-9884afcdc748,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c63c388de6144c5a6e1a03934533111',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:13:10Z,use_quota=True,user_id='1af9541840f84a4d9db466c2cd8d9ca1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:13:10 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-d3f064ed-f8ae-40c2-9179-f7a6a3f46445 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b796fdbd-0860-41da-bc05-860832ea59d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:13:10 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-d3f064ed-f8ae-40c2-9179-f7a6a3f46445 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b796fdbd-0860-41da-bc05-860832ea59d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:13:10 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-d3f064ed-f8ae-40c2-9179-f7a6a3f46445 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b08d625a-7a63-4281-a331-9aebe4537003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:13:10 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-d3f064ed-f8ae-40c2-9179-f7a6a3f46445 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b08d625a-7a63-4281-a331-9aebe4537003) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffaeaff6-8169-48c7-a10e-9884afcdc748', 'volume_name': 'volume-ffaeaff6-8169-48c7-a10e-9884afcdc748', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:13:10 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-d3f064ed-f8ae-40c2-9179-f7a6a3f46445 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a69f5d80-2ceb-45fb-bd72-f4491a9f317e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:13:10 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-d3f064ed-f8ae-40c2-9179-f7a6a3f46445 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a69f5d80-2ceb-45fb-bd72-f4491a9f317e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:13:10 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-d3f064ed-f8ae-40c2-9179-f7a6a3f46445 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (444d5a7b-e076-44a1-a2dd-e6ff20ad80a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:13:10 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-d3f064ed-f8ae-40c2-9179-f7a6a3f46445 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Volume ffaeaff6-8169-48c7-a10e-9884afcdc748: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffaeaff6-8169-48c7-a10e-9884afcdc748', 'volume_size': 1} Jul 10 10:13:10 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-d3f064ed-f8ae-40c2-9179-f7a6a3f46445 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:13:10 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-d3f064ed-f8ae-40c2-9179-f7a6a3f46445 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:13:10 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-d3f064ed-f8ae-40c2-9179-f7a6a3f46445 tempest-TestServerVolumeAttachmentScenario-2059541924 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-712375010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffaeaff6-8169-48c7-a10e-9884afcdc748,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c63c388de6144c5a6e1a03934533111',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:13:10Z,use_quota=True,user_id='1af9541840f84a4d9db466c2cd8d9ca1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:13:10 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-d3f064ed-f8ae-40c2-9179-f7a6a3f46445 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Creating volume ffaeaff6-8169-48c7-a10e-9884afcdc748 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:13:10 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-d3f064ed-f8ae-40c2-9179-f7a6a3f46445 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:13:10 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-d3f064ed-f8ae-40c2-9179-f7a6a3f46445 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:13:10 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-d3f064ed-f8ae-40c2-9179-f7a6a3f46445 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:13:10 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-d3f064ed-f8ae-40c2-9179-f7a6a3f46445 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:13:10 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-d3f064ed-f8ae-40c2-9179-f7a6a3f46445 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:13:10 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-d3f064ed-f8ae-40c2-9179-f7a6a3f46445 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:13:10 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-d3f064ed-f8ae-40c2-9179-f7a6a3f46445 tempest-TestServerVolumeAttachmentScenario-2059541924 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:13:10 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-d3f064ed-f8ae-40c2-9179-f7a6a3f46445 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ffaeaff6-8169-48c7-a10e-9884afcdc748 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:13:10 devstack sudo[97749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ffaeaff6-8169-48c7-a10e-9884afcdc748 1073741824 Jul 10 10:13:10 devstack sudo[97749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:13:11 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5182f95-c843-4348-b0bc-ed20c7048448 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:13:11 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c5182f95-c843-4348-b0bc-ed20c7048448 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Flow 'volume_create_manager' (d9075697-13a3-44a4-9816-c73e20e4b548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:13:11 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c5182f95-c843-4348-b0bc-ed20c7048448 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6146c033-c98a-4dea-b4c2-3f6930b158f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:13:11 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c5182f95-c843-4348-b0bc-ed20c7048448 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6146c033-c98a-4dea-b4c2-3f6930b158f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1476925677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b21371e9-f11a-4ebc-99ab-1fbd85172fe6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c63c388de6144c5a6e1a03934533111',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:13:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:13:11Z,use_quota=True,user_id='1af9541840f84a4d9db466c2cd8d9ca1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:13:11 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c5182f95-c843-4348-b0bc-ed20c7048448 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62fa982c-dc09-4445-a7f2-8332c0e9c6bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:13:11 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c5182f95-c843-4348-b0bc-ed20c7048448 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62fa982c-dc09-4445-a7f2-8332c0e9c6bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:13:11 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c5182f95-c843-4348-b0bc-ed20c7048448 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1d73383-e926-4036-a1ab-3449267cbd2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:13:11 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c5182f95-c843-4348-b0bc-ed20c7048448 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1d73383-e926-4036-a1ab-3449267cbd2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b21371e9-f11a-4ebc-99ab-1fbd85172fe6', 'volume_name': 'volume-b21371e9-f11a-4ebc-99ab-1fbd85172fe6', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:13:11 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c5182f95-c843-4348-b0bc-ed20c7048448 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d02e795f-f23e-4bc5-b665-890550fa6601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:13:11 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c5182f95-c843-4348-b0bc-ed20c7048448 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d02e795f-f23e-4bc5-b665-890550fa6601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:13:11 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c5182f95-c843-4348-b0bc-ed20c7048448 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fedfa4e-6c88-4708-a757-dbd88bd0d29a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:13:11 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-c5182f95-c843-4348-b0bc-ed20c7048448 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Volume b21371e9-f11a-4ebc-99ab-1fbd85172fe6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b21371e9-f11a-4ebc-99ab-1fbd85172fe6', 'volume_size': 1} Jul 10 10:13:11 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-c5182f95-c843-4348-b0bc-ed20c7048448 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:13:11 devstack sudo[97749]: pam_unix(sudo:session): session closed for user root Jul 10 10:13:11 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-d3f064ed-f8ae-40c2-9179-f7a6a3f46445 tempest-TestServerVolumeAttachmentScenario-2059541924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ffaeaff6-8169-48c7-a10e-9884afcdc748 1073741824" returned: 0 in 1.427s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:13:11 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-d3f064ed-f8ae-40c2-9179-f7a6a3f46445 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ffaeaff6-8169-48c7-a10e-9884afcdc748 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:13:11 devstack sudo[97755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ffaeaff6-8169-48c7-a10e-9884afcdc748 Jul 10 10:13:11 devstack sudo[97755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:13:12 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-4cdd5329-1319-4aad-bb46-fe3b4e11f71b tempest-VolumesTransfersV355Test-1071747509 None] Transfer volume completed successfully. Jul 10 10:13:12 devstack sudo[97755]: pam_unix(sudo:session): session closed for user root Jul 10 10:13:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-d3f064ed-f8ae-40c2-9179-f7a6a3f46445 tempest-TestServerVolumeAttachmentScenario-2059541924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ffaeaff6-8169-48c7-a10e-9884afcdc748" returned: 0 in 0.935s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:13:12 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-d3f064ed-f8ae-40c2-9179-f7a6a3f46445 tempest-TestServerVolumeAttachmentScenario-2059541924 None] <== create_volume: return (2456ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:13:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-d3f064ed-f8ae-40c2-9179-f7a6a3f46445 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.459s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:13:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-c5182f95-c843-4348-b0bc-ed20c7048448 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.690s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:13:12 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-c5182f95-c843-4348-b0bc-ed20c7048448 tempest-TestServerVolumeAttachmentScenario-2059541924 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1476925677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b21371e9-f11a-4ebc-99ab-1fbd85172fe6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c63c388de6144c5a6e1a03934533111',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:13:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:13:11Z,use_quota=True,user_id='1af9541840f84a4d9db466c2cd8d9ca1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:13:12 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-c5182f95-c843-4348-b0bc-ed20c7048448 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Creating volume b21371e9-f11a-4ebc-99ab-1fbd85172fe6 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:13:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-c5182f95-c843-4348-b0bc-ed20c7048448 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:13:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-c5182f95-c843-4348-b0bc-ed20c7048448 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:13:12 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-c5182f95-c843-4348-b0bc-ed20c7048448 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:13:12 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-c5182f95-c843-4348-b0bc-ed20c7048448 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:13:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-c5182f95-c843-4348-b0bc-ed20c7048448 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:13:12 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-c5182f95-c843-4348-b0bc-ed20c7048448 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:13:12 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-c5182f95-c843-4348-b0bc-ed20c7048448 tempest-TestServerVolumeAttachmentScenario-2059541924 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:13:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c5182f95-c843-4348-b0bc-ed20c7048448 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b21371e9-f11a-4ebc-99ab-1fbd85172fe6 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:13:12 devstack sudo[97758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b21371e9-f11a-4ebc-99ab-1fbd85172fe6 1073741824 Jul 10 10:13:12 devstack sudo[97758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:13:12 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-d3f064ed-f8ae-40c2-9179-f7a6a3f46445 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (444d5a7b-e076-44a1-a2dd-e6ff20ad80a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffaeaff6-8169-48c7-a10e-9884afcdc748', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:13:12 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-d3f064ed-f8ae-40c2-9179-f7a6a3f46445 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (232660a7-989b-4433-b1a5-8f1bd46d3fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:13:12 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-d3f064ed-f8ae-40c2-9179-f7a6a3f46445 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Volume volume-ffaeaff6-8169-48c7-a10e-9884afcdc748 (ffaeaff6-8169-48c7-a10e-9884afcdc748): created successfully Jul 10 10:13:12 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-d3f064ed-f8ae-40c2-9179-f7a6a3f46445 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (232660a7-989b-4433-b1a5-8f1bd46d3fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:13:12 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-d3f064ed-f8ae-40c2-9179-f7a6a3f46445 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Flow 'volume_create_manager' (727152de-7332-4cf5-98b4-fa296785f701) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:13:12 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-d3f064ed-f8ae-40c2-9179-f7a6a3f46445 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Created volume successfully. Jul 10 10:13:13 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-147e2672-0ca7-4650-87d8-e74e58b6b689 tempest-VolumesTransfersV355Test-899335260 None] Acquiring lock "cinder-51f267d2-615e-4f5c-888b-540b17f53c3b-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:13:13 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-147e2672-0ca7-4650-87d8-e74e58b6b689 tempest-VolumesTransfersV355Test-899335260 None] Lock "cinder-51f267d2-615e-4f5c-888b-540b17f53c3b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:13:13 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-147e2672-0ca7-4650-87d8-e74e58b6b689 tempest-VolumesTransfersV355Test-899335260 None] Acquiring lock "cinder-quobyte-51f267d2-615e-4f5c-888b-540b17f53c3b" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:13:13 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-147e2672-0ca7-4650-87d8-e74e58b6b689 tempest-VolumesTransfersV355Test-899335260 None] Lock "cinder-quobyte-51f267d2-615e-4f5c-888b-540b17f53c3b" acquired by "delete_volume" :: waited 0.018s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:13:13 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd1cd76-5631-497d-9d8c-c4a5d8fa88d0]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:13:13 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-147e2672-0ca7-4650-87d8-e74e58b6b689 tempest-VolumesTransfersV355Test-899335260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-51f267d2-615e-4f5c-888b-540b17f53c3b {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:13:13 devstack sudo[97794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-51f267d2-615e-4f5c-888b-540b17f53c3b Jul 10 10:13:13 devstack sudo[97794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:13:14 devstack sudo[97758]: pam_unix(sudo:session): session closed for user root Jul 10 10:13:14 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c5182f95-c843-4348-b0bc-ed20c7048448 tempest-TestServerVolumeAttachmentScenario-2059541924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b21371e9-f11a-4ebc-99ab-1fbd85172fe6 1073741824" returned: 0 in 1.277s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:13:14 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c5182f95-c843-4348-b0bc-ed20c7048448 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b21371e9-f11a-4ebc-99ab-1fbd85172fe6 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:13:14 devstack sudo[97806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b21371e9-f11a-4ebc-99ab-1fbd85172fe6 Jul 10 10:13:14 devstack sudo[97806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:13:14 devstack sudo[97794]: pam_unix(sudo:session): session closed for user root Jul 10 10:13:14 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-147e2672-0ca7-4650-87d8-e74e58b6b689 tempest-VolumesTransfersV355Test-899335260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-51f267d2-615e-4f5c-888b-540b17f53c3b" returned: 0 in 1.113s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:13:14 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-147e2672-0ca7-4650-87d8-e74e58b6b689 tempest-VolumesTransfersV355Test-899335260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-51f267d2-615e-4f5c-888b-540b17f53c3b {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:13:14 devstack sudo[97808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-51f267d2-615e-4f5c-888b-540b17f53c3b Jul 10 10:13:14 devstack sudo[97808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:13:15 devstack sudo[97806]: pam_unix(sudo:session): session closed for user root Jul 10 10:13:15 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c5182f95-c843-4348-b0bc-ed20c7048448 tempest-TestServerVolumeAttachmentScenario-2059541924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b21371e9-f11a-4ebc-99ab-1fbd85172fe6" returned: 0 in 1.118s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:13:15 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-c5182f95-c843-4348-b0bc-ed20c7048448 tempest-TestServerVolumeAttachmentScenario-2059541924 None] <== create_volume: return (2462ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:13:15 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-c5182f95-c843-4348-b0bc-ed20c7048448 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.468s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:13:15 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c5182f95-c843-4348-b0bc-ed20c7048448 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fedfa4e-6c88-4708-a757-dbd88bd0d29a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b21371e9-f11a-4ebc-99ab-1fbd85172fe6', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:13:15 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c5182f95-c843-4348-b0bc-ed20c7048448 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc59f673-b89c-403b-b262-23482099c517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:13:15 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-c5182f95-c843-4348-b0bc-ed20c7048448 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Volume volume-b21371e9-f11a-4ebc-99ab-1fbd85172fe6 (b21371e9-f11a-4ebc-99ab-1fbd85172fe6): created successfully Jul 10 10:13:15 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c5182f95-c843-4348-b0bc-ed20c7048448 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc59f673-b89c-403b-b262-23482099c517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:13:15 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c5182f95-c843-4348-b0bc-ed20c7048448 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Flow 'volume_create_manager' (d9075697-13a3-44a4-9816-c73e20e4b548) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:13:15 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-c5182f95-c843-4348-b0bc-ed20c7048448 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Created volume successfully. Jul 10 10:13:15 devstack sudo[97808]: pam_unix(sudo:session): session closed for user root Jul 10 10:13:15 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-147e2672-0ca7-4650-87d8-e74e58b6b689 tempest-VolumesTransfersV355Test-899335260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-51f267d2-615e-4f5c-888b-540b17f53c3b" returned: 0 in 1.055s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:13:15 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-147e2672-0ca7-4650-87d8-e74e58b6b689 tempest-VolumesTransfersV355Test-899335260 None] Lock "cinder-quobyte-51f267d2-615e-4f5c-888b-540b17f53c3b" released by "delete_volume" :: held 2.231s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:13:15 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-147e2672-0ca7-4650-87d8-e74e58b6b689 tempest-VolumesTransfersV355Test-899335260 None] Created reservations ['9fa171a2-49db-43e8-8123-d49e45fe7110', '41be7aa5-e76c-4eb1-b6d8-63f59b0f19bc', '6b20b5ac-b95d-4dc0-8c5d-97025e493a28', '241b6547-8a33-4554-b5d5-d50da8bf6b47'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:13:15 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-147e2672-0ca7-4650-87d8-e74e58b6b689 tempest-VolumesTransfersV355Test-899335260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:13:15 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-147e2672-0ca7-4650-87d8-e74e58b6b689 tempest-VolumesTransfersV355Test-899335260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:13:15 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-147e2672-0ca7-4650-87d8-e74e58b6b689 tempest-VolumesTransfersV355Test-899335260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:13:15 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-147e2672-0ca7-4650-87d8-e74e58b6b689 tempest-VolumesTransfersV355Test-899335260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:13:15 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-147e2672-0ca7-4650-87d8-e74e58b6b689 tempest-VolumesTransfersV355Test-899335260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:13:15 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-147e2672-0ca7-4650-87d8-e74e58b6b689 tempest-VolumesTransfersV355Test-899335260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:13:15 devstack sudo[97817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:13:15 devstack sudo[97817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:13:16 devstack sudo[97817]: pam_unix(sudo:session): session closed for user root Jul 10 10:13:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-147e2672-0ca7-4650-87d8-e74e58b6b689 tempest-VolumesTransfersV355Test-899335260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 1.190s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:13:16 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-147e2672-0ca7-4650-87d8-e74e58b6b689 tempest-VolumesTransfersV355Test-899335260 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:13:16 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-147e2672-0ca7-4650-87d8-e74e58b6b689 tempest-VolumesTransfersV355Test-899335260 None] Deleted volume successfully. Jul 10 10:13:16 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-147e2672-0ca7-4650-87d8-e74e58b6b689 tempest-VolumesTransfersV355Test-899335260 None] Lock "cinder-51f267d2-615e-4f5c-888b-540b17f53c3b-delete_volume" released by "delete_volume" :: held 3.729s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:13:17 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c36b254-bbf6-4db2-87ff-4a9a9beb387d tempest-VolumesTransfersV355Test-1976305099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:13:17 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5c36b254-bbf6-4db2-87ff-4a9a9beb387d tempest-VolumesTransfersV355Test-1976305099 None] Flow 'volume_create_manager' (3cfec05d-def0-485a-a890-8aadec82213a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:13:17 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5c36b254-bbf6-4db2-87ff-4a9a9beb387d tempest-VolumesTransfersV355Test-1976305099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8476fa3c-bfc7-440f-9fc4-34b80cfd89bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:13:17 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5c36b254-bbf6-4db2-87ff-4a9a9beb387d tempest-VolumesTransfersV355Test-1976305099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8476fa3c-bfc7-440f-9fc4-34b80cfd89bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:13:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-177504469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7b15665-3a49-4ce7-95b8-0b015898eb53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffe372d26f124e57bdf1bdfe5e8dee9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:13:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:13:17Z,use_quota=True,user_id='285d476455c042cb8986bdcb9ada68f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:13:17 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5c36b254-bbf6-4db2-87ff-4a9a9beb387d tempest-VolumesTransfersV355Test-1976305099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2c9011a-25db-40ff-9e5a-e94072c90ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:13:17 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5c36b254-bbf6-4db2-87ff-4a9a9beb387d tempest-VolumesTransfersV355Test-1976305099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2c9011a-25db-40ff-9e5a-e94072c90ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:13:17 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5c36b254-bbf6-4db2-87ff-4a9a9beb387d tempest-VolumesTransfersV355Test-1976305099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d07463f-3ab1-4c62-a6aa-b0b1019893a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:13:17 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5c36b254-bbf6-4db2-87ff-4a9a9beb387d tempest-VolumesTransfersV355Test-1976305099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d07463f-3ab1-4c62-a6aa-b0b1019893a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7b15665-3a49-4ce7-95b8-0b015898eb53', 'volume_name': 'volume-c7b15665-3a49-4ce7-95b8-0b015898eb53', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:13:17 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5c36b254-bbf6-4db2-87ff-4a9a9beb387d tempest-VolumesTransfersV355Test-1976305099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cb26c44-bd68-4813-ad2d-6565f483ae9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:13:17 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5c36b254-bbf6-4db2-87ff-4a9a9beb387d tempest-VolumesTransfersV355Test-1976305099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cb26c44-bd68-4813-ad2d-6565f483ae9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:13:17 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5c36b254-bbf6-4db2-87ff-4a9a9beb387d tempest-VolumesTransfersV355Test-1976305099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3404e7f-7aeb-42df-a7e9-a9527fabd73d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:13:17 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-5c36b254-bbf6-4db2-87ff-4a9a9beb387d tempest-VolumesTransfersV355Test-1976305099 None] Volume c7b15665-3a49-4ce7-95b8-0b015898eb53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7b15665-3a49-4ce7-95b8-0b015898eb53', 'volume_size': 1} Jul 10 10:13:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-5c36b254-bbf6-4db2-87ff-4a9a9beb387d tempest-VolumesTransfersV355Test-1976305099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:13:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-5c36b254-bbf6-4db2-87ff-4a9a9beb387d tempest-VolumesTransfersV355Test-1976305099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:13:17 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-5c36b254-bbf6-4db2-87ff-4a9a9beb387d tempest-VolumesTransfersV355Test-1976305099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:13:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-177504469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7b15665-3a49-4ce7-95b8-0b015898eb53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffe372d26f124e57bdf1bdfe5e8dee9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:13:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:13:17Z,use_quota=True,user_id='285d476455c042cb8986bdcb9ada68f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:13:17 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-5c36b254-bbf6-4db2-87ff-4a9a9beb387d tempest-VolumesTransfersV355Test-1976305099 None] Creating volume c7b15665-3a49-4ce7-95b8-0b015898eb53 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:13:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-5c36b254-bbf6-4db2-87ff-4a9a9beb387d tempest-VolumesTransfersV355Test-1976305099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:13:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-5c36b254-bbf6-4db2-87ff-4a9a9beb387d tempest-VolumesTransfersV355Test-1976305099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:13:17 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-5c36b254-bbf6-4db2-87ff-4a9a9beb387d tempest-VolumesTransfersV355Test-1976305099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:13:17 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-5c36b254-bbf6-4db2-87ff-4a9a9beb387d tempest-VolumesTransfersV355Test-1976305099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:13:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-5c36b254-bbf6-4db2-87ff-4a9a9beb387d tempest-VolumesTransfersV355Test-1976305099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:13:17 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-5c36b254-bbf6-4db2-87ff-4a9a9beb387d tempest-VolumesTransfersV355Test-1976305099 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:13:17 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-5c36b254-bbf6-4db2-87ff-4a9a9beb387d tempest-VolumesTransfersV355Test-1976305099 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:13:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5c36b254-bbf6-4db2-87ff-4a9a9beb387d tempest-VolumesTransfersV355Test-1976305099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c7b15665-3a49-4ce7-95b8-0b015898eb53 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:13:17 devstack sudo[97843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c7b15665-3a49-4ce7-95b8-0b015898eb53 1073741824 Jul 10 10:13:17 devstack sudo[97843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:13:18 devstack sudo[97843]: pam_unix(sudo:session): session closed for user root Jul 10 10:13:18 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5c36b254-bbf6-4db2-87ff-4a9a9beb387d tempest-VolumesTransfersV355Test-1976305099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c7b15665-3a49-4ce7-95b8-0b015898eb53 1073741824" returned: 0 in 1.130s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:13:18 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5c36b254-bbf6-4db2-87ff-4a9a9beb387d tempest-VolumesTransfersV355Test-1976305099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c7b15665-3a49-4ce7-95b8-0b015898eb53 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:13:18 devstack sudo[97850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c7b15665-3a49-4ce7-95b8-0b015898eb53 Jul 10 10:13:18 devstack sudo[97850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:13:19 devstack sudo[97850]: pam_unix(sudo:session): session closed for user root Jul 10 10:13:19 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5c36b254-bbf6-4db2-87ff-4a9a9beb387d tempest-VolumesTransfersV355Test-1976305099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c7b15665-3a49-4ce7-95b8-0b015898eb53" returned: 0 in 0.964s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:13:19 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-5c36b254-bbf6-4db2-87ff-4a9a9beb387d tempest-VolumesTransfersV355Test-1976305099 None] <== create_volume: return (2166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:13:19 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-5c36b254-bbf6-4db2-87ff-4a9a9beb387d tempest-VolumesTransfersV355Test-1976305099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.171s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:13:19 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5c36b254-bbf6-4db2-87ff-4a9a9beb387d tempest-VolumesTransfersV355Test-1976305099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3404e7f-7aeb-42df-a7e9-a9527fabd73d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7b15665-3a49-4ce7-95b8-0b015898eb53', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:13:19 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5c36b254-bbf6-4db2-87ff-4a9a9beb387d tempest-VolumesTransfersV355Test-1976305099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2be161e-5e25-4662-bd71-095b30e9279e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:13:19 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-5c36b254-bbf6-4db2-87ff-4a9a9beb387d tempest-VolumesTransfersV355Test-1976305099 None] Volume volume-c7b15665-3a49-4ce7-95b8-0b015898eb53 (c7b15665-3a49-4ce7-95b8-0b015898eb53): created successfully Jul 10 10:13:19 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5c36b254-bbf6-4db2-87ff-4a9a9beb387d tempest-VolumesTransfersV355Test-1976305099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2be161e-5e25-4662-bd71-095b30e9279e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:13:19 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5c36b254-bbf6-4db2-87ff-4a9a9beb387d tempest-VolumesTransfersV355Test-1976305099 None] Flow 'volume_create_manager' (3cfec05d-def0-485a-a890-8aadec82213a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:13:19 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-5c36b254-bbf6-4db2-87ff-4a9a9beb387d tempest-VolumesTransfersV355Test-1976305099 None] Created volume successfully. Jul 10 10:13:21 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-7b491265-3341-4c10-839b-1dff49bb2414 tempest-VolumesTransfersV355Test-899335260 None] Acquiring lock "cinder-c7b15665-3a49-4ce7-95b8-0b015898eb53-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:13:21 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-7b491265-3341-4c10-839b-1dff49bb2414 tempest-VolumesTransfersV355Test-899335260 None] Lock "cinder-c7b15665-3a49-4ce7-95b8-0b015898eb53-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:13:21 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-7b491265-3341-4c10-839b-1dff49bb2414 tempest-VolumesTransfersV355Test-899335260 None] Acquiring lock "cinder-quobyte-c7b15665-3a49-4ce7-95b8-0b015898eb53" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:13:21 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-7b491265-3341-4c10-839b-1dff49bb2414 tempest-VolumesTransfersV355Test-899335260 None] Lock "cinder-quobyte-c7b15665-3a49-4ce7-95b8-0b015898eb53" acquired by "delete_volume" :: waited 0.021s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:13:21 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a498c0e-9d1a-4f80-99d6-c07bd95d42ea]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:13:21 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-7b491265-3341-4c10-839b-1dff49bb2414 tempest-VolumesTransfersV355Test-899335260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c7b15665-3a49-4ce7-95b8-0b015898eb53 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:13:21 devstack sudo[97855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c7b15665-3a49-4ce7-95b8-0b015898eb53 Jul 10 10:13:21 devstack sudo[97855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:13:22 devstack sudo[97855]: pam_unix(sudo:session): session closed for user root Jul 10 10:13:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-7b491265-3341-4c10-839b-1dff49bb2414 tempest-VolumesTransfersV355Test-899335260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c7b15665-3a49-4ce7-95b8-0b015898eb53" returned: 0 in 1.018s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:13:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-7b491265-3341-4c10-839b-1dff49bb2414 tempest-VolumesTransfersV355Test-899335260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c7b15665-3a49-4ce7-95b8-0b015898eb53 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:13:22 devstack sudo[97862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c7b15665-3a49-4ce7-95b8-0b015898eb53 Jul 10 10:13:22 devstack sudo[97862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:13:23 devstack sudo[97862]: pam_unix(sudo:session): session closed for user root Jul 10 10:13:23 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-7b491265-3341-4c10-839b-1dff49bb2414 tempest-VolumesTransfersV355Test-899335260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c7b15665-3a49-4ce7-95b8-0b015898eb53" returned: 0 in 0.815s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:13:23 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-7b491265-3341-4c10-839b-1dff49bb2414 tempest-VolumesTransfersV355Test-899335260 None] Lock "cinder-quobyte-c7b15665-3a49-4ce7-95b8-0b015898eb53" released by "delete_volume" :: held 1.902s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:13:23 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-7b491265-3341-4c10-839b-1dff49bb2414 tempest-VolumesTransfersV355Test-899335260 None] Created reservations ['7804e466-9307-415b-a0bd-84af69d0f9b1', '72373c33-d967-4cd3-8e28-ba35924e4e8c', 'e36bb075-c8dd-4a2b-9401-62510449862c', '99f5340b-1d4d-464a-9ff7-fa632d3889e6'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:13:23 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-7b491265-3341-4c10-839b-1dff49bb2414 tempest-VolumesTransfersV355Test-899335260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:13:23 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-7b491265-3341-4c10-839b-1dff49bb2414 tempest-VolumesTransfersV355Test-899335260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:13:23 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-7b491265-3341-4c10-839b-1dff49bb2414 tempest-VolumesTransfersV355Test-899335260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:13:23 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-7b491265-3341-4c10-839b-1dff49bb2414 tempest-VolumesTransfersV355Test-899335260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:13:23 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-7b491265-3341-4c10-839b-1dff49bb2414 tempest-VolumesTransfersV355Test-899335260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:13:23 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-7b491265-3341-4c10-839b-1dff49bb2414 tempest-VolumesTransfersV355Test-899335260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:13:23 devstack sudo[97870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:13:23 devstack sudo[97870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:13:24 devstack sudo[97870]: pam_unix(sudo:session): session closed for user root Jul 10 10:13:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-7b491265-3341-4c10-839b-1dff49bb2414 tempest-VolumesTransfersV355Test-899335260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 1.053s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:13:24 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-7b491265-3341-4c10-839b-1dff49bb2414 tempest-VolumesTransfersV355Test-899335260 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:13:24 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-7b491265-3341-4c10-839b-1dff49bb2414 tempest-VolumesTransfersV355Test-899335260 None] Deleted volume successfully. Jul 10 10:13:24 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-7b491265-3341-4c10-839b-1dff49bb2414 tempest-VolumesTransfersV355Test-899335260 None] Lock "cinder-c7b15665-3a49-4ce7-95b8-0b015898eb53-delete_volume" released by "delete_volume" :: held 3.361s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:13:30 devstack cinder-volume[87234]: INFO cinder.volume.manager [req-c4b2c8e3-45fa-4eca-a3d0-e689084b91f9 req-25f899c4-350f-4320-9bad-48830e773863 tempest-AttachVolumeNegativeTest-1243032650 None] Terminate volume connection completed successfully. Jul 10 10:13:30 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [req-c4b2c8e3-45fa-4eca-a3d0-e689084b91f9 req-25f899c4-350f-4320-9bad-48830e773863 tempest-AttachVolumeNegativeTest-1243032650 None] Deleting attachment b3159772-da0a-4ca9-9367-b4ed5ecd98c8. {{(pid=87234) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 10:13:33 devstack cinder-volume[87234]: DEBUG dbcounter [-] [87234] Writing DB stats cinder:SELECT=18,cinder:UPDATE=26,cinder:DELETE=2,cinder:INSERT=6 {{(pid=87234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 10:13:36 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-18459e03-4eef-4343-a584-07199f5e1af6 tempest-TestShelveInstance-276001208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:13:36 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-18459e03-4eef-4343-a584-07199f5e1af6 tempest-TestShelveInstance-276001208 None] Flow 'volume_create_manager' (04081aa6-6a62-4e38-b63d-d549d608b401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:13:36 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-18459e03-4eef-4343-a584-07199f5e1af6 tempest-TestShelveInstance-276001208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2d0c041-7f5e-4ba9-9933-d72b2c2cadd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:13:36 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-18459e03-4eef-4343-a584-07199f5e1af6 tempest-TestShelveInstance-276001208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2d0c041-7f5e-4ba9-9933-d72b2c2cadd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:13:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1724959318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0475ede2-b806-4549-95bd-25c6bb4298ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58607d19d2564b769cc0398ab5c01cf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:13:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:13:37Z,use_quota=True,user_id='829b553eb35344948d7712b6c6a968f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:13:36 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-18459e03-4eef-4343-a584-07199f5e1af6 tempest-TestShelveInstance-276001208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7707694b-5a43-40fa-ae4f-f7c633e7724e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:13:36 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-18459e03-4eef-4343-a584-07199f5e1af6 tempest-TestShelveInstance-276001208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7707694b-5a43-40fa-ae4f-f7c633e7724e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:13:36 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-18459e03-4eef-4343-a584-07199f5e1af6 tempest-TestShelveInstance-276001208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc259291-e3b7-44b1-b48d-55ebf6ac043c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:13:36 devstack cinder-volume[87234]: DEBUG cinder.image.glance [None req-18459e03-4eef-4343-a584-07199f5e1af6 tempest-TestShelveInstance-276001208 None] Creating Keystone auth plugin from conf {{(pid=87234) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 10:13:37 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-18459e03-4eef-4343-a584-07199f5e1af6 tempest-TestShelveInstance-276001208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc259291-e3b7-44b1-b48d-55ebf6ac043c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0475ede2-b806-4549-95bd-25c6bb4298ff', 'volume_name': 'volume-0475ede2-b806-4549-95bd-25c6bb4298ff', 'volume_size': 1, 'image_id': '57b49355-8d23-4892-9d66-30ed6d4bc3c1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/57b49355-8d23-4892-9d66-30ed6d4bc3c1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd8e6341302c8449397efca0eea68956a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '57b49355-8d23-4892-9d66-30ed6d4bc3c1', 'created_at': datetime.datetime(2026, 7, 10, 7, 56, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 7, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/57b49355-8d23-4892-9d66-30ed6d4bc3c1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:13:37 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-18459e03-4eef-4343-a584-07199f5e1af6 tempest-TestShelveInstance-276001208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d0c5467-5602-452c-a770-dc620cae7f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:13:37 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-18459e03-4eef-4343-a584-07199f5e1af6 tempest-TestShelveInstance-276001208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d0c5467-5602-452c-a770-dc620cae7f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:13:37 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-18459e03-4eef-4343-a584-07199f5e1af6 tempest-TestShelveInstance-276001208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (625d1375-547e-4ed7-a1a2-644148d1c1c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:13:37 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-18459e03-4eef-4343-a584-07199f5e1af6 tempest-TestShelveInstance-276001208 None] Volume 0475ede2-b806-4549-95bd-25c6bb4298ff: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0475ede2-b806-4549-95bd-25c6bb4298ff', 'volume_size': 1, 'image_id': '57b49355-8d23-4892-9d66-30ed6d4bc3c1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/57b49355-8d23-4892-9d66-30ed6d4bc3c1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd8e6341302c8449397efca0eea68956a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '57b49355-8d23-4892-9d66-30ed6d4bc3c1', 'created_at': datetime.datetime(2026, 7, 10, 7, 56, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 7, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/57b49355-8d23-4892-9d66-30ed6d4bc3c1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 10 10:13:37 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-18459e03-4eef-4343-a584-07199f5e1af6 tempest-TestShelveInstance-276001208 None] Trying to clone 0475ede2-b806-4549-95bd-25c6bb4298ff from image 57b49355-8d23-4892-9d66-30ed6d4bc3c1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/57b49355-8d23-4892-9d66-30ed6d4bc3c1', 'metadata': {}}]). {{(pid=87234) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 10:13:38 devstack cinder-volume[87234]: DEBUG cinder.image.image_utils [None req-18459e03-4eef-4343-a584-07199f5e1af6 tempest-TestShelveInstance-276001208 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_57b49355-8d23-4892-9d66-30ed6d4bc3c1_m91o56ccdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87234) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 10:13:38 devstack cinder-volume[87234]: INFO cinder.image.image_utils [None req-18459e03-4eef-4343-a584-07199f5e1af6 tempest-TestShelveInstance-276001208 None] Image download 20.69 MB at 20.69 MB/s Jul 10 10:13:38 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde576a2-7b2b-4777-bf7e-08d05f87d8fd]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:13:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-18459e03-4eef-4343-a584-07199f5e1af6 tempest-TestShelveInstance-276001208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57b49355-8d23-4892-9d66-30ed6d4bc3c1_m91o56ccdevstack@QuobyteHD {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:13:38 devstack sudo[97989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57b49355-8d23-4892-9d66-30ed6d4bc3c1_m91o56ccdevstack@QuobyteHD Jul 10 10:13:38 devstack sudo[97989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:13:39 devstack sudo[97989]: pam_unix(sudo:session): session closed for user root Jul 10 10:13:39 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-18459e03-4eef-4343-a584-07199f5e1af6 tempest-TestShelveInstance-276001208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57b49355-8d23-4892-9d66-30ed6d4bc3c1_m91o56ccdevstack@QuobyteHD" returned: 0 in 1.257s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:13:39 devstack cinder-volume[87234]: DEBUG cinder.image.image_utils [None req-18459e03-4eef-4343-a584-07199f5e1af6 tempest-TestShelveInstance-276001208 None] Temporary image 57b49355-8d23-4892-9d66-30ed6d4bc3c1 is fetched for user 829b553eb35344948d7712b6c6a968f0. {{(pid=87234) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 10:13:39 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e613613-d52c-41e8-b07b-b14002566122]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:13:39 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-18459e03-4eef-4343-a584-07199f5e1af6 tempest-TestShelveInstance-276001208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57b49355-8d23-4892-9d66-30ed6d4bc3c1_m91o56ccdevstack@QuobyteHD {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:13:39 devstack sudo[97995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57b49355-8d23-4892-9d66-30ed6d4bc3c1_m91o56ccdevstack@QuobyteHD Jul 10 10:13:39 devstack sudo[97995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:13:40 devstack sudo[97995]: pam_unix(sudo:session): session closed for user root Jul 10 10:13:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-18459e03-4eef-4343-a584-07199f5e1af6 tempest-TestShelveInstance-276001208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57b49355-8d23-4892-9d66-30ed6d4bc3c1_m91o56ccdevstack@QuobyteHD" returned: 0 in 1.085s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:13:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-18459e03-4eef-4343-a584-07199f5e1af6 tempest-TestShelveInstance-276001208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:13:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-18459e03-4eef-4343-a584-07199f5e1af6 tempest-TestShelveInstance-276001208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:13:40 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-18459e03-4eef-4343-a584-07199f5e1af6 tempest-TestShelveInstance-276001208 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:13:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1724959318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0475ede2-b806-4549-95bd-25c6bb4298ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58607d19d2564b769cc0398ab5c01cf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:13:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:13:37Z,use_quota=True,user_id='829b553eb35344948d7712b6c6a968f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:13:40 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-18459e03-4eef-4343-a584-07199f5e1af6 tempest-TestShelveInstance-276001208 None] Creating volume 0475ede2-b806-4549-95bd-25c6bb4298ff {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:13:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-18459e03-4eef-4343-a584-07199f5e1af6 tempest-TestShelveInstance-276001208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:13:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-18459e03-4eef-4343-a584-07199f5e1af6 tempest-TestShelveInstance-276001208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:13:40 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-18459e03-4eef-4343-a584-07199f5e1af6 tempest-TestShelveInstance-276001208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:13:40 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-18459e03-4eef-4343-a584-07199f5e1af6 tempest-TestShelveInstance-276001208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:13:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-18459e03-4eef-4343-a584-07199f5e1af6 tempest-TestShelveInstance-276001208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:13:40 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-18459e03-4eef-4343-a584-07199f5e1af6 tempest-TestShelveInstance-276001208 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:13:40 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-18459e03-4eef-4343-a584-07199f5e1af6 tempest-TestShelveInstance-276001208 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:13:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-18459e03-4eef-4343-a584-07199f5e1af6 tempest-TestShelveInstance-276001208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0475ede2-b806-4549-95bd-25c6bb4298ff 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:13:40 devstack sudo[98001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0475ede2-b806-4549-95bd-25c6bb4298ff 1073741824 Jul 10 10:13:40 devstack sudo[98001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:13:42 devstack sudo[98001]: pam_unix(sudo:session): session closed for user root Jul 10 10:13:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-18459e03-4eef-4343-a584-07199f5e1af6 tempest-TestShelveInstance-276001208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0475ede2-b806-4549-95bd-25c6bb4298ff 1073741824" returned: 0 in 1.390s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:13:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-18459e03-4eef-4343-a584-07199f5e1af6 tempest-TestShelveInstance-276001208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0475ede2-b806-4549-95bd-25c6bb4298ff {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:13:42 devstack cinder-volume[87234]: DEBUG oslo_service.periodic_task [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 10:13:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:13:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:13:42 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:13:42 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:13:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:13:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:13:42 devstack sudo[98006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0475ede2-b806-4549-95bd-25c6bb4298ff Jul 10 10:13:42 devstack sudo[98006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:13:42 devstack sudo[98007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:13:42 devstack sudo[98007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:13:43 devstack sudo[98006]: pam_unix(sudo:session): session closed for user root Jul 10 10:13:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-18459e03-4eef-4343-a584-07199f5e1af6 tempest-TestShelveInstance-276001208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0475ede2-b806-4549-95bd-25c6bb4298ff" returned: 0 in 0.972s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:13:43 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-18459e03-4eef-4343-a584-07199f5e1af6 tempest-TestShelveInstance-276001208 None] <== create_volume: return (2437ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:13:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-18459e03-4eef-4343-a584-07199f5e1af6 tempest-TestShelveInstance-276001208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.443s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:13:43 devstack cinder-volume[87234]: DEBUG cinder.volume.volume_utils [None req-18459e03-4eef-4343-a584-07199f5e1af6 tempest-TestShelveInstance-276001208 None] Attempting download of 57b49355-8d23-4892-9d66-30ed6d4bc3c1 ((None, [{'url': 'file:///opt/stack/data/glance/images/57b49355-8d23-4892-9d66-30ed6d4bc3c1', 'metadata': {}}])) to volume 0475ede2-b806-4549-95bd-25c6bb4298ff. {{(pid=87234) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 10:13:43 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[f008de7b-2e04-4ace-bf42-36c6757e4cbe]: (4, 'raw') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:13:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-18459e03-4eef-4343-a584-07199f5e1af6 tempest-TestShelveInstance-276001208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_57b49355-8d23-4892-9d66-30ed6d4bc3c1_q8j7kzaz {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:13:43 devstack sudo[98007]: pam_unix(sudo:session): session closed for user root Jul 10 10:13:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 1.157s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:13:43 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:13:43 devstack cinder-volume[87234]: DEBUG oslo_service.periodic_task [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Running periodic task VolumeManager._thread_info {{(pid=87234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 10:13:43 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] thread count: 28 {{(pid=87234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 10:13:43 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] thread info: [<_MainThread(MainThread, started 131600773742720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 10:13:43 devstack sudo[98012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_57b49355-8d23-4892-9d66-30ed6d4bc3c1_q8j7kzaz Jul 10 10:13:43 devstack sudo[98012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:13:44 devstack sudo[98012]: pam_unix(sudo:session): session closed for user root Jul 10 10:13:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-18459e03-4eef-4343-a584-07199f5e1af6 tempest-TestShelveInstance-276001208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_57b49355-8d23-4892-9d66-30ed6d4bc3c1_q8j7kzaz" returned: 0 in 1.035s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:13:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-18459e03-4eef-4343-a584-07199f5e1af6 tempest-TestShelveInstance-276001208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_57b49355-8d23-4892-9d66-30ed6d4bc3c1_q8j7kzaz {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:13:44 devstack sudo[98016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_57b49355-8d23-4892-9d66-30ed6d4bc3c1_q8j7kzaz Jul 10 10:13:44 devstack sudo[98016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:13:45 devstack sudo[98016]: pam_unix(sudo:session): session closed for user root Jul 10 10:13:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-18459e03-4eef-4343-a584-07199f5e1af6 tempest-TestShelveInstance-276001208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_57b49355-8d23-4892-9d66-30ed6d4bc3c1_q8j7kzaz" returned: 1 in 1.306s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:13:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-18459e03-4eef-4343-a584-07199f5e1af6 tempest-TestShelveInstance-276001208 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_57b49355-8d23-4892-9d66-30ed6d4bc3c1_q8j7kzaz' failed. Not Retrying. {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 10:13:45 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[c07875ed-143f-4d17-9042-b6ccf52da340]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:13:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-18459e03-4eef-4343-a584-07199f5e1af6 tempest-TestShelveInstance-276001208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57b49355-8d23-4892-9d66-30ed6d4bc3c1_m91o56ccdevstack@QuobyteHD {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:13:45 devstack sudo[98020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57b49355-8d23-4892-9d66-30ed6d4bc3c1_m91o56ccdevstack@QuobyteHD Jul 10 10:13:45 devstack sudo[98020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:13:46 devstack sudo[98020]: pam_unix(sudo:session): session closed for user root Jul 10 10:13:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-18459e03-4eef-4343-a584-07199f5e1af6 tempest-TestShelveInstance-276001208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57b49355-8d23-4892-9d66-30ed6d4bc3c1_m91o56ccdevstack@QuobyteHD" returned: 0 in 1.382s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:13:46 devstack cinder-volume[87234]: DEBUG cinder.image.image_utils [None req-18459e03-4eef-4343-a584-07199f5e1af6 tempest-TestShelveInstance-276001208 None] 57b49355-8d23-4892-9d66-30ed6d4bc3c1 was qcow2, converting to raw {{(pid=87234) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 10:13:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-18459e03-4eef-4343-a584-07199f5e1af6 tempest-TestShelveInstance-276001208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_57b49355-8d23-4892-9d66-30ed6d4bc3c1_m91o56ccdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0475ede2-b806-4549-95bd-25c6bb4298ff {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:13:47 devstack sudo[98026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_57b49355-8d23-4892-9d66-30ed6d4bc3c1_m91o56ccdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0475ede2-b806-4549-95bd-25c6bb4298ff Jul 10 10:13:47 devstack sudo[98026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:13:49 devstack sudo[98026]: pam_unix(sudo:session): session closed for user root Jul 10 10:13:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-18459e03-4eef-4343-a584-07199f5e1af6 tempest-TestShelveInstance-276001208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_57b49355-8d23-4892-9d66-30ed6d4bc3c1_m91o56ccdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0475ede2-b806-4549-95bd-25c6bb4298ff" returned: 0 in 2.748s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:13:49 devstack cinder-volume[87234]: DEBUG cinder.image.image_utils [None req-18459e03-4eef-4343-a584-07199f5e1af6 tempest-TestShelveInstance-276001208 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_57b49355-8d23-4892-9d66-30ed6d4bc3c1_m91o56ccdevstack@QuobyteHD, size 112.00 MB, duration 2.75 sec, destination /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0475ede2-b806-4549-95bd-25c6bb4298ff {{(pid=87234) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 10:13:49 devstack cinder-volume[87234]: INFO cinder.image.image_utils [None req-18459e03-4eef-4343-a584-07199f5e1af6 tempest-TestShelveInstance-276001208 None] Converted 112.00 MB image at 40.73 MB/s Jul 10 10:13:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-18459e03-4eef-4343-a584-07199f5e1af6 tempest-TestShelveInstance-276001208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0475ede2-b806-4549-95bd-25c6bb4298ff 1G {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:13:49 devstack sudo[98058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0475ede2-b806-4549-95bd-25c6bb4298ff 1G Jul 10 10:13:49 devstack sudo[98058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:13:50 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-f30811f9-80bc-491e-88ab-2c194cb825d1 tempest-VolumesActionsTest-778674190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:13:50 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f30811f9-80bc-491e-88ab-2c194cb825d1 tempest-VolumesActionsTest-778674190 None] Flow 'volume_create_manager' (35a40eb4-780c-4318-8221-2560893b0c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:13:50 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f30811f9-80bc-491e-88ab-2c194cb825d1 tempest-VolumesActionsTest-778674190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aa7ec4a-92bd-493e-b895-3bc4379efebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:13:50 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f30811f9-80bc-491e-88ab-2c194cb825d1 tempest-VolumesActionsTest-778674190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aa7ec4a-92bd-493e-b895-3bc4379efebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:13:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1310141288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0720f10d-0900-45e5-973e-f6dd0db0ab7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccaf26c0e72e4a34be29df619c0d00d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:13:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:13:50Z,use_quota=True,user_id='7f07f4b6fc1e429b9cd3ef4062f603a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:13:50 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f30811f9-80bc-491e-88ab-2c194cb825d1 tempest-VolumesActionsTest-778674190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3f698a8-3945-4ff0-acf6-dc7332a5fdca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:13:50 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f30811f9-80bc-491e-88ab-2c194cb825d1 tempest-VolumesActionsTest-778674190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3f698a8-3945-4ff0-acf6-dc7332a5fdca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:13:50 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f30811f9-80bc-491e-88ab-2c194cb825d1 tempest-VolumesActionsTest-778674190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69be0bae-e489-4738-a4f0-d9a6f97a1da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:13:50 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f30811f9-80bc-491e-88ab-2c194cb825d1 tempest-VolumesActionsTest-778674190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69be0bae-e489-4738-a4f0-d9a6f97a1da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0720f10d-0900-45e5-973e-f6dd0db0ab7d', 'volume_name': 'volume-0720f10d-0900-45e5-973e-f6dd0db0ab7d', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:13:50 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f30811f9-80bc-491e-88ab-2c194cb825d1 tempest-VolumesActionsTest-778674190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3104779-894c-45a2-b664-2a69476b55f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:13:50 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f30811f9-80bc-491e-88ab-2c194cb825d1 tempest-VolumesActionsTest-778674190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3104779-894c-45a2-b664-2a69476b55f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:13:50 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f30811f9-80bc-491e-88ab-2c194cb825d1 tempest-VolumesActionsTest-778674190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3117c89c-446d-4163-99e4-5dc565a90a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:13:50 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-f30811f9-80bc-491e-88ab-2c194cb825d1 tempest-VolumesActionsTest-778674190 None] Volume 0720f10d-0900-45e5-973e-f6dd0db0ab7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0720f10d-0900-45e5-973e-f6dd0db0ab7d', 'volume_size': 1} Jul 10 10:13:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f30811f9-80bc-491e-88ab-2c194cb825d1 tempest-VolumesActionsTest-778674190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:13:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f30811f9-80bc-491e-88ab-2c194cb825d1 tempest-VolumesActionsTest-778674190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:13:50 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f30811f9-80bc-491e-88ab-2c194cb825d1 tempest-VolumesActionsTest-778674190 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:13:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1310141288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0720f10d-0900-45e5-973e-f6dd0db0ab7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccaf26c0e72e4a34be29df619c0d00d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:13:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:13:50Z,use_quota=True,user_id='7f07f4b6fc1e429b9cd3ef4062f603a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:13:50 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-f30811f9-80bc-491e-88ab-2c194cb825d1 tempest-VolumesActionsTest-778674190 None] Creating volume 0720f10d-0900-45e5-973e-f6dd0db0ab7d {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:13:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f30811f9-80bc-491e-88ab-2c194cb825d1 tempest-VolumesActionsTest-778674190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:13:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f30811f9-80bc-491e-88ab-2c194cb825d1 tempest-VolumesActionsTest-778674190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:13:50 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f30811f9-80bc-491e-88ab-2c194cb825d1 tempest-VolumesActionsTest-778674190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:13:50 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f30811f9-80bc-491e-88ab-2c194cb825d1 tempest-VolumesActionsTest-778674190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:13:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f30811f9-80bc-491e-88ab-2c194cb825d1 tempest-VolumesActionsTest-778674190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:13:50 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f30811f9-80bc-491e-88ab-2c194cb825d1 tempest-VolumesActionsTest-778674190 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:13:50 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-f30811f9-80bc-491e-88ab-2c194cb825d1 tempest-VolumesActionsTest-778674190 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:13:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f30811f9-80bc-491e-88ab-2c194cb825d1 tempest-VolumesActionsTest-778674190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0720f10d-0900-45e5-973e-f6dd0db0ab7d 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:13:50 devstack sudo[98060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0720f10d-0900-45e5-973e-f6dd0db0ab7d 1073741824 Jul 10 10:13:50 devstack sudo[98060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:13:50 devstack sudo[98058]: pam_unix(sudo:session): session closed for user root Jul 10 10:13:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-18459e03-4eef-4343-a584-07199f5e1af6 tempest-TestShelveInstance-276001208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0475ede2-b806-4549-95bd-25c6bb4298ff 1G" returned: 0 in 0.746s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:13:50 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e21a39c-bc1a-429d-aa8b-e13cdb1f2dea]: (4, 'raw') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:13:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-18459e03-4eef-4343-a584-07199f5e1af6 tempest-TestShelveInstance-276001208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0475ede2-b806-4549-95bd-25c6bb4298ff {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:13:50 devstack sudo[98065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0475ede2-b806-4549-95bd-25c6bb4298ff Jul 10 10:13:50 devstack sudo[98065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:13:51 devstack sudo[98060]: pam_unix(sudo:session): session closed for user root Jul 10 10:13:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f30811f9-80bc-491e-88ab-2c194cb825d1 tempest-VolumesActionsTest-778674190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0720f10d-0900-45e5-973e-f6dd0db0ab7d 1073741824" returned: 0 in 0.938s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:13:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f30811f9-80bc-491e-88ab-2c194cb825d1 tempest-VolumesActionsTest-778674190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0720f10d-0900-45e5-973e-f6dd0db0ab7d {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:13:51 devstack sudo[98070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0720f10d-0900-45e5-973e-f6dd0db0ab7d Jul 10 10:13:51 devstack sudo[98070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:13:51 devstack sudo[98065]: pam_unix(sudo:session): session closed for user root Jul 10 10:13:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-18459e03-4eef-4343-a584-07199f5e1af6 tempest-TestShelveInstance-276001208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0475ede2-b806-4549-95bd-25c6bb4298ff" returned: 0 in 0.842s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:13:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-18459e03-4eef-4343-a584-07199f5e1af6 tempest-TestShelveInstance-276001208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0475ede2-b806-4549-95bd-25c6bb4298ff {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:13:51 devstack sudo[98074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0475ede2-b806-4549-95bd-25c6bb4298ff Jul 10 10:13:51 devstack sudo[98074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:13:51 devstack sudo[98070]: pam_unix(sudo:session): session closed for user root Jul 10 10:13:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f30811f9-80bc-491e-88ab-2c194cb825d1 tempest-VolumesActionsTest-778674190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0720f10d-0900-45e5-973e-f6dd0db0ab7d" returned: 0 in 0.667s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:13:51 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f30811f9-80bc-491e-88ab-2c194cb825d1 tempest-VolumesActionsTest-778674190 None] <== create_volume: return (1650ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:13:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f30811f9-80bc-491e-88ab-2c194cb825d1 tempest-VolumesActionsTest-778674190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.653s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:13:51 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f30811f9-80bc-491e-88ab-2c194cb825d1 tempest-VolumesActionsTest-778674190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3117c89c-446d-4163-99e4-5dc565a90a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0720f10d-0900-45e5-973e-f6dd0db0ab7d', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:13:51 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f30811f9-80bc-491e-88ab-2c194cb825d1 tempest-VolumesActionsTest-778674190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bb058ed-7088-4269-9a77-35c9ef5a431c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:13:51 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-f30811f9-80bc-491e-88ab-2c194cb825d1 tempest-VolumesActionsTest-778674190 None] Volume volume-0720f10d-0900-45e5-973e-f6dd0db0ab7d (0720f10d-0900-45e5-973e-f6dd0db0ab7d): created successfully Jul 10 10:13:51 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f30811f9-80bc-491e-88ab-2c194cb825d1 tempest-VolumesActionsTest-778674190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bb058ed-7088-4269-9a77-35c9ef5a431c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:13:51 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f30811f9-80bc-491e-88ab-2c194cb825d1 tempest-VolumesActionsTest-778674190 None] Flow 'volume_create_manager' (35a40eb4-780c-4318-8221-2560893b0c33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:13:51 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-f30811f9-80bc-491e-88ab-2c194cb825d1 tempest-VolumesActionsTest-778674190 None] Created volume successfully. Jul 10 10:13:52 devstack sudo[98074]: pam_unix(sudo:session): session closed for user root Jul 10 10:13:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-18459e03-4eef-4343-a584-07199f5e1af6 tempest-TestShelveInstance-276001208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0475ede2-b806-4549-95bd-25c6bb4298ff" returned: 1 in 0.828s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:13:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-18459e03-4eef-4343-a584-07199f5e1af6 tempest-TestShelveInstance-276001208 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0475ede2-b806-4549-95bd-25c6bb4298ff' failed. Not Retrying. {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 10:13:52 devstack cinder-volume[87234]: DEBUG cinder.volume.volume_utils [None req-18459e03-4eef-4343-a584-07199f5e1af6 tempest-TestShelveInstance-276001208 None] Downloaded image 57b49355-8d23-4892-9d66-30ed6d4bc3c1 ((None, [{'url': 'file:///opt/stack/data/glance/images/57b49355-8d23-4892-9d66-30ed6d4bc3c1', 'metadata': {}}])) to volume 0475ede2-b806-4549-95bd-25c6bb4298ff successfully. {{(pid=87234) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 10:13:52 devstack cinder-volume[87234]: DEBUG cinder.image.image_utils [None req-18459e03-4eef-4343-a584-07199f5e1af6 tempest-TestShelveInstance-276001208 None] Temporary image 57b49355-8d23-4892-9d66-30ed6d4bc3c1 for user 829b553eb35344948d7712b6c6a968f0 is deleted. {{(pid=87234) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 10:13:52 devstack cinder-volume[87234]: DEBUG cinder.volume.volume_utils [None req-18459e03-4eef-4343-a584-07199f5e1af6 tempest-TestShelveInstance-276001208 None] Marking volume 0475ede2-b806-4549-95bd-25c6bb4298ff as bootable. {{(pid=87234) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 10:13:52 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-18459e03-4eef-4343-a584-07199f5e1af6 tempest-TestShelveInstance-276001208 None] Copying metadata from image 57b49355-8d23-4892-9d66-30ed6d4bc3c1 to 0475ede2-b806-4549-95bd-25c6bb4298ff. {{(pid=87234) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 10:13:52 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-18459e03-4eef-4343-a584-07199f5e1af6 tempest-TestShelveInstance-276001208 None] Creating volume glance metadata for volume 0475ede2-b806-4549-95bd-25c6bb4298ff backed by image 57b49355-8d23-4892-9d66-30ed6d4bc3c1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '57b49355-8d23-4892-9d66-30ed6d4bc3c1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87234) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 10:13:52 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-18459e03-4eef-4343-a584-07199f5e1af6 tempest-TestShelveInstance-276001208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (625d1375-547e-4ed7-a1a2-644148d1c1c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0475ede2-b806-4549-95bd-25c6bb4298ff', 'volume_size': 1, 'image_id': '57b49355-8d23-4892-9d66-30ed6d4bc3c1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/57b49355-8d23-4892-9d66-30ed6d4bc3c1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd8e6341302c8449397efca0eea68956a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '57b49355-8d23-4892-9d66-30ed6d4bc3c1', 'created_at': datetime.datetime(2026, 7, 10, 7, 56, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 7, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/57b49355-8d23-4892-9d66-30ed6d4bc3c1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:13:52 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-18459e03-4eef-4343-a584-07199f5e1af6 tempest-TestShelveInstance-276001208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c49980f7-ae17-4826-b1d2-cdc629cc22db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:13:52 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-18459e03-4eef-4343-a584-07199f5e1af6 tempest-TestShelveInstance-276001208 None] Volume volume-0475ede2-b806-4549-95bd-25c6bb4298ff (0475ede2-b806-4549-95bd-25c6bb4298ff): created successfully Jul 10 10:13:52 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-18459e03-4eef-4343-a584-07199f5e1af6 tempest-TestShelveInstance-276001208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c49980f7-ae17-4826-b1d2-cdc629cc22db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:13:52 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-18459e03-4eef-4343-a584-07199f5e1af6 tempest-TestShelveInstance-276001208 None] Flow 'volume_create_manager' (04081aa6-6a62-4e38-b63d-d549d608b401) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:13:52 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-18459e03-4eef-4343-a584-07199f5e1af6 tempest-TestShelveInstance-276001208 None] Created volume successfully. Jul 10 10:14:02 devstack cinder-volume[87234]: DEBUG dbcounter [-] [87234] Writing DB stats cinder:UPDATE=9,cinder:SELECT=12,cinder:DELETE=1,cinder:INSERT=5 {{(pid=87234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 10:14:02 devstack cinder-volume[87234]: DEBUG dbcounter [-] [87234] Writing DB stats cinder:SELECT=33,cinder:UPDATE=37,cinder:INSERT=16,cinder:DELETE=5 {{(pid=87234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 10:14:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-68401aba-5e63-4dbf-a5b5-327de49a18f2 req-e75d5417-37fa-4876-9189-21c76e545da1 tempest-TestShelveInstance-276001208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:14:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-68401aba-5e63-4dbf-a5b5-327de49a18f2 req-e75d5417-37fa-4876-9189-21c76e545da1 tempest-TestShelveInstance-276001208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:14:02 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[1357a7b6-f97c-421d-8957-d5051553b0aa]: (4, 'raw') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:14:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-68401aba-5e63-4dbf-a5b5-327de49a18f2 req-e75d5417-37fa-4876-9189-21c76e545da1 tempest-TestShelveInstance-276001208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0475ede2-b806-4549-95bd-25c6bb4298ff {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:14:02 devstack sudo[98213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0475ede2-b806-4549-95bd-25c6bb4298ff Jul 10 10:14:02 devstack sudo[98213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:14:03 devstack sudo[98213]: pam_unix(sudo:session): session closed for user root Jul 10 10:14:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-68401aba-5e63-4dbf-a5b5-327de49a18f2 req-e75d5417-37fa-4876-9189-21c76e545da1 tempest-TestShelveInstance-276001208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0475ede2-b806-4549-95bd-25c6bb4298ff" returned: 0 in 1.189s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:14:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-68401aba-5e63-4dbf-a5b5-327de49a18f2 req-e75d5417-37fa-4876-9189-21c76e545da1 tempest-TestShelveInstance-276001208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0475ede2-b806-4549-95bd-25c6bb4298ff {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:14:03 devstack sudo[98217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0475ede2-b806-4549-95bd-25c6bb4298ff Jul 10 10:14:03 devstack sudo[98217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:14:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-e94939a2-6409-40f0-8a43-56a24bbc57d2 req-c7ee9b79-9f96-467f-ac17-d0146a3596a2 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:14:04 devstack sudo[98217]: pam_unix(sudo:session): session closed for user root Jul 10 10:14:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-68401aba-5e63-4dbf-a5b5-327de49a18f2 req-e75d5417-37fa-4876-9189-21c76e545da1 tempest-TestShelveInstance-276001208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0475ede2-b806-4549-95bd-25c6bb4298ff" returned: 1 in 1.201s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:14:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-68401aba-5e63-4dbf-a5b5-327de49a18f2 req-e75d5417-37fa-4876-9189-21c76e545da1 tempest-TestShelveInstance-276001208 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0475ede2-b806-4549-95bd-25c6bb4298ff' failed. Not Retrying. {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 10:14:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-68401aba-5e63-4dbf-a5b5-327de49a18f2 req-e75d5417-37fa-4876-9189-21c76e545da1 tempest-TestShelveInstance-276001208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.466s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:14:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-e94939a2-6409-40f0-8a43-56a24bbc57d2 req-c7ee9b79-9f96-467f-ac17-d0146a3596a2 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.532s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:14:04 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[43282c63-e808-4e11-aab4-9b8480652848]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:14:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-e94939a2-6409-40f0-8a43-56a24bbc57d2 req-c7ee9b79-9f96-467f-ac17-d0146a3596a2 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ffaeaff6-8169-48c7-a10e-9884afcdc748 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:14:04 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [req-68401aba-5e63-4dbf-a5b5-327de49a18f2 req-e75d5417-37fa-4876-9189-21c76e545da1 tempest-TestShelveInstance-276001208 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091', 'name': 'volume-0475ede2-b806-4549-95bd-25c6bb4298ff', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '53e8c0d3-d17d-4bc7-9006-3e60dda66876', 'enforce_multipath': True} {{(pid=87234) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 10:14:05 devstack cinder-volume[87234]: INFO cinder.volume.manager [req-68401aba-5e63-4dbf-a5b5-327de49a18f2 req-e75d5417-37fa-4876-9189-21c76e545da1 tempest-TestShelveInstance-276001208 None] attachment_update completed successfully. Jul 10 10:14:05 devstack sudo[98232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ffaeaff6-8169-48c7-a10e-9884afcdc748 Jul 10 10:14:05 devstack sudo[98232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:14:05 devstack sudo[98232]: pam_unix(sudo:session): session closed for user root Jul 10 10:14:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-e94939a2-6409-40f0-8a43-56a24bbc57d2 req-c7ee9b79-9f96-467f-ac17-d0146a3596a2 tempest-TestServerVolumeAttachmentScenario-2059541924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ffaeaff6-8169-48c7-a10e-9884afcdc748" returned: 0 in 1.043s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:14:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-e94939a2-6409-40f0-8a43-56a24bbc57d2 req-c7ee9b79-9f96-467f-ac17-d0146a3596a2 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.082s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:14:06 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [req-e94939a2-6409-40f0-8a43-56a24bbc57d2 req-c7ee9b79-9f96-467f-ac17-d0146a3596a2 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091', 'name': 'volume-ffaeaff6-8169-48c7-a10e-9884afcdc748', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd0855145-bae5-45f5-a22b-f48527f835c7', 'enforce_multipath': True} {{(pid=87234) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 10:14:06 devstack cinder-volume[87234]: INFO cinder.volume.manager [req-e94939a2-6409-40f0-8a43-56a24bbc57d2 req-c7ee9b79-9f96-467f-ac17-d0146a3596a2 tempest-TestServerVolumeAttachmentScenario-2059541924 None] attachment_update completed successfully. Jul 10 10:14:12 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f248a7c7-073a-4aab-85eb-63a788cd1a17 tempest-VolumesActionsTest-778674190 None] Acquiring lock "cinder-0720f10d-0900-45e5-973e-f6dd0db0ab7d" by "attach_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:14:12 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f248a7c7-073a-4aab-85eb-63a788cd1a17 tempest-VolumesActionsTest-778674190 None] Lock "cinder-0720f10d-0900-45e5-973e-f6dd0db0ab7d" acquired by "attach_volume" :: waited 0.047s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:14:12 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-f248a7c7-073a-4aab-85eb-63a788cd1a17 tempest-VolumesActionsTest-778674190 None] Attaching volume 0720f10d-0900-45e5-973e-f6dd0db0ab7d to instance 78be2468-f515-465a-8f19-96e67234810d at mountpoint /dev/vdb on host None. Jul 10 10:14:12 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-f248a7c7-073a-4aab-85eb-63a788cd1a17 tempest-VolumesActionsTest-778674190 None] Attach volume completed successfully. Jul 10 10:14:12 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f248a7c7-073a-4aab-85eb-63a788cd1a17 tempest-VolumesActionsTest-778674190 None] Lock "cinder-0720f10d-0900-45e5-973e-f6dd0db0ab7d" released by "attach_volume" :: held 0.221s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:14:12 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-bacef7d5-d6c3-49bd-a2e2-d994278f0836 tempest-VolumesActionsTest-778674190 None] Acquiring lock "cinder-0720f10d-0900-45e5-973e-f6dd0db0ab7d-detach_volume" by "detach_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:14:12 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-bacef7d5-d6c3-49bd-a2e2-d994278f0836 tempest-VolumesActionsTest-778674190 None] Lock "cinder-0720f10d-0900-45e5-973e-f6dd0db0ab7d-detach_volume" acquired by "detach_volume" :: waited 0.030s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:14:12 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-bacef7d5-d6c3-49bd-a2e2-d994278f0836 tempest-VolumesActionsTest-778674190 None] Detaching volume 0720f10d-0900-45e5-973e-f6dd0db0ab7d from instance 78be2468-f515-465a-8f19-96e67234810d. Jul 10 10:14:12 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-bacef7d5-d6c3-49bd-a2e2-d994278f0836 tempest-VolumesActionsTest-778674190 None] Detach volume completed successfully. Jul 10 10:14:12 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-bacef7d5-d6c3-49bd-a2e2-d994278f0836 tempest-VolumesActionsTest-778674190 None] Lock "cinder-0720f10d-0900-45e5-973e-f6dd0db0ab7d-detach_volume" released by "detach_volume" :: held 0.109s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:14:19 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-ff98098d-4468-44b7-844e-0a7a1a96d70c req-ee6eb626-1150-4664-a00d-e8cdf0255254 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:14:19 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-ff98098d-4468-44b7-844e-0a7a1a96d70c req-ee6eb626-1150-4664-a00d-e8cdf0255254 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:14:19 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b405b08-52e1-4cde-a639-260126540a8e]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:14:19 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-ff98098d-4468-44b7-844e-0a7a1a96d70c req-ee6eb626-1150-4664-a00d-e8cdf0255254 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b21371e9-f11a-4ebc-99ab-1fbd85172fe6 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:14:19 devstack sudo[98860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b21371e9-f11a-4ebc-99ab-1fbd85172fe6 Jul 10 10:14:19 devstack sudo[98860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:14:19 devstack sudo[98860]: pam_unix(sudo:session): session closed for user root Jul 10 10:14:19 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-ff98098d-4468-44b7-844e-0a7a1a96d70c req-ee6eb626-1150-4664-a00d-e8cdf0255254 tempest-TestServerVolumeAttachmentScenario-2059541924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b21371e9-f11a-4ebc-99ab-1fbd85172fe6" returned: 0 in 0.785s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:14:19 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-ff98098d-4468-44b7-844e-0a7a1a96d70c req-ee6eb626-1150-4664-a00d-e8cdf0255254 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.820s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:14:19 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [req-ff98098d-4468-44b7-844e-0a7a1a96d70c req-ee6eb626-1150-4664-a00d-e8cdf0255254 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091', 'name': 'volume-b21371e9-f11a-4ebc-99ab-1fbd85172fe6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1b088e5c-83a8-4b1f-9d67-32508d500196', 'enforce_multipath': True} {{(pid=87234) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 10:14:19 devstack cinder-volume[87234]: INFO cinder.volume.manager [req-ff98098d-4468-44b7-844e-0a7a1a96d70c req-ee6eb626-1150-4664-a00d-e8cdf0255254 tempest-TestServerVolumeAttachmentScenario-2059541924 None] attachment_update completed successfully. Jul 10 10:14:25 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-40583a02-e347-492f-9cb5-4f5bdd448b74 tempest-AttachVolumeNegativeTest-1243032650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:14:25 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-40583a02-e347-492f-9cb5-4f5bdd448b74 tempest-AttachVolumeNegativeTest-1243032650 None] Flow 'volume_create_manager' (0d7b0889-6d8b-4fd4-96dd-0499a733078f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:14:25 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-40583a02-e347-492f-9cb5-4f5bdd448b74 tempest-AttachVolumeNegativeTest-1243032650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccb0abbc-9ce0-4bdf-8ecf-4cb0f253f720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:14:25 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-40583a02-e347-492f-9cb5-4f5bdd448b74 tempest-AttachVolumeNegativeTest-1243032650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccb0abbc-9ce0-4bdf-8ecf-4cb0f253f720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:14:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2027176443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68428cb2-39ae-4076-8966-41d751e1ca59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e45ed030cc4a4542858731861ac6abd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:14:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:14:25Z,use_quota=True,user_id='0cbeaefb02e34b5896c041bba985deb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:14:25 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-40583a02-e347-492f-9cb5-4f5bdd448b74 tempest-AttachVolumeNegativeTest-1243032650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6e368c4-107d-4fbb-baf5-2799cfebc952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:14:25 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-40583a02-e347-492f-9cb5-4f5bdd448b74 tempest-AttachVolumeNegativeTest-1243032650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6e368c4-107d-4fbb-baf5-2799cfebc952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:14:25 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-40583a02-e347-492f-9cb5-4f5bdd448b74 tempest-AttachVolumeNegativeTest-1243032650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03fc77e0-efd5-402d-a262-560dd988f7f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:14:25 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-40583a02-e347-492f-9cb5-4f5bdd448b74 tempest-AttachVolumeNegativeTest-1243032650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03fc77e0-efd5-402d-a262-560dd988f7f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68428cb2-39ae-4076-8966-41d751e1ca59', 'volume_name': 'volume-68428cb2-39ae-4076-8966-41d751e1ca59', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:14:25 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-40583a02-e347-492f-9cb5-4f5bdd448b74 tempest-AttachVolumeNegativeTest-1243032650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0eb10970-c61f-4931-a02b-dad58f76a269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:14:25 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-40583a02-e347-492f-9cb5-4f5bdd448b74 tempest-AttachVolumeNegativeTest-1243032650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0eb10970-c61f-4931-a02b-dad58f76a269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:14:25 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-40583a02-e347-492f-9cb5-4f5bdd448b74 tempest-AttachVolumeNegativeTest-1243032650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (160c889b-b7cf-4a12-bf89-38cdabb76838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:14:25 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-40583a02-e347-492f-9cb5-4f5bdd448b74 tempest-AttachVolumeNegativeTest-1243032650 None] Volume 68428cb2-39ae-4076-8966-41d751e1ca59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68428cb2-39ae-4076-8966-41d751e1ca59', 'volume_size': 1} Jul 10 10:14:25 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-40583a02-e347-492f-9cb5-4f5bdd448b74 tempest-AttachVolumeNegativeTest-1243032650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:14:25 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-40583a02-e347-492f-9cb5-4f5bdd448b74 tempest-AttachVolumeNegativeTest-1243032650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:14:25 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-40583a02-e347-492f-9cb5-4f5bdd448b74 tempest-AttachVolumeNegativeTest-1243032650 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:14:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2027176443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68428cb2-39ae-4076-8966-41d751e1ca59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e45ed030cc4a4542858731861ac6abd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:14:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:14:25Z,use_quota=True,user_id='0cbeaefb02e34b5896c041bba985deb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:14:25 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-40583a02-e347-492f-9cb5-4f5bdd448b74 tempest-AttachVolumeNegativeTest-1243032650 None] Creating volume 68428cb2-39ae-4076-8966-41d751e1ca59 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:14:25 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-40583a02-e347-492f-9cb5-4f5bdd448b74 tempest-AttachVolumeNegativeTest-1243032650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:14:25 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-40583a02-e347-492f-9cb5-4f5bdd448b74 tempest-AttachVolumeNegativeTest-1243032650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:14:25 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-40583a02-e347-492f-9cb5-4f5bdd448b74 tempest-AttachVolumeNegativeTest-1243032650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:14:25 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-40583a02-e347-492f-9cb5-4f5bdd448b74 tempest-AttachVolumeNegativeTest-1243032650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:14:25 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-40583a02-e347-492f-9cb5-4f5bdd448b74 tempest-AttachVolumeNegativeTest-1243032650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:14:25 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-40583a02-e347-492f-9cb5-4f5bdd448b74 tempest-AttachVolumeNegativeTest-1243032650 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:14:25 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-40583a02-e347-492f-9cb5-4f5bdd448b74 tempest-AttachVolumeNegativeTest-1243032650 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:14:25 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-40583a02-e347-492f-9cb5-4f5bdd448b74 tempest-AttachVolumeNegativeTest-1243032650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-68428cb2-39ae-4076-8966-41d751e1ca59 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:14:25 devstack sudo[98877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-68428cb2-39ae-4076-8966-41d751e1ca59 1073741824 Jul 10 10:14:25 devstack sudo[98877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:14:26 devstack sudo[98877]: pam_unix(sudo:session): session closed for user root Jul 10 10:14:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-40583a02-e347-492f-9cb5-4f5bdd448b74 tempest-AttachVolumeNegativeTest-1243032650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-68428cb2-39ae-4076-8966-41d751e1ca59 1073741824" returned: 0 in 0.954s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:14:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-40583a02-e347-492f-9cb5-4f5bdd448b74 tempest-AttachVolumeNegativeTest-1243032650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-68428cb2-39ae-4076-8966-41d751e1ca59 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:14:26 devstack sudo[98883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-68428cb2-39ae-4076-8966-41d751e1ca59 Jul 10 10:14:26 devstack sudo[98883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:14:26 devstack cinder-volume[87234]: INFO cinder.volume.manager [req-5c0c869c-2e12-4831-be17-b80c092b59b1 req-8561c950-a421-426e-8d25-8b05bbf0d5d4 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Terminate volume connection completed successfully. Jul 10 10:14:26 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [req-5c0c869c-2e12-4831-be17-b80c092b59b1 req-8561c950-a421-426e-8d25-8b05bbf0d5d4 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Deleting attachment 1b088e5c-83a8-4b1f-9d67-32508d500196. {{(pid=87234) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 10:14:27 devstack sudo[98883]: pam_unix(sudo:session): session closed for user root Jul 10 10:14:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-40583a02-e347-492f-9cb5-4f5bdd448b74 tempest-AttachVolumeNegativeTest-1243032650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-68428cb2-39ae-4076-8966-41d751e1ca59" returned: 0 in 0.864s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:14:27 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-40583a02-e347-492f-9cb5-4f5bdd448b74 tempest-AttachVolumeNegativeTest-1243032650 None] <== create_volume: return (1875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:14:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-40583a02-e347-492f-9cb5-4f5bdd448b74 tempest-AttachVolumeNegativeTest-1243032650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.879s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:14:27 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-40583a02-e347-492f-9cb5-4f5bdd448b74 tempest-AttachVolumeNegativeTest-1243032650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (160c889b-b7cf-4a12-bf89-38cdabb76838) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68428cb2-39ae-4076-8966-41d751e1ca59', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:14:27 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-40583a02-e347-492f-9cb5-4f5bdd448b74 tempest-AttachVolumeNegativeTest-1243032650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23b6a0df-47bb-4b20-9eae-8155c03510e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:14:27 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-40583a02-e347-492f-9cb5-4f5bdd448b74 tempest-AttachVolumeNegativeTest-1243032650 None] Volume volume-68428cb2-39ae-4076-8966-41d751e1ca59 (68428cb2-39ae-4076-8966-41d751e1ca59): created successfully Jul 10 10:14:27 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-40583a02-e347-492f-9cb5-4f5bdd448b74 tempest-AttachVolumeNegativeTest-1243032650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23b6a0df-47bb-4b20-9eae-8155c03510e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:14:27 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-40583a02-e347-492f-9cb5-4f5bdd448b74 tempest-AttachVolumeNegativeTest-1243032650 None] Flow 'volume_create_manager' (0d7b0889-6d8b-4fd4-96dd-0499a733078f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:14:27 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-40583a02-e347-492f-9cb5-4f5bdd448b74 tempest-AttachVolumeNegativeTest-1243032650 None] Created volume successfully. Jul 10 10:14:30 devstack cinder-volume[87234]: INFO cinder.volume.manager [req-e04d5ae6-ed11-4e8c-b0f6-29689923aed7 req-4f31675a-d1b7-44bc-a88f-f2419a1b762c tempest-TestServerVolumeAttachmentScenario-2059541924 None] Terminate volume connection completed successfully. Jul 10 10:14:30 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [req-e04d5ae6-ed11-4e8c-b0f6-29689923aed7 req-4f31675a-d1b7-44bc-a88f-f2419a1b762c tempest-TestServerVolumeAttachmentScenario-2059541924 None] Deleting attachment d0855145-bae5-45f5-a22b-f48527f835c7. {{(pid=87234) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 10:14:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-cf60d903-22e0-4f7a-97fc-d43bb648ed67 req-ad8f7e3e-5fcc-4ab2-8ace-2cba71a0bb8d tempest-AttachVolumeNegativeTest-1243032650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:14:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-cf60d903-22e0-4f7a-97fc-d43bb648ed67 req-ad8f7e3e-5fcc-4ab2-8ace-2cba71a0bb8d tempest-AttachVolumeNegativeTest-1243032650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:14:31 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b810d3a-57a8-4cff-91e7-8cdc20a99650]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:14:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-cf60d903-22e0-4f7a-97fc-d43bb648ed67 req-ad8f7e3e-5fcc-4ab2-8ace-2cba71a0bb8d tempest-AttachVolumeNegativeTest-1243032650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-68428cb2-39ae-4076-8966-41d751e1ca59 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:14:31 devstack sudo[99026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-68428cb2-39ae-4076-8966-41d751e1ca59 Jul 10 10:14:31 devstack sudo[99026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:14:32 devstack sudo[99026]: pam_unix(sudo:session): session closed for user root Jul 10 10:14:32 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-cf60d903-22e0-4f7a-97fc-d43bb648ed67 req-ad8f7e3e-5fcc-4ab2-8ace-2cba71a0bb8d tempest-AttachVolumeNegativeTest-1243032650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-68428cb2-39ae-4076-8966-41d751e1ca59" returned: 0 in 0.816s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:14:32 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-cf60d903-22e0-4f7a-97fc-d43bb648ed67 req-ad8f7e3e-5fcc-4ab2-8ace-2cba71a0bb8d tempest-AttachVolumeNegativeTest-1243032650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.832s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:14:32 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [req-cf60d903-22e0-4f7a-97fc-d43bb648ed67 req-ad8f7e3e-5fcc-4ab2-8ace-2cba71a0bb8d tempest-AttachVolumeNegativeTest-1243032650 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091', 'name': 'volume-68428cb2-39ae-4076-8966-41d751e1ca59', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1c8ed639-838e-485c-a41a-fac2472bc324', 'enforce_multipath': True} {{(pid=87234) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 10:14:32 devstack cinder-volume[87234]: INFO cinder.volume.manager [req-cf60d903-22e0-4f7a-97fc-d43bb648ed67 req-ad8f7e3e-5fcc-4ab2-8ace-2cba71a0bb8d tempest-AttachVolumeNegativeTest-1243032650 None] attachment_update completed successfully. Jul 10 10:14:37 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-34c5764f-29d7-401a-91a1-18cfebab0ebe tempest-VolumesActionsTest-778674190 None] Acquiring lock "cinder-0720f10d-0900-45e5-973e-f6dd0db0ab7d" by "attach_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:14:37 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-34c5764f-29d7-401a-91a1-18cfebab0ebe tempest-VolumesActionsTest-778674190 None] Lock "cinder-0720f10d-0900-45e5-973e-f6dd0db0ab7d" acquired by "attach_volume" :: waited 0.026s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:14:37 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-34c5764f-29d7-401a-91a1-18cfebab0ebe tempest-VolumesActionsTest-778674190 None] Attaching volume 0720f10d-0900-45e5-973e-f6dd0db0ab7d to instance 7d1e47e2-8116-4960-bf0b-370b117ae345 at mountpoint /dev/vdb on host None. Jul 10 10:14:37 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-34c5764f-29d7-401a-91a1-18cfebab0ebe tempest-VolumesActionsTest-778674190 None] Attach volume completed successfully. Jul 10 10:14:37 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-34c5764f-29d7-401a-91a1-18cfebab0ebe tempest-VolumesActionsTest-778674190 None] Lock "cinder-0720f10d-0900-45e5-973e-f6dd0db0ab7d" released by "attach_volume" :: held 0.114s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:14:38 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-4360e15f-abd4-4742-ba1c-2c7a27fc09d4 tempest-VolumesActionsTest-778674190 None] Acquiring lock "cinder-0720f10d-0900-45e5-973e-f6dd0db0ab7d-detach_volume" by "detach_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:14:38 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-4360e15f-abd4-4742-ba1c-2c7a27fc09d4 tempest-VolumesActionsTest-778674190 None] Lock "cinder-0720f10d-0900-45e5-973e-f6dd0db0ab7d-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:14:38 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-4360e15f-abd4-4742-ba1c-2c7a27fc09d4 tempest-VolumesActionsTest-778674190 None] Detaching volume 0720f10d-0900-45e5-973e-f6dd0db0ab7d from instance 7d1e47e2-8116-4960-bf0b-370b117ae345. Jul 10 10:14:38 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-4360e15f-abd4-4742-ba1c-2c7a27fc09d4 tempest-VolumesActionsTest-778674190 None] Detach volume completed successfully. Jul 10 10:14:38 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-4360e15f-abd4-4742-ba1c-2c7a27fc09d4 tempest-VolumesActionsTest-778674190 None] Lock "cinder-0720f10d-0900-45e5-973e-f6dd0db0ab7d-detach_volume" released by "detach_volume" :: held 0.067s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:14:38 devstack cinder-volume[87234]: INFO cinder.volume.manager [req-9d1fd0fd-b43d-49b7-b85e-18e74433203d req-314e0dcf-9e1e-4abd-9598-28db835ff7bb tempest-AttachVolumeNegativeTest-1243032650 None] Terminate volume connection completed successfully. Jul 10 10:14:38 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [req-9d1fd0fd-b43d-49b7-b85e-18e74433203d req-314e0dcf-9e1e-4abd-9598-28db835ff7bb tempest-AttachVolumeNegativeTest-1243032650 None] Deleting attachment 1c8ed639-838e-485c-a41a-fac2472bc324. {{(pid=87234) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 10:14:41 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-a5086c56-7777-44bb-99b8-4e96539b50d8 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Acquiring lock "cinder-b21371e9-f11a-4ebc-99ab-1fbd85172fe6-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:14:41 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-a5086c56-7777-44bb-99b8-4e96539b50d8 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Lock "cinder-b21371e9-f11a-4ebc-99ab-1fbd85172fe6-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:14:41 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-a5086c56-7777-44bb-99b8-4e96539b50d8 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Acquiring lock "cinder-quobyte-b21371e9-f11a-4ebc-99ab-1fbd85172fe6" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:14:41 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-a5086c56-7777-44bb-99b8-4e96539b50d8 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Lock "cinder-quobyte-b21371e9-f11a-4ebc-99ab-1fbd85172fe6" acquired by "delete_volume" :: waited 0.027s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:14:41 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[2136c4bc-a298-4869-a0a5-857429d36f01]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:14:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a5086c56-7777-44bb-99b8-4e96539b50d8 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b21371e9-f11a-4ebc-99ab-1fbd85172fe6 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:14:41 devstack sudo[99152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b21371e9-f11a-4ebc-99ab-1fbd85172fe6 Jul 10 10:14:41 devstack sudo[99152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:14:42 devstack cinder-volume[87234]: DEBUG oslo_service.periodic_task [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 10:14:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:14:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:14:42 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:14:42 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:14:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:14:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:14:42 devstack sudo[99164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:14:42 devstack sudo[99164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:14:42 devstack sudo[99152]: pam_unix(sudo:session): session closed for user root Jul 10 10:14:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a5086c56-7777-44bb-99b8-4e96539b50d8 tempest-TestServerVolumeAttachmentScenario-2059541924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b21371e9-f11a-4ebc-99ab-1fbd85172fe6" returned: 0 in 1.041s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:14:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a5086c56-7777-44bb-99b8-4e96539b50d8 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b21371e9-f11a-4ebc-99ab-1fbd85172fe6 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:14:42 devstack sudo[99169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b21371e9-f11a-4ebc-99ab-1fbd85172fe6 Jul 10 10:14:42 devstack sudo[99169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:14:42 devstack sudo[99164]: pam_unix(sudo:session): session closed for user root Jul 10 10:14:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.809s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:14:42 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:14:42 devstack cinder-volume[87234]: DEBUG oslo_service.periodic_task [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Running periodic task VolumeManager._thread_info {{(pid=87234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 10:14:42 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] thread count: 28 {{(pid=87234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 10:14:42 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] thread info: [<_MainThread(MainThread, started 131600773742720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 10:14:43 devstack sudo[99169]: pam_unix(sudo:session): session closed for user root Jul 10 10:14:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a5086c56-7777-44bb-99b8-4e96539b50d8 tempest-TestServerVolumeAttachmentScenario-2059541924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b21371e9-f11a-4ebc-99ab-1fbd85172fe6" returned: 0 in 0.709s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:14:43 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-a5086c56-7777-44bb-99b8-4e96539b50d8 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Lock "cinder-quobyte-b21371e9-f11a-4ebc-99ab-1fbd85172fe6" released by "delete_volume" :: held 1.855s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:14:43 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-a5086c56-7777-44bb-99b8-4e96539b50d8 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Created reservations ['962dea80-7351-4907-a539-ef80374e6e14', 'fabc31b8-d75a-4607-b985-17cd4bf45e93', '058f00d2-4bd5-4dab-9e6c-702750a4418a', '99d3cb0d-7a49-4769-81ec-740db31b7772'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:14:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-a5086c56-7777-44bb-99b8-4e96539b50d8 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:14:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-a5086c56-7777-44bb-99b8-4e96539b50d8 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:14:43 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-a5086c56-7777-44bb-99b8-4e96539b50d8 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:14:43 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-a5086c56-7777-44bb-99b8-4e96539b50d8 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:14:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-a5086c56-7777-44bb-99b8-4e96539b50d8 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:14:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a5086c56-7777-44bb-99b8-4e96539b50d8 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:14:43 devstack sudo[99187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:14:43 devstack sudo[99187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:14:43 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-b5ca9334-0cad-4dd7-8d73-cbe6f2c79eb9 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Acquiring lock "cinder-ffaeaff6-8169-48c7-a10e-9884afcdc748-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:14:43 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-b5ca9334-0cad-4dd7-8d73-cbe6f2c79eb9 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Lock "cinder-ffaeaff6-8169-48c7-a10e-9884afcdc748-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:14:43 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-b5ca9334-0cad-4dd7-8d73-cbe6f2c79eb9 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Acquiring lock "cinder-quobyte-ffaeaff6-8169-48c7-a10e-9884afcdc748" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:14:43 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-b5ca9334-0cad-4dd7-8d73-cbe6f2c79eb9 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Lock "cinder-quobyte-ffaeaff6-8169-48c7-a10e-9884afcdc748" acquired by "delete_volume" :: waited 0.022s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:14:43 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[38839b69-9bef-4aed-a4e2-454ef59022b9]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:14:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-b5ca9334-0cad-4dd7-8d73-cbe6f2c79eb9 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ffaeaff6-8169-48c7-a10e-9884afcdc748 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:14:43 devstack sudo[99193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ffaeaff6-8169-48c7-a10e-9884afcdc748 Jul 10 10:14:43 devstack sudo[99193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:14:44 devstack sudo[99187]: pam_unix(sudo:session): session closed for user root Jul 10 10:14:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a5086c56-7777-44bb-99b8-4e96539b50d8 tempest-TestServerVolumeAttachmentScenario-2059541924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.944s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:14:44 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-a5086c56-7777-44bb-99b8-4e96539b50d8 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:14:44 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-a5086c56-7777-44bb-99b8-4e96539b50d8 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Deleted volume successfully. Jul 10 10:14:44 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-a5086c56-7777-44bb-99b8-4e96539b50d8 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Lock "cinder-b21371e9-f11a-4ebc-99ab-1fbd85172fe6-delete_volume" released by "delete_volume" :: held 3.183s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:14:44 devstack sudo[99193]: pam_unix(sudo:session): session closed for user root Jul 10 10:14:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-b5ca9334-0cad-4dd7-8d73-cbe6f2c79eb9 tempest-TestServerVolumeAttachmentScenario-2059541924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ffaeaff6-8169-48c7-a10e-9884afcdc748" returned: 0 in 1.111s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:14:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-b5ca9334-0cad-4dd7-8d73-cbe6f2c79eb9 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ffaeaff6-8169-48c7-a10e-9884afcdc748 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:14:44 devstack sudo[99204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ffaeaff6-8169-48c7-a10e-9884afcdc748 Jul 10 10:14:44 devstack sudo[99204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:14:45 devstack sudo[99204]: pam_unix(sudo:session): session closed for user root Jul 10 10:14:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-b5ca9334-0cad-4dd7-8d73-cbe6f2c79eb9 tempest-TestServerVolumeAttachmentScenario-2059541924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ffaeaff6-8169-48c7-a10e-9884afcdc748" returned: 0 in 0.757s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:14:45 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-b5ca9334-0cad-4dd7-8d73-cbe6f2c79eb9 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Lock "cinder-quobyte-ffaeaff6-8169-48c7-a10e-9884afcdc748" released by "delete_volume" :: held 1.952s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:14:45 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-b5ca9334-0cad-4dd7-8d73-cbe6f2c79eb9 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Created reservations ['7179f5e6-a611-4aa3-b385-e375524c9c61', 'eadfbe46-d1e5-482d-9075-41e3e6874e4f', '1680f8e2-701e-4589-8505-92247014de27', '1ac215aa-5b06-4dca-9ecb-504c91865310'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:14:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-b5ca9334-0cad-4dd7-8d73-cbe6f2c79eb9 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:14:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-b5ca9334-0cad-4dd7-8d73-cbe6f2c79eb9 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:14:45 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-b5ca9334-0cad-4dd7-8d73-cbe6f2c79eb9 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:14:45 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-b5ca9334-0cad-4dd7-8d73-cbe6f2c79eb9 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:14:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-b5ca9334-0cad-4dd7-8d73-cbe6f2c79eb9 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:14:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-b5ca9334-0cad-4dd7-8d73-cbe6f2c79eb9 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:14:45 devstack sudo[99207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:14:45 devstack sudo[99207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:14:46 devstack sudo[99207]: pam_unix(sudo:session): session closed for user root Jul 10 10:14:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-b5ca9334-0cad-4dd7-8d73-cbe6f2c79eb9 tempest-TestServerVolumeAttachmentScenario-2059541924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.812s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:14:46 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-b5ca9334-0cad-4dd7-8d73-cbe6f2c79eb9 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:14:46 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-b5ca9334-0cad-4dd7-8d73-cbe6f2c79eb9 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Deleted volume successfully. Jul 10 10:14:46 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-b5ca9334-0cad-4dd7-8d73-cbe6f2c79eb9 tempest-TestServerVolumeAttachmentScenario-2059541924 None] Lock "cinder-ffaeaff6-8169-48c7-a10e-9884afcdc748-delete_volume" released by "delete_volume" :: held 3.052s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:14:47 devstack cinder-volume[87234]: INFO cinder.volume.manager [req-6e3daed5-9549-47be-a85c-4953bb94a619 req-f99996c6-738d-4122-a967-d1c25a1b5180 tempest-TestShelveInstance-276001208 None] Terminate volume connection completed successfully. Jul 10 10:14:47 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [req-6e3daed5-9549-47be-a85c-4953bb94a619 req-f99996c6-738d-4122-a967-d1c25a1b5180 tempest-TestShelveInstance-276001208 None] Deleting attachment 53e8c0d3-d17d-4bc7-9006-3e60dda66876. {{(pid=87234) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 10:14:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-0865c534-2173-468d-a50f-ca48a4178fe2 tempest-VolumesActionsTest-778674190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:14:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-0865c534-2173-468d-a50f-ca48a4178fe2 tempest-VolumesActionsTest-778674190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:14:49 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac1c2e4-49c3-4107-8afe-6165c2e054e1]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:14:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0865c534-2173-468d-a50f-ca48a4178fe2 tempest-VolumesActionsTest-778674190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0720f10d-0900-45e5-973e-f6dd0db0ab7d {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:14:49 devstack sudo[99233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0720f10d-0900-45e5-973e-f6dd0db0ab7d Jul 10 10:14:49 devstack sudo[99233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:14:50 devstack sudo[99233]: pam_unix(sudo:session): session closed for user root Jul 10 10:14:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0865c534-2173-468d-a50f-ca48a4178fe2 tempest-VolumesActionsTest-778674190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0720f10d-0900-45e5-973e-f6dd0db0ab7d" returned: 0 in 0.915s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:14:50 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f2c1e0-f8c0-4f4a-ba15-f925768317ba]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:14:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0865c534-2173-468d-a50f-ca48a4178fe2 tempest-VolumesActionsTest-778674190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0720f10d-0900-45e5-973e-f6dd0db0ab7d {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:14:50 devstack sudo[99238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0720f10d-0900-45e5-973e-f6dd0db0ab7d Jul 10 10:14:50 devstack sudo[99238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:14:51 devstack sudo[99238]: pam_unix(sudo:session): session closed for user root Jul 10 10:14:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0865c534-2173-468d-a50f-ca48a4178fe2 tempest-VolumesActionsTest-778674190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0720f10d-0900-45e5-973e-f6dd0db0ab7d" returned: 0 in 0.960s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:14:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0865c534-2173-468d-a50f-ca48a4178fe2 tempest-VolumesActionsTest-778674190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0720f10d-0900-45e5-973e-f6dd0db0ab7d /opt/stack/data/cinder/conversion/0720f10d-0900-45e5-973e-f6dd0db0ab7d.temp_image.dacf0213-a249-4c4f-9d90-07d70e7d231fl9ktyxj4.img {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:14:51 devstack sudo[99244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0720f10d-0900-45e5-973e-f6dd0db0ab7d /opt/stack/data/cinder/conversion/0720f10d-0900-45e5-973e-f6dd0db0ab7d.temp_image.dacf0213-a249-4c4f-9d90-07d70e7d231fl9ktyxj4.img Jul 10 10:14:51 devstack sudo[99244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:14:57 devstack sudo[99244]: pam_unix(sudo:session): session closed for user root Jul 10 10:14:57 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0865c534-2173-468d-a50f-ca48a4178fe2 tempest-VolumesActionsTest-778674190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0720f10d-0900-45e5-973e-f6dd0db0ab7d /opt/stack/data/cinder/conversion/0720f10d-0900-45e5-973e-f6dd0db0ab7d.temp_image.dacf0213-a249-4c4f-9d90-07d70e7d231fl9ktyxj4.img" returned: 0 in 5.957s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:14:57 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[313b4429-8a3d-41e1-b8b8-42c520dd40a0]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:14:57 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0865c534-2173-468d-a50f-ca48a4178fe2 tempest-VolumesActionsTest-778674190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0720f10d-0900-45e5-973e-f6dd0db0ab7d {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:14:57 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-bc05371e-e786-4893-8c8d-c85059659445 req-159ec1f8-7b29-4150-b042-8d8a2fb1687d tempest-TestShelveInstance-276001208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:14:57 devstack sudo[99270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0720f10d-0900-45e5-973e-f6dd0db0ab7d Jul 10 10:14:57 devstack sudo[99270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:14:58 devstack sudo[99270]: pam_unix(sudo:session): session closed for user root Jul 10 10:14:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0865c534-2173-468d-a50f-ca48a4178fe2 tempest-VolumesActionsTest-778674190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0720f10d-0900-45e5-973e-f6dd0db0ab7d" returned: 0 in 1.415s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:14:58 devstack cinder-volume[87234]: DEBUG cinder.image.image_utils [None req-0865c534-2173-468d-a50f-ca48a4178fe2 tempest-VolumesActionsTest-778674190 None] Image conversion details: src /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0720f10d-0900-45e5-973e-f6dd0db0ab7d, size 1024.00 MB, duration 5.96 sec, destination /opt/stack/data/cinder/conversion/0720f10d-0900-45e5-973e-f6dd0db0ab7d.temp_image.dacf0213-a249-4c4f-9d90-07d70e7d231fl9ktyxj4.img {{(pid=87234) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 10:14:58 devstack cinder-volume[87234]: INFO cinder.image.image_utils [None req-0865c534-2173-468d-a50f-ca48a4178fe2 tempest-VolumesActionsTest-778674190 None] Converted 1024.00 MB image at 171.85 MB/s Jul 10 10:14:58 devstack cinder-volume[87234]: DEBUG cinder.image.image_utils [None req-0865c534-2173-468d-a50f-ca48a4178fe2 tempest-VolumesActionsTest-778674190 None] dacf0213-a249-4c4f-9d90-07d70e7d231f was raw, no need to convert to raw {{(pid=87234) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 10 10:15:07 devstack cinder-volume[87234]: DEBUG dbcounter [-] [87234] Writing DB stats cinder:SELECT=44,cinder:UPDATE=36,cinder:INSERT=7,cinder:DELETE=1 {{(pid=87234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 10:15:07 devstack cinder-volume[87234]: DEBUG dbcounter [-] [87234] Writing DB stats cinder:SELECT=64,cinder:UPDATE=27,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 10:15:07 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-85763dc2-ee41-4e26-bebd-8e9336f05fbf tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:15:07 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-85763dc2-ee41-4e26-bebd-8e9336f05fbf tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] Flow 'volume_create_manager' (19f7caf4-926a-4864-8012-29383560cb0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:15:07 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-85763dc2-ee41-4e26-bebd-8e9336f05fbf tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d80287b8-a6ab-4c4e-8ac9-1c459799900b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:15:07 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-85763dc2-ee41-4e26-bebd-8e9336f05fbf tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d80287b8-a6ab-4c4e-8ac9-1c459799900b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:15:07Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dbdf762-a82c-40f7-ad69-e15140f5c958,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9c6c4b4dd3a43be908836a5e11d48b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:15:07Z,use_quota=True,user_id='2ca5c48debbd414289fc37bd7945a4a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a728527-4de0-4d79-8342-d2b8de25bba8),volume_type_id=4a728527-4de0-4d79-8342-d2b8de25bba8)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:15:07 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-85763dc2-ee41-4e26-bebd-8e9336f05fbf tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b2dffb3-ff31-49d5-9248-318e1da21b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:15:07 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-85763dc2-ee41-4e26-bebd-8e9336f05fbf tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b2dffb3-ff31-49d5-9248-318e1da21b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:15:07 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-85763dc2-ee41-4e26-bebd-8e9336f05fbf tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db149608-d4ca-454f-986d-421d3e98ecba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:15:07 devstack cinder-volume[87234]: DEBUG cinder.image.glance [None req-85763dc2-ee41-4e26-bebd-8e9336f05fbf tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] Creating Keystone auth plugin from conf {{(pid=87234) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 10:15:07 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-85763dc2-ee41-4e26-bebd-8e9336f05fbf tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db149608-d4ca-454f-986d-421d3e98ecba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5dbdf762-a82c-40f7-ad69-e15140f5c958', 'volume_name': 'volume-5dbdf762-a82c-40f7-ad69-e15140f5c958', 'volume_size': 1, 'image_id': '148823db-f433-4129-9f8b-5e0d86dc3054', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/148823db-f433-4129-9f8b-5e0d86dc3054', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '31578b3a0a3c5eed75109de85374242d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c9c6c4b4dd3a43be908836a5e11d48b0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '63e908f7e857ffd3249e88ae252789a482d37ff1b93dd1095a06970890253399386865ea740e782992722c9331b94d4913b6547d2826e20f9f26410713827416', 'id': '148823db-f433-4129-9f8b-5e0d86dc3054', 'created_at': datetime.datetime(2026, 7, 10, 8, 15, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 8, 15, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/148823db-f433-4129-9f8b-5e0d86dc3054/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:15:07 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-85763dc2-ee41-4e26-bebd-8e9336f05fbf tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98e54976-0c28-42a0-ae63-a13efc048224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:15:07 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-85763dc2-ee41-4e26-bebd-8e9336f05fbf tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98e54976-0c28-42a0-ae63-a13efc048224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:15:07 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-85763dc2-ee41-4e26-bebd-8e9336f05fbf tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d768bf3-d0af-43e5-971c-f15c085aaff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:15:07 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-85763dc2-ee41-4e26-bebd-8e9336f05fbf tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] Volume 5dbdf762-a82c-40f7-ad69-e15140f5c958: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5dbdf762-a82c-40f7-ad69-e15140f5c958', 'volume_size': 1, 'image_id': '148823db-f433-4129-9f8b-5e0d86dc3054', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/148823db-f433-4129-9f8b-5e0d86dc3054', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '31578b3a0a3c5eed75109de85374242d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c9c6c4b4dd3a43be908836a5e11d48b0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '63e908f7e857ffd3249e88ae252789a482d37ff1b93dd1095a06970890253399386865ea740e782992722c9331b94d4913b6547d2826e20f9f26410713827416', 'id': '148823db-f433-4129-9f8b-5e0d86dc3054', 'created_at': datetime.datetime(2026, 7, 10, 8, 15, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 8, 15, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/148823db-f433-4129-9f8b-5e0d86dc3054/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 10 10:15:07 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-85763dc2-ee41-4e26-bebd-8e9336f05fbf tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] Trying to clone 5dbdf762-a82c-40f7-ad69-e15140f5c958 from image 148823db-f433-4129-9f8b-5e0d86dc3054 at location (None, [{'url': 'file:///opt/stack/data/glance/images/148823db-f433-4129-9f8b-5e0d86dc3054', 'metadata': {}}]). {{(pid=87234) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 10:15:07 devstack cinder-volume[87234]: DEBUG cinder.image.image_utils [None req-85763dc2-ee41-4e26-bebd-8e9336f05fbf tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_148823db-f433-4129-9f8b-5e0d86dc3054_3wx_3vbpdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87234) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 10:15:07 devstack cinder-volume[87234]: INFO cinder.image.image_utils [None req-85763dc2-ee41-4e26-bebd-8e9336f05fbf tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] Image download 0.00 MB at 0.00 MB/s Jul 10 10:15:07 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ed3f4d-daef-4e53-ba62-236f37384210]: (4, 'raw') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:15:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-85763dc2-ee41-4e26-bebd-8e9336f05fbf tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_148823db-f433-4129-9f8b-5e0d86dc3054_3wx_3vbpdevstack@QuobyteHD {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:15:08 devstack sudo[99307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_148823db-f433-4129-9f8b-5e0d86dc3054_3wx_3vbpdevstack@QuobyteHD Jul 10 10:15:08 devstack sudo[99307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:15:08 devstack sudo[99307]: pam_unix(sudo:session): session closed for user root Jul 10 10:15:08 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-85763dc2-ee41-4e26-bebd-8e9336f05fbf tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_148823db-f433-4129-9f8b-5e0d86dc3054_3wx_3vbpdevstack@QuobyteHD" returned: 0 in 0.802s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:15:08 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-85763dc2-ee41-4e26-bebd-8e9336f05fbf tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_148823db-f433-4129-9f8b-5e0d86dc3054_3wx_3vbpdevstack@QuobyteHD {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:15:08 devstack sudo[99311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_148823db-f433-4129-9f8b-5e0d86dc3054_3wx_3vbpdevstack@QuobyteHD Jul 10 10:15:08 devstack sudo[99311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:15:09 devstack sudo[99311]: pam_unix(sudo:session): session closed for user root Jul 10 10:15:09 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-85763dc2-ee41-4e26-bebd-8e9336f05fbf tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_148823db-f433-4129-9f8b-5e0d86dc3054_3wx_3vbpdevstack@QuobyteHD" returned: 1 in 0.891s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:15:09 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-85763dc2-ee41-4e26-bebd-8e9336f05fbf tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_148823db-f433-4129-9f8b-5e0d86dc3054_3wx_3vbpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 10:15:09 devstack cinder-volume[87234]: DEBUG cinder.image.image_utils [None req-85763dc2-ee41-4e26-bebd-8e9336f05fbf tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] Temporary image 148823db-f433-4129-9f8b-5e0d86dc3054 is fetched for user 2ca5c48debbd414289fc37bd7945a4a2. {{(pid=87234) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 10:15:09 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0aac52-456e-4b69-a5c6-246d2bbae62a]: (4, 'raw') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:15:09 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-85763dc2-ee41-4e26-bebd-8e9336f05fbf tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_148823db-f433-4129-9f8b-5e0d86dc3054_3wx_3vbpdevstack@QuobyteHD {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:15:09 devstack sudo[99316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_148823db-f433-4129-9f8b-5e0d86dc3054_3wx_3vbpdevstack@QuobyteHD Jul 10 10:15:09 devstack sudo[99316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:15:11 devstack sudo[99316]: pam_unix(sudo:session): session closed for user root Jul 10 10:15:11 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-85763dc2-ee41-4e26-bebd-8e9336f05fbf tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_148823db-f433-4129-9f8b-5e0d86dc3054_3wx_3vbpdevstack@QuobyteHD" returned: 0 in 1.422s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:15:11 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-85763dc2-ee41-4e26-bebd-8e9336f05fbf tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_148823db-f433-4129-9f8b-5e0d86dc3054_3wx_3vbpdevstack@QuobyteHD {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:15:11 devstack sudo[99366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_148823db-f433-4129-9f8b-5e0d86dc3054_3wx_3vbpdevstack@QuobyteHD Jul 10 10:15:11 devstack sudo[99366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:15:12 devstack sudo[99366]: pam_unix(sudo:session): session closed for user root Jul 10 10:15:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-85763dc2-ee41-4e26-bebd-8e9336f05fbf tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_148823db-f433-4129-9f8b-5e0d86dc3054_3wx_3vbpdevstack@QuobyteHD" returned: 1 in 0.978s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:15:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-85763dc2-ee41-4e26-bebd-8e9336f05fbf tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_148823db-f433-4129-9f8b-5e0d86dc3054_3wx_3vbpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 10:15:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-85763dc2-ee41-4e26-bebd-8e9336f05fbf tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:15:19 devstack cinder-volume[87234]: DEBUG dbcounter [-] [87234] Writing DB stats cinder:SELECT=1 {{(pid=87234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 10:15:19 devstack cinder-volume[87234]: DEBUG dbcounter [-] [87234] Writing DB stats cinder:SELECT=2,cinder:INSERT=1 {{(pid=87234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 10:15:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-0865c534-2173-468d-a50f-ca48a4178fe2 tempest-VolumesActionsTest-778674190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 33.330s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:15:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-0865c534-2173-468d-a50f-ca48a4178fe2 tempest-VolumesActionsTest-778674190 None] Uploaded volume to glance image-id: dacf0213-a249-4c4f-9d90-07d70e7d231f. {{(pid=87234) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 10 10:15:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-bc05371e-e786-4893-8c8d-c85059659445 req-159ec1f8-7b29-4150-b042-8d8a2fb1687d tempest-TestShelveInstance-276001208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 25.268s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:15:22 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[64822929-6042-4c0a-a8bd-b7853cb4307e]: (4, 'raw') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:15:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-bc05371e-e786-4893-8c8d-c85059659445 req-159ec1f8-7b29-4150-b042-8d8a2fb1687d tempest-TestShelveInstance-276001208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0475ede2-b806-4549-95bd-25c6bb4298ff {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:15:22 devstack sudo[99437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0475ede2-b806-4549-95bd-25c6bb4298ff Jul 10 10:15:22 devstack sudo[99437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:15:23 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-0865c534-2173-468d-a50f-ca48a4178fe2 tempest-VolumesActionsTest-778674190 None] Copy volume to image completed successfully. Jul 10 10:15:23 devstack sudo[99437]: pam_unix(sudo:session): session closed for user root Jul 10 10:15:23 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-bc05371e-e786-4893-8c8d-c85059659445 req-159ec1f8-7b29-4150-b042-8d8a2fb1687d tempest-TestShelveInstance-276001208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0475ede2-b806-4549-95bd-25c6bb4298ff" returned: 0 in 0.860s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:15:23 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-bc05371e-e786-4893-8c8d-c85059659445 req-159ec1f8-7b29-4150-b042-8d8a2fb1687d tempest-TestShelveInstance-276001208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0475ede2-b806-4549-95bd-25c6bb4298ff {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:15:23 devstack sudo[99441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0475ede2-b806-4549-95bd-25c6bb4298ff Jul 10 10:15:23 devstack sudo[99441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:15:23 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-eeba5fd6-a62a-4fdf-ba54-ec3c2bcb4328 tempest-VolumesActionsTest-778674190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:15:24 devstack sudo[99441]: pam_unix(sudo:session): session closed for user root Jul 10 10:15:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-bc05371e-e786-4893-8c8d-c85059659445 req-159ec1f8-7b29-4150-b042-8d8a2fb1687d tempest-TestShelveInstance-276001208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0475ede2-b806-4549-95bd-25c6bb4298ff" returned: 1 in 0.807s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:15:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-bc05371e-e786-4893-8c8d-c85059659445 req-159ec1f8-7b29-4150-b042-8d8a2fb1687d tempest-TestShelveInstance-276001208 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0475ede2-b806-4549-95bd-25c6bb4298ff' failed. Not Retrying. {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 10:15:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-bc05371e-e786-4893-8c8d-c85059659445 req-159ec1f8-7b29-4150-b042-8d8a2fb1687d tempest-TestShelveInstance-276001208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.742s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:15:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-85763dc2-ee41-4e26-bebd-8e9336f05fbf tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.181s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:15:24 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-85763dc2-ee41-4e26-bebd-8e9336f05fbf tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:15:07Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dbdf762-a82c-40f7-ad69-e15140f5c958,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9c6c4b4dd3a43be908836a5e11d48b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:15:07Z,use_quota=True,user_id='2ca5c48debbd414289fc37bd7945a4a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a728527-4de0-4d79-8342-d2b8de25bba8),volume_type_id=4a728527-4de0-4d79-8342-d2b8de25bba8)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:15:24 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-85763dc2-ee41-4e26-bebd-8e9336f05fbf tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] Creating volume 5dbdf762-a82c-40f7-ad69-e15140f5c958 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:15:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-85763dc2-ee41-4e26-bebd-8e9336f05fbf tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:15:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-85763dc2-ee41-4e26-bebd-8e9336f05fbf tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:15:24 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-85763dc2-ee41-4e26-bebd-8e9336f05fbf tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:15:24 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-85763dc2-ee41-4e26-bebd-8e9336f05fbf tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:15:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-85763dc2-ee41-4e26-bebd-8e9336f05fbf tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:15:24 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-85763dc2-ee41-4e26-bebd-8e9336f05fbf tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:15:24 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-85763dc2-ee41-4e26-bebd-8e9336f05fbf tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:15:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-85763dc2-ee41-4e26-bebd-8e9336f05fbf tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5dbdf762-a82c-40f7-ad69-e15140f5c958 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:15:24 devstack sudo[99446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5dbdf762-a82c-40f7-ad69-e15140f5c958 1073741824 Jul 10 10:15:24 devstack sudo[99446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:15:24 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [req-bc05371e-e786-4893-8c8d-c85059659445 req-159ec1f8-7b29-4150-b042-8d8a2fb1687d tempest-TestShelveInstance-276001208 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091', 'name': 'volume-0475ede2-b806-4549-95bd-25c6bb4298ff', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1cd849b5-a850-4cc4-acf2-f285986a8026', 'enforce_multipath': True} {{(pid=87234) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 10:15:24 devstack cinder-volume[87234]: INFO cinder.volume.manager [req-bc05371e-e786-4893-8c8d-c85059659445 req-159ec1f8-7b29-4150-b042-8d8a2fb1687d tempest-TestShelveInstance-276001208 None] attachment_update completed successfully. Jul 10 10:15:25 devstack sudo[99446]: pam_unix(sudo:session): session closed for user root Jul 10 10:15:25 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-85763dc2-ee41-4e26-bebd-8e9336f05fbf tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5dbdf762-a82c-40f7-ad69-e15140f5c958 1073741824" returned: 0 in 0.886s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:15:25 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-85763dc2-ee41-4e26-bebd-8e9336f05fbf tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5dbdf762-a82c-40f7-ad69-e15140f5c958 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:15:25 devstack sudo[99465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5dbdf762-a82c-40f7-ad69-e15140f5c958 Jul 10 10:15:25 devstack sudo[99465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:15:25 devstack sudo[99465]: pam_unix(sudo:session): session closed for user root Jul 10 10:15:25 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-85763dc2-ee41-4e26-bebd-8e9336f05fbf tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5dbdf762-a82c-40f7-ad69-e15140f5c958" returned: 0 in 0.649s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:15:25 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-85763dc2-ee41-4e26-bebd-8e9336f05fbf tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] <== create_volume: return (1616ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:15:25 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-85763dc2-ee41-4e26-bebd-8e9336f05fbf tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.620s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:15:25 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-eeba5fd6-a62a-4fdf-ba54-ec3c2bcb4328 tempest-VolumesActionsTest-778674190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.930s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:15:25 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bbd951d-4dfc-417a-8878-eb8ad91bba46]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:15:25 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-eeba5fd6-a62a-4fdf-ba54-ec3c2bcb4328 tempest-VolumesActionsTest-778674190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0720f10d-0900-45e5-973e-f6dd0db0ab7d {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:15:25 devstack cinder-volume[87234]: DEBUG cinder.volume.volume_utils [None req-85763dc2-ee41-4e26-bebd-8e9336f05fbf tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] Attempting download of 148823db-f433-4129-9f8b-5e0d86dc3054 ((None, [{'url': 'file:///opt/stack/data/glance/images/148823db-f433-4129-9f8b-5e0d86dc3054', 'metadata': {}}])) to volume 5dbdf762-a82c-40f7-ad69-e15140f5c958. {{(pid=87234) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 10:15:26 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[985a6dd4-e9ea-4778-a3d8-93d10057a787]: (4, 'raw') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:15:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-85763dc2-ee41-4e26-bebd-8e9336f05fbf tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_148823db-f433-4129-9f8b-5e0d86dc3054_youx3as1 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:15:26 devstack sudo[99471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0720f10d-0900-45e5-973e-f6dd0db0ab7d Jul 10 10:15:26 devstack sudo[99471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:15:26 devstack sudo[99472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_148823db-f433-4129-9f8b-5e0d86dc3054_youx3as1 Jul 10 10:15:26 devstack sudo[99472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:15:26 devstack sudo[99471]: pam_unix(sudo:session): session closed for user root Jul 10 10:15:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-eeba5fd6-a62a-4fdf-ba54-ec3c2bcb4328 tempest-VolumesActionsTest-778674190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0720f10d-0900-45e5-973e-f6dd0db0ab7d" returned: 0 in 0.796s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:15:26 devstack sudo[99472]: pam_unix(sudo:session): session closed for user root Jul 10 10:15:26 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[30eaa5f5-a334-4d57-990e-7da655cd9959]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:15:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-eeba5fd6-a62a-4fdf-ba54-ec3c2bcb4328 tempest-VolumesActionsTest-778674190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0720f10d-0900-45e5-973e-f6dd0db0ab7d {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:15:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-85763dc2-ee41-4e26-bebd-8e9336f05fbf tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_148823db-f433-4129-9f8b-5e0d86dc3054_youx3as1" returned: 0 in 0.756s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:15:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-85763dc2-ee41-4e26-bebd-8e9336f05fbf tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_148823db-f433-4129-9f8b-5e0d86dc3054_youx3as1 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:15:26 devstack sudo[99480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0720f10d-0900-45e5-973e-f6dd0db0ab7d Jul 10 10:15:26 devstack sudo[99480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:15:26 devstack sudo[99481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_148823db-f433-4129-9f8b-5e0d86dc3054_youx3as1 Jul 10 10:15:26 devstack sudo[99481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:15:27 devstack sudo[99481]: pam_unix(sudo:session): session closed for user root Jul 10 10:15:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-85763dc2-ee41-4e26-bebd-8e9336f05fbf tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_148823db-f433-4129-9f8b-5e0d86dc3054_youx3as1" returned: 1 in 0.789s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:15:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-85763dc2-ee41-4e26-bebd-8e9336f05fbf tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_148823db-f433-4129-9f8b-5e0d86dc3054_youx3as1' failed. Not Retrying. {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 10:15:27 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[953f4c89-0d1b-42a7-a27d-7108085eff5a]: (4, 'raw') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:15:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-85763dc2-ee41-4e26-bebd-8e9336f05fbf tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_148823db-f433-4129-9f8b-5e0d86dc3054_3wx_3vbpdevstack@QuobyteHD {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:15:27 devstack sudo[99480]: pam_unix(sudo:session): session closed for user root Jul 10 10:15:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-eeba5fd6-a62a-4fdf-ba54-ec3c2bcb4328 tempest-VolumesActionsTest-778674190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0720f10d-0900-45e5-973e-f6dd0db0ab7d" returned: 0 in 0.859s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:15:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-eeba5fd6-a62a-4fdf-ba54-ec3c2bcb4328 tempest-VolumesActionsTest-778674190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0720f10d-0900-45e5-973e-f6dd0db0ab7d /opt/stack/data/cinder/conversion/0720f10d-0900-45e5-973e-f6dd0db0ab7d.temp_image.49bd4496-02cf-4d0e-9fc6-a1bd5fdad0adadsf3o3e.img {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:15:27 devstack sudo[99492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0720f10d-0900-45e5-973e-f6dd0db0ab7d /opt/stack/data/cinder/conversion/0720f10d-0900-45e5-973e-f6dd0db0ab7d.temp_image.49bd4496-02cf-4d0e-9fc6-a1bd5fdad0adadsf3o3e.img Jul 10 10:15:27 devstack sudo[99492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:15:27 devstack sudo[99491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_148823db-f433-4129-9f8b-5e0d86dc3054_3wx_3vbpdevstack@QuobyteHD Jul 10 10:15:27 devstack sudo[99491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:15:28 devstack sudo[99491]: pam_unix(sudo:session): session closed for user root Jul 10 10:15:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-85763dc2-ee41-4e26-bebd-8e9336f05fbf tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_148823db-f433-4129-9f8b-5e0d86dc3054_3wx_3vbpdevstack@QuobyteHD" returned: 0 in 0.866s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:15:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-85763dc2-ee41-4e26-bebd-8e9336f05fbf tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_148823db-f433-4129-9f8b-5e0d86dc3054_3wx_3vbpdevstack@QuobyteHD {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:15:28 devstack sudo[99507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_148823db-f433-4129-9f8b-5e0d86dc3054_3wx_3vbpdevstack@QuobyteHD Jul 10 10:15:28 devstack sudo[99507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:15:30 devstack sudo[99507]: pam_unix(sudo:session): session closed for user root Jul 10 10:15:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-85763dc2-ee41-4e26-bebd-8e9336f05fbf tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_148823db-f433-4129-9f8b-5e0d86dc3054_3wx_3vbpdevstack@QuobyteHD" returned: 1 in 1.683s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:15:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-85763dc2-ee41-4e26-bebd-8e9336f05fbf tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_148823db-f433-4129-9f8b-5e0d86dc3054_3wx_3vbpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 10:15:30 devstack cinder-volume[87234]: DEBUG cinder.image.image_utils [None req-85763dc2-ee41-4e26-bebd-8e9336f05fbf tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] 148823db-f433-4129-9f8b-5e0d86dc3054 was raw, converting to raw {{(pid=87234) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 10:15:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-85763dc2-ee41-4e26-bebd-8e9336f05fbf tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_148823db-f433-4129-9f8b-5e0d86dc3054_3wx_3vbpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5dbdf762-a82c-40f7-ad69-e15140f5c958 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:15:30 devstack sudo[99519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_148823db-f433-4129-9f8b-5e0d86dc3054_3wx_3vbpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5dbdf762-a82c-40f7-ad69-e15140f5c958 Jul 10 10:15:30 devstack sudo[99519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:15:32 devstack sudo[99519]: pam_unix(sudo:session): session closed for user root Jul 10 10:15:32 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-85763dc2-ee41-4e26-bebd-8e9336f05fbf tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_148823db-f433-4129-9f8b-5e0d86dc3054_3wx_3vbpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5dbdf762-a82c-40f7-ad69-e15140f5c958" returned: 0 in 2.291s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:15:32 devstack cinder-volume[87234]: DEBUG cinder.image.image_utils [None req-85763dc2-ee41-4e26-bebd-8e9336f05fbf tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_148823db-f433-4129-9f8b-5e0d86dc3054_3wx_3vbpdevstack@QuobyteHD, size 0.00 MB, duration 2.30 sec, destination /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5dbdf762-a82c-40f7-ad69-e15140f5c958 {{(pid=87234) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 10:15:32 devstack cinder-volume[87234]: INFO cinder.image.image_utils [None req-85763dc2-ee41-4e26-bebd-8e9336f05fbf tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] Converted 0.00 MB image at 0.00 MB/s Jul 10 10:15:32 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-85763dc2-ee41-4e26-bebd-8e9336f05fbf tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5dbdf762-a82c-40f7-ad69-e15140f5c958 1G {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:15:32 devstack sudo[99526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5dbdf762-a82c-40f7-ad69-e15140f5c958 1G Jul 10 10:15:32 devstack sudo[99526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:15:33 devstack sudo[99492]: pam_unix(sudo:session): session closed for user root Jul 10 10:15:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-eeba5fd6-a62a-4fdf-ba54-ec3c2bcb4328 tempest-VolumesActionsTest-778674190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0720f10d-0900-45e5-973e-f6dd0db0ab7d /opt/stack/data/cinder/conversion/0720f10d-0900-45e5-973e-f6dd0db0ab7d.temp_image.49bd4496-02cf-4d0e-9fc6-a1bd5fdad0adadsf3o3e.img" returned: 0 in 5.599s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:15:33 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[960949a7-73c3-44d3-b6b6-d4ef05238da8]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:15:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-eeba5fd6-a62a-4fdf-ba54-ec3c2bcb4328 tempest-VolumesActionsTest-778674190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0720f10d-0900-45e5-973e-f6dd0db0ab7d {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:15:33 devstack sudo[99528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0720f10d-0900-45e5-973e-f6dd0db0ab7d Jul 10 10:15:33 devstack sudo[99528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:15:33 devstack sudo[99526]: pam_unix(sudo:session): session closed for user root Jul 10 10:15:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-85763dc2-ee41-4e26-bebd-8e9336f05fbf tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5dbdf762-a82c-40f7-ad69-e15140f5c958 1G" returned: 0 in 1.170s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:15:33 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee9e2af-193d-4a3b-baab-a45d80e14b48]: (4, 'raw') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:15:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-85763dc2-ee41-4e26-bebd-8e9336f05fbf tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5dbdf762-a82c-40f7-ad69-e15140f5c958 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:15:33 devstack sudo[99533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5dbdf762-a82c-40f7-ad69-e15140f5c958 Jul 10 10:15:33 devstack sudo[99533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:15:34 devstack sudo[99528]: pam_unix(sudo:session): session closed for user root Jul 10 10:15:34 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-eeba5fd6-a62a-4fdf-ba54-ec3c2bcb4328 tempest-VolumesActionsTest-778674190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0720f10d-0900-45e5-973e-f6dd0db0ab7d" returned: 0 in 1.037s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:15:34 devstack cinder-volume[87234]: DEBUG cinder.image.image_utils [None req-eeba5fd6-a62a-4fdf-ba54-ec3c2bcb4328 tempest-VolumesActionsTest-778674190 None] Image conversion details: src /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0720f10d-0900-45e5-973e-f6dd0db0ab7d, size 1024.00 MB, duration 5.60 sec, destination /opt/stack/data/cinder/conversion/0720f10d-0900-45e5-973e-f6dd0db0ab7d.temp_image.49bd4496-02cf-4d0e-9fc6-a1bd5fdad0adadsf3o3e.img {{(pid=87234) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 10:15:34 devstack cinder-volume[87234]: INFO cinder.image.image_utils [None req-eeba5fd6-a62a-4fdf-ba54-ec3c2bcb4328 tempest-VolumesActionsTest-778674190 None] Converted 1024.00 MB image at 182.83 MB/s Jul 10 10:15:34 devstack cinder-volume[87234]: DEBUG cinder.image.image_utils [None req-eeba5fd6-a62a-4fdf-ba54-ec3c2bcb4328 tempest-VolumesActionsTest-778674190 None] 49bd4496-02cf-4d0e-9fc6-a1bd5fdad0ad was raw, converting to qcow2 {{(pid=87234) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 10 10:15:34 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f7b47f-d93d-4336-9a75-bc74f16a36f6]: (4, 'raw') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:15:34 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-eeba5fd6-a62a-4fdf-ba54-ec3c2bcb4328 tempest-VolumesActionsTest-778674190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/0720f10d-0900-45e5-973e-f6dd0db0ab7d.temp_image.49bd4496-02cf-4d0e-9fc6-a1bd5fdad0adadsf3o3e.img {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:15:34 devstack sudo[99539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/0720f10d-0900-45e5-973e-f6dd0db0ab7d.temp_image.49bd4496-02cf-4d0e-9fc6-a1bd5fdad0adadsf3o3e.img Jul 10 10:15:34 devstack sudo[99539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:15:34 devstack sudo[99533]: pam_unix(sudo:session): session closed for user root Jul 10 10:15:34 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-85763dc2-ee41-4e26-bebd-8e9336f05fbf tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5dbdf762-a82c-40f7-ad69-e15140f5c958" returned: 0 in 1.009s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:15:34 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-85763dc2-ee41-4e26-bebd-8e9336f05fbf tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5dbdf762-a82c-40f7-ad69-e15140f5c958 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:15:34 devstack sudo[99565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5dbdf762-a82c-40f7-ad69-e15140f5c958 Jul 10 10:15:34 devstack sudo[99565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:15:35 devstack sudo[99539]: pam_unix(sudo:session): session closed for user root Jul 10 10:15:35 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-eeba5fd6-a62a-4fdf-ba54-ec3c2bcb4328 tempest-VolumesActionsTest-778674190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/0720f10d-0900-45e5-973e-f6dd0db0ab7d.temp_image.49bd4496-02cf-4d0e-9fc6-a1bd5fdad0adadsf3o3e.img" returned: 0 in 0.927s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:15:35 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-eeba5fd6-a62a-4fdf-ba54-ec3c2bcb4328 tempest-VolumesActionsTest-778674190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/0720f10d-0900-45e5-973e-f6dd0db0ab7d.temp_image.49bd4496-02cf-4d0e-9fc6-a1bd5fdad0adadsf3o3e.img {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:15:35 devstack sudo[99614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/0720f10d-0900-45e5-973e-f6dd0db0ab7d.temp_image.49bd4496-02cf-4d0e-9fc6-a1bd5fdad0adadsf3o3e.img Jul 10 10:15:35 devstack sudo[99614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:15:35 devstack sudo[99565]: pam_unix(sudo:session): session closed for user root Jul 10 10:15:35 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-85763dc2-ee41-4e26-bebd-8e9336f05fbf tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5dbdf762-a82c-40f7-ad69-e15140f5c958" returned: 1 in 0.951s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:15:35 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-85763dc2-ee41-4e26-bebd-8e9336f05fbf tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5dbdf762-a82c-40f7-ad69-e15140f5c958' failed. Not Retrying. {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 10:15:35 devstack cinder-volume[87234]: DEBUG cinder.volume.volume_utils [None req-85763dc2-ee41-4e26-bebd-8e9336f05fbf tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] Downloaded image 148823db-f433-4129-9f8b-5e0d86dc3054 ((None, [{'url': 'file:///opt/stack/data/glance/images/148823db-f433-4129-9f8b-5e0d86dc3054', 'metadata': {}}])) to volume 5dbdf762-a82c-40f7-ad69-e15140f5c958 successfully. {{(pid=87234) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 10:15:35 devstack cinder-volume[87234]: DEBUG cinder.image.image_utils [None req-85763dc2-ee41-4e26-bebd-8e9336f05fbf tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] Temporary image 148823db-f433-4129-9f8b-5e0d86dc3054 for user 2ca5c48debbd414289fc37bd7945a4a2 is deleted. {{(pid=87234) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 10:15:35 devstack cinder-volume[87234]: DEBUG cinder.volume.volume_utils [None req-85763dc2-ee41-4e26-bebd-8e9336f05fbf tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] Marking volume 5dbdf762-a82c-40f7-ad69-e15140f5c958 as bootable. {{(pid=87234) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 10:15:35 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-85763dc2-ee41-4e26-bebd-8e9336f05fbf tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] Copying metadata from image 148823db-f433-4129-9f8b-5e0d86dc3054 to 5dbdf762-a82c-40f7-ad69-e15140f5c958. {{(pid=87234) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 10:15:35 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-85763dc2-ee41-4e26-bebd-8e9336f05fbf tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] Creating volume glance metadata for volume 5dbdf762-a82c-40f7-ad69-e15140f5c958 backed by image 148823db-f433-4129-9f8b-5e0d86dc3054 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '148823db-f433-4129-9f8b-5e0d86dc3054', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '31578b3a0a3c5eed75109de85374242d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87234) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 10:15:35 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-85763dc2-ee41-4e26-bebd-8e9336f05fbf tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d768bf3-d0af-43e5-971c-f15c085aaff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5dbdf762-a82c-40f7-ad69-e15140f5c958', 'volume_size': 1, 'image_id': '148823db-f433-4129-9f8b-5e0d86dc3054', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/148823db-f433-4129-9f8b-5e0d86dc3054', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '31578b3a0a3c5eed75109de85374242d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c9c6c4b4dd3a43be908836a5e11d48b0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '63e908f7e857ffd3249e88ae252789a482d37ff1b93dd1095a06970890253399386865ea740e782992722c9331b94d4913b6547d2826e20f9f26410713827416', 'id': '148823db-f433-4129-9f8b-5e0d86dc3054', 'created_at': datetime.datetime(2026, 7, 10, 8, 15, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 8, 15, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/148823db-f433-4129-9f8b-5e0d86dc3054/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:15:35 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-85763dc2-ee41-4e26-bebd-8e9336f05fbf tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (627e5d81-54fd-41f1-a0ab-18cf3f809b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:15:35 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-85763dc2-ee41-4e26-bebd-8e9336f05fbf tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] Volume volume-5dbdf762-a82c-40f7-ad69-e15140f5c958 (5dbdf762-a82c-40f7-ad69-e15140f5c958): created successfully Jul 10 10:15:35 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-85763dc2-ee41-4e26-bebd-8e9336f05fbf tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (627e5d81-54fd-41f1-a0ab-18cf3f809b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:15:35 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-85763dc2-ee41-4e26-bebd-8e9336f05fbf tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] Flow 'volume_create_manager' (19f7caf4-926a-4864-8012-29383560cb0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:15:35 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-85763dc2-ee41-4e26-bebd-8e9336f05fbf tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] Created volume successfully. Jul 10 10:15:36 devstack sudo[99614]: pam_unix(sudo:session): session closed for user root Jul 10 10:15:36 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-eeba5fd6-a62a-4fdf-ba54-ec3c2bcb4328 tempest-VolumesActionsTest-778674190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/0720f10d-0900-45e5-973e-f6dd0db0ab7d.temp_image.49bd4496-02cf-4d0e-9fc6-a1bd5fdad0adadsf3o3e.img" returned: 1 in 1.014s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:15:36 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-eeba5fd6-a62a-4fdf-ba54-ec3c2bcb4328 tempest-VolumesActionsTest-778674190 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/0720f10d-0900-45e5-973e-f6dd0db0ab7d.temp_image.49bd4496-02cf-4d0e-9fc6-a1bd5fdad0adadsf3o3e.img' failed. Not Retrying. {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 10:15:36 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-eeba5fd6-a62a-4fdf-ba54-ec3c2bcb4328 tempest-VolumesActionsTest-778674190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/0720f10d-0900-45e5-973e-f6dd0db0ab7d.temp_image.49bd4496-02cf-4d0e-9fc6-a1bd5fdad0adadsf3o3e.img /opt/stack/data/cinder/conversion/vol_upload_465cl1ia {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:15:36 devstack sudo[99651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/0720f10d-0900-45e5-973e-f6dd0db0ab7d.temp_image.49bd4496-02cf-4d0e-9fc6-a1bd5fdad0adadsf3o3e.img /opt/stack/data/cinder/conversion/vol_upload_465cl1ia Jul 10 10:15:36 devstack sudo[99651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:15:36 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-dfd1267b-6389-48f2-a8e4-704f05d4f1c7 tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] Acquiring lock "cinder-5dbdf762-a82c-40f7-ad69-e15140f5c958-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:15:36 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-dfd1267b-6389-48f2-a8e4-704f05d4f1c7 tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] Lock "cinder-5dbdf762-a82c-40f7-ad69-e15140f5c958-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:15:36 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-dfd1267b-6389-48f2-a8e4-704f05d4f1c7 tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] Acquiring lock "cinder-quobyte-5dbdf762-a82c-40f7-ad69-e15140f5c958" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:15:36 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-dfd1267b-6389-48f2-a8e4-704f05d4f1c7 tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] Lock "cinder-quobyte-5dbdf762-a82c-40f7-ad69-e15140f5c958" acquired by "delete_volume" :: waited 0.032s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:15:36 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f40515a-facf-429c-8c2f-72ed74505f51]: (4, 'raw') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:15:36 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-dfd1267b-6389-48f2-a8e4-704f05d4f1c7 tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5dbdf762-a82c-40f7-ad69-e15140f5c958 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:15:36 devstack sudo[99664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5dbdf762-a82c-40f7-ad69-e15140f5c958 Jul 10 10:15:36 devstack sudo[99664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:15:37 devstack sudo[99651]: pam_unix(sudo:session): session closed for user root Jul 10 10:15:37 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-eeba5fd6-a62a-4fdf-ba54-ec3c2bcb4328 tempest-VolumesActionsTest-778674190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/0720f10d-0900-45e5-973e-f6dd0db0ab7d.temp_image.49bd4496-02cf-4d0e-9fc6-a1bd5fdad0adadsf3o3e.img /opt/stack/data/cinder/conversion/vol_upload_465cl1ia" returned: 0 in 0.980s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:15:37 devstack cinder-volume[87234]: DEBUG cinder.image.image_utils [None req-eeba5fd6-a62a-4fdf-ba54-ec3c2bcb4328 tempest-VolumesActionsTest-778674190 None] Image conversion details: src /opt/stack/data/cinder/conversion/0720f10d-0900-45e5-973e-f6dd0db0ab7d.temp_image.49bd4496-02cf-4d0e-9fc6-a1bd5fdad0adadsf3o3e.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_465cl1ia {{(pid=87234) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 10:15:37 devstack cinder-volume[87234]: INFO cinder.image.image_utils [None req-eeba5fd6-a62a-4fdf-ba54-ec3c2bcb4328 tempest-VolumesActionsTest-778674190 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 10 10:15:37 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[99493dfa-ae27-4e24-81d0-ad32c22355d6]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:15:37 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-eeba5fd6-a62a-4fdf-ba54-ec3c2bcb4328 tempest-VolumesActionsTest-778674190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_465cl1ia {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:15:37 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-35a02ce9-d6c0-4721-b729-9d2c7aab7e1e tempest-AttachVolumeNegativeTest-1243032650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:15:37 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-35a02ce9-d6c0-4721-b729-9d2c7aab7e1e tempest-AttachVolumeNegativeTest-1243032650 None] Flow 'volume_create_manager' (08809d0b-8fec-47f7-8745-558fefab78db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:15:37 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-35a02ce9-d6c0-4721-b729-9d2c7aab7e1e tempest-AttachVolumeNegativeTest-1243032650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a34935d-c6e3-4169-8dcf-119a87795122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:15:37 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-35a02ce9-d6c0-4721-b729-9d2c7aab7e1e tempest-AttachVolumeNegativeTest-1243032650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a34935d-c6e3-4169-8dcf-119a87795122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-602031991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19a05715-0e72-4458-9e80-d2cbb93d2491,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e45ed030cc4a4542858731861ac6abd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:15:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:15:37Z,use_quota=True,user_id='0cbeaefb02e34b5896c041bba985deb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:15:37 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-35a02ce9-d6c0-4721-b729-9d2c7aab7e1e tempest-AttachVolumeNegativeTest-1243032650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57a95bc0-a413-4731-8f06-d7b351029a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:15:37 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-35a02ce9-d6c0-4721-b729-9d2c7aab7e1e tempest-AttachVolumeNegativeTest-1243032650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57a95bc0-a413-4731-8f06-d7b351029a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:15:37 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-35a02ce9-d6c0-4721-b729-9d2c7aab7e1e tempest-AttachVolumeNegativeTest-1243032650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a71cf400-a0e8-49c1-a99a-b06ceacc426d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:15:37 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-35a02ce9-d6c0-4721-b729-9d2c7aab7e1e tempest-AttachVolumeNegativeTest-1243032650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a71cf400-a0e8-49c1-a99a-b06ceacc426d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19a05715-0e72-4458-9e80-d2cbb93d2491', 'volume_name': 'volume-19a05715-0e72-4458-9e80-d2cbb93d2491', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:15:37 devstack sudo[99678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_465cl1ia Jul 10 10:15:37 devstack sudo[99678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:15:37 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-35a02ce9-d6c0-4721-b729-9d2c7aab7e1e tempest-AttachVolumeNegativeTest-1243032650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47a009c6-9fa3-420f-8de1-7c32202f5a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:15:37 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-35a02ce9-d6c0-4721-b729-9d2c7aab7e1e tempest-AttachVolumeNegativeTest-1243032650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47a009c6-9fa3-420f-8de1-7c32202f5a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:15:37 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-35a02ce9-d6c0-4721-b729-9d2c7aab7e1e tempest-AttachVolumeNegativeTest-1243032650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d55532f9-bce0-4ead-b1c8-00825a8f742d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:15:37 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-35a02ce9-d6c0-4721-b729-9d2c7aab7e1e tempest-AttachVolumeNegativeTest-1243032650 None] Volume 19a05715-0e72-4458-9e80-d2cbb93d2491: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19a05715-0e72-4458-9e80-d2cbb93d2491', 'volume_size': 1} Jul 10 10:15:37 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-35a02ce9-d6c0-4721-b729-9d2c7aab7e1e tempest-AttachVolumeNegativeTest-1243032650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:15:37 devstack sudo[99664]: pam_unix(sudo:session): session closed for user root Jul 10 10:15:37 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-dfd1267b-6389-48f2-a8e4-704f05d4f1c7 tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5dbdf762-a82c-40f7-ad69-e15140f5c958" returned: 0 in 1.093s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:15:37 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-dfd1267b-6389-48f2-a8e4-704f05d4f1c7 tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5dbdf762-a82c-40f7-ad69-e15140f5c958 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:15:37 devstack sudo[100002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5dbdf762-a82c-40f7-ad69-e15140f5c958 Jul 10 10:15:37 devstack sudo[100002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:15:38 devstack sudo[99678]: pam_unix(sudo:session): session closed for user root Jul 10 10:15:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-eeba5fd6-a62a-4fdf-ba54-ec3c2bcb4328 tempest-VolumesActionsTest-778674190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_465cl1ia" returned: 0 in 0.790s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:15:38 devstack sudo[100002]: pam_unix(sudo:session): session closed for user root Jul 10 10:15:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-dfd1267b-6389-48f2-a8e4-704f05d4f1c7 tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5dbdf762-a82c-40f7-ad69-e15140f5c958" returned: 1 in 0.908s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:15:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-dfd1267b-6389-48f2-a8e4-704f05d4f1c7 tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5dbdf762-a82c-40f7-ad69-e15140f5c958' failed. Not Retrying. {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 10:15:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-dfd1267b-6389-48f2-a8e4-704f05d4f1c7 tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5dbdf762-a82c-40f7-ad69-e15140f5c958 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:15:38 devstack sudo[100020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5dbdf762-a82c-40f7-ad69-e15140f5c958 Jul 10 10:15:38 devstack sudo[100020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:15:39 devstack sudo[100020]: pam_unix(sudo:session): session closed for user root Jul 10 10:15:39 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-dfd1267b-6389-48f2-a8e4-704f05d4f1c7 tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5dbdf762-a82c-40f7-ad69-e15140f5c958" returned: 0 in 0.742s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:15:39 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-dfd1267b-6389-48f2-a8e4-704f05d4f1c7 tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] Lock "cinder-quobyte-5dbdf762-a82c-40f7-ad69-e15140f5c958" released by "delete_volume" :: held 2.855s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:15:39 devstack cinder-volume[87234]: WARNING cinder.quota [None req-dfd1267b-6389-48f2-a8e4-704f05d4f1c7 tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 10 10:15:39 devstack cinder-volume[87234]: WARNING cinder.quota [None req-dfd1267b-6389-48f2-a8e4-704f05d4f1c7 tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 10 10:15:39 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-dfd1267b-6389-48f2-a8e4-704f05d4f1c7 tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] Created reservations ['418f5117-f05e-4a79-9e98-058f4ad82fb2', '2b174890-af04-4255-b043-99cf1ec7ca42', '3f9d55b9-821e-412e-89cc-714d366aa66c', 'b58038b8-18a8-488a-94b7-1202525c1eed'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:15:39 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-dfd1267b-6389-48f2-a8e4-704f05d4f1c7 tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:15:39 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-dfd1267b-6389-48f2-a8e4-704f05d4f1c7 tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:15:39 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-dfd1267b-6389-48f2-a8e4-704f05d4f1c7 tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:15:39 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-dfd1267b-6389-48f2-a8e4-704f05d4f1c7 tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:15:39 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-dfd1267b-6389-48f2-a8e4-704f05d4f1c7 tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:15:39 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-dfd1267b-6389-48f2-a8e4-704f05d4f1c7 tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:15:39 devstack sudo[100025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:15:39 devstack sudo[100025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:15:39 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-eeba5fd6-a62a-4fdf-ba54-ec3c2bcb4328 tempest-VolumesActionsTest-778674190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.879s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:15:39 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-eeba5fd6-a62a-4fdf-ba54-ec3c2bcb4328 tempest-VolumesActionsTest-778674190 None] Uploaded volume to glance image-id: 49bd4496-02cf-4d0e-9fc6-a1bd5fdad0ad. {{(pid=87234) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 10 10:15:39 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-35a02ce9-d6c0-4721-b729-9d2c7aab7e1e tempest-AttachVolumeNegativeTest-1243032650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.437s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:15:39 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-35a02ce9-d6c0-4721-b729-9d2c7aab7e1e tempest-AttachVolumeNegativeTest-1243032650 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-602031991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19a05715-0e72-4458-9e80-d2cbb93d2491,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e45ed030cc4a4542858731861ac6abd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:15:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:15:37Z,use_quota=True,user_id='0cbeaefb02e34b5896c041bba985deb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:15:39 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-35a02ce9-d6c0-4721-b729-9d2c7aab7e1e tempest-AttachVolumeNegativeTest-1243032650 None] Creating volume 19a05715-0e72-4458-9e80-d2cbb93d2491 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:15:39 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-35a02ce9-d6c0-4721-b729-9d2c7aab7e1e tempest-AttachVolumeNegativeTest-1243032650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:15:39 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-35a02ce9-d6c0-4721-b729-9d2c7aab7e1e tempest-AttachVolumeNegativeTest-1243032650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:15:39 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-35a02ce9-d6c0-4721-b729-9d2c7aab7e1e tempest-AttachVolumeNegativeTest-1243032650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:15:39 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-35a02ce9-d6c0-4721-b729-9d2c7aab7e1e tempest-AttachVolumeNegativeTest-1243032650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:15:39 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-35a02ce9-d6c0-4721-b729-9d2c7aab7e1e tempest-AttachVolumeNegativeTest-1243032650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:15:39 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-35a02ce9-d6c0-4721-b729-9d2c7aab7e1e tempest-AttachVolumeNegativeTest-1243032650 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:15:39 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-35a02ce9-d6c0-4721-b729-9d2c7aab7e1e tempest-AttachVolumeNegativeTest-1243032650 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:15:39 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-35a02ce9-d6c0-4721-b729-9d2c7aab7e1e tempest-AttachVolumeNegativeTest-1243032650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-19a05715-0e72-4458-9e80-d2cbb93d2491 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:15:39 devstack sudo[100027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-19a05715-0e72-4458-9e80-d2cbb93d2491 1073741824 Jul 10 10:15:39 devstack sudo[100027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:15:39 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-eeba5fd6-a62a-4fdf-ba54-ec3c2bcb4328 tempest-VolumesActionsTest-778674190 None] Copy volume to image completed successfully. Jul 10 10:15:40 devstack sudo[100025]: pam_unix(sudo:session): session closed for user root Jul 10 10:15:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-dfd1267b-6389-48f2-a8e4-704f05d4f1c7 tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 1.096s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:15:40 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-dfd1267b-6389-48f2-a8e4-704f05d4f1c7 tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:15:40 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-dfd1267b-6389-48f2-a8e4-704f05d4f1c7 tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] Deleted volume successfully. Jul 10 10:15:40 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-dfd1267b-6389-48f2-a8e4-704f05d4f1c7 tempest-VolumeAndVolumeTypeFromImageTest-2074244893 None] Lock "cinder-5dbdf762-a82c-40f7-ad69-e15140f5c958-delete_volume" released by "delete_volume" :: held 4.275s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:15:41 devstack sudo[100027]: pam_unix(sudo:session): session closed for user root Jul 10 10:15:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-35a02ce9-d6c0-4721-b729-9d2c7aab7e1e tempest-AttachVolumeNegativeTest-1243032650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-19a05715-0e72-4458-9e80-d2cbb93d2491 1073741824" returned: 0 in 1.271s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:15:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-35a02ce9-d6c0-4721-b729-9d2c7aab7e1e tempest-AttachVolumeNegativeTest-1243032650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-19a05715-0e72-4458-9e80-d2cbb93d2491 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:15:41 devstack sudo[100033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-19a05715-0e72-4458-9e80-d2cbb93d2491 Jul 10 10:15:41 devstack sudo[100033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:15:41 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-80f1a228-f635-4a49-ac49-4b3265c89f59 tempest-VolumesActionsTest-778674190 None] Acquiring lock "cinder-0720f10d-0900-45e5-973e-f6dd0db0ab7d-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:15:41 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-80f1a228-f635-4a49-ac49-4b3265c89f59 tempest-VolumesActionsTest-778674190 None] Lock "cinder-0720f10d-0900-45e5-973e-f6dd0db0ab7d-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:15:42 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-80f1a228-f635-4a49-ac49-4b3265c89f59 tempest-VolumesActionsTest-778674190 None] Acquiring lock "cinder-quobyte-0720f10d-0900-45e5-973e-f6dd0db0ab7d" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:15:42 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-80f1a228-f635-4a49-ac49-4b3265c89f59 tempest-VolumesActionsTest-778674190 None] Lock "cinder-quobyte-0720f10d-0900-45e5-973e-f6dd0db0ab7d" acquired by "delete_volume" :: waited 0.021s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:15:42 devstack cinder-volume[87234]: DEBUG oslo_service.periodic_task [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 10:15:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:15:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:15:42 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:15:42 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:15:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:15:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:15:42 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[856ac17e-0837-45cd-b704-1c071a8e2054]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:15:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-80f1a228-f635-4a49-ac49-4b3265c89f59 tempest-VolumesActionsTest-778674190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0720f10d-0900-45e5-973e-f6dd0db0ab7d {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:15:42 devstack sudo[100035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:15:42 devstack sudo[100035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:15:42 devstack sudo[100037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0720f10d-0900-45e5-973e-f6dd0db0ab7d Jul 10 10:15:42 devstack sudo[100037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:15:42 devstack sudo[100033]: pam_unix(sudo:session): session closed for user root Jul 10 10:15:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-35a02ce9-d6c0-4721-b729-9d2c7aab7e1e tempest-AttachVolumeNegativeTest-1243032650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-19a05715-0e72-4458-9e80-d2cbb93d2491" returned: 0 in 1.251s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:15:42 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-35a02ce9-d6c0-4721-b729-9d2c7aab7e1e tempest-AttachVolumeNegativeTest-1243032650 None] <== create_volume: return (2612ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:15:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-35a02ce9-d6c0-4721-b729-9d2c7aab7e1e tempest-AttachVolumeNegativeTest-1243032650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.618s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:15:42 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-35a02ce9-d6c0-4721-b729-9d2c7aab7e1e tempest-AttachVolumeNegativeTest-1243032650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d55532f9-bce0-4ead-b1c8-00825a8f742d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19a05715-0e72-4458-9e80-d2cbb93d2491', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:15:42 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-35a02ce9-d6c0-4721-b729-9d2c7aab7e1e tempest-AttachVolumeNegativeTest-1243032650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d87e07af-e4a7-4b5e-83fd-6583bf8da37e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:15:42 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-35a02ce9-d6c0-4721-b729-9d2c7aab7e1e tempest-AttachVolumeNegativeTest-1243032650 None] Volume volume-19a05715-0e72-4458-9e80-d2cbb93d2491 (19a05715-0e72-4458-9e80-d2cbb93d2491): created successfully Jul 10 10:15:42 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-35a02ce9-d6c0-4721-b729-9d2c7aab7e1e tempest-AttachVolumeNegativeTest-1243032650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d87e07af-e4a7-4b5e-83fd-6583bf8da37e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:15:42 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-35a02ce9-d6c0-4721-b729-9d2c7aab7e1e tempest-AttachVolumeNegativeTest-1243032650 None] Flow 'volume_create_manager' (08809d0b-8fec-47f7-8745-558fefab78db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:15:42 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-35a02ce9-d6c0-4721-b729-9d2c7aab7e1e tempest-AttachVolumeNegativeTest-1243032650 None] Created volume successfully. Jul 10 10:15:43 devstack sudo[100035]: pam_unix(sudo:session): session closed for user root Jul 10 10:15:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 1.185s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:15:43 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:15:43 devstack cinder-volume[87234]: DEBUG oslo_service.periodic_task [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Running periodic task VolumeManager._thread_info {{(pid=87234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 10:15:43 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] thread count: 28 {{(pid=87234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 10:15:43 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] thread info: [<_MainThread(MainThread, started 131600773742720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 10:15:43 devstack sudo[100037]: pam_unix(sudo:session): session closed for user root Jul 10 10:15:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-80f1a228-f635-4a49-ac49-4b3265c89f59 tempest-VolumesActionsTest-778674190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0720f10d-0900-45e5-973e-f6dd0db0ab7d" returned: 0 in 1.246s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:15:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-80f1a228-f635-4a49-ac49-4b3265c89f59 tempest-VolumesActionsTest-778674190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0720f10d-0900-45e5-973e-f6dd0db0ab7d {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:15:43 devstack sudo[100047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0720f10d-0900-45e5-973e-f6dd0db0ab7d Jul 10 10:15:43 devstack sudo[100047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:15:44 devstack sudo[100047]: pam_unix(sudo:session): session closed for user root Jul 10 10:15:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-80f1a228-f635-4a49-ac49-4b3265c89f59 tempest-VolumesActionsTest-778674190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0720f10d-0900-45e5-973e-f6dd0db0ab7d" returned: 0 in 0.842s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:15:44 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-80f1a228-f635-4a49-ac49-4b3265c89f59 tempest-VolumesActionsTest-778674190 None] Lock "cinder-quobyte-0720f10d-0900-45e5-973e-f6dd0db0ab7d" released by "delete_volume" :: held 2.175s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:15:44 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-80f1a228-f635-4a49-ac49-4b3265c89f59 tempest-VolumesActionsTest-778674190 None] Created reservations ['08dc4474-99e7-4a69-ab1d-68148d2eb50b', 'a48a51c3-ba93-4947-ad03-c41d20212d9b', '6993456c-52b9-44a9-b3a3-51ca07264465', '41d41ff5-1141-4738-a807-95981b016043'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:15:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-80f1a228-f635-4a49-ac49-4b3265c89f59 tempest-VolumesActionsTest-778674190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:15:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-80f1a228-f635-4a49-ac49-4b3265c89f59 tempest-VolumesActionsTest-778674190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:15:44 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-80f1a228-f635-4a49-ac49-4b3265c89f59 tempest-VolumesActionsTest-778674190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:15:44 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-80f1a228-f635-4a49-ac49-4b3265c89f59 tempest-VolumesActionsTest-778674190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:15:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-80f1a228-f635-4a49-ac49-4b3265c89f59 tempest-VolumesActionsTest-778674190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:15:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-80f1a228-f635-4a49-ac49-4b3265c89f59 tempest-VolumesActionsTest-778674190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:15:44 devstack sudo[100050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:15:44 devstack sudo[100050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:15:45 devstack sudo[100050]: pam_unix(sudo:session): session closed for user root Jul 10 10:15:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-80f1a228-f635-4a49-ac49-4b3265c89f59 tempest-VolumesActionsTest-778674190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.706s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:15:45 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-80f1a228-f635-4a49-ac49-4b3265c89f59 tempest-VolumesActionsTest-778674190 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:15:45 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-80f1a228-f635-4a49-ac49-4b3265c89f59 tempest-VolumesActionsTest-778674190 None] Deleted volume successfully. Jul 10 10:15:45 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-80f1a228-f635-4a49-ac49-4b3265c89f59 tempest-VolumesActionsTest-778674190 None] Lock "cinder-0720f10d-0900-45e5-973e-f6dd0db0ab7d-delete_volume" released by "delete_volume" :: held 3.152s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:15:46 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-71cccdb2-e931-4bf2-aad6-bbdac363a8a8 tempest-CreateVolumesFromImageTest-270291878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:15:46 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-71cccdb2-e931-4bf2-aad6-bbdac363a8a8 tempest-CreateVolumesFromImageTest-270291878 None] Flow 'volume_create_manager' (a1bb149d-f442-4a28-97ed-fa958598bec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:15:46 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-71cccdb2-e931-4bf2-aad6-bbdac363a8a8 tempest-CreateVolumesFromImageTest-270291878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (584ba5bb-61c4-4e15-b499-5fd75502b9c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:15:46 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-71cccdb2-e931-4bf2-aad6-bbdac363a8a8 tempest-CreateVolumesFromImageTest-270291878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (584ba5bb-61c4-4e15-b499-5fd75502b9c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:15:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-752875362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=279dd4ad-e97f-4355-9b6a-7a95339ff8aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d53199a49f84f03952fe952a61fc924',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:15:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:15:46Z,use_quota=True,user_id='18e4ee8d00bb4d0e9330a978641a1302',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:15:46 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-71cccdb2-e931-4bf2-aad6-bbdac363a8a8 tempest-CreateVolumesFromImageTest-270291878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b9e8235-8f08-4ae1-a507-1f906868d36f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:15:46 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-71cccdb2-e931-4bf2-aad6-bbdac363a8a8 tempest-CreateVolumesFromImageTest-270291878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b9e8235-8f08-4ae1-a507-1f906868d36f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:15:46 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-71cccdb2-e931-4bf2-aad6-bbdac363a8a8 tempest-CreateVolumesFromImageTest-270291878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (515b0a15-eb0d-49be-95ab-1eab2bddb461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:15:46 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-71cccdb2-e931-4bf2-aad6-bbdac363a8a8 tempest-CreateVolumesFromImageTest-270291878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (515b0a15-eb0d-49be-95ab-1eab2bddb461) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '279dd4ad-e97f-4355-9b6a-7a95339ff8aa', 'volume_name': 'volume-279dd4ad-e97f-4355-9b6a-7a95339ff8aa', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:15:46 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-71cccdb2-e931-4bf2-aad6-bbdac363a8a8 tempest-CreateVolumesFromImageTest-270291878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b09d3f5a-b46c-456d-bbd6-662db7b349be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:15:46 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-71cccdb2-e931-4bf2-aad6-bbdac363a8a8 tempest-CreateVolumesFromImageTest-270291878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b09d3f5a-b46c-456d-bbd6-662db7b349be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:15:46 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-71cccdb2-e931-4bf2-aad6-bbdac363a8a8 tempest-CreateVolumesFromImageTest-270291878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b464e9ca-6690-4730-b0f2-9b2d3bcabf55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:15:46 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-71cccdb2-e931-4bf2-aad6-bbdac363a8a8 tempest-CreateVolumesFromImageTest-270291878 None] Volume 279dd4ad-e97f-4355-9b6a-7a95339ff8aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-279dd4ad-e97f-4355-9b6a-7a95339ff8aa', 'volume_size': 1} Jul 10 10:15:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-71cccdb2-e931-4bf2-aad6-bbdac363a8a8 tempest-CreateVolumesFromImageTest-270291878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:15:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-71cccdb2-e931-4bf2-aad6-bbdac363a8a8 tempest-CreateVolumesFromImageTest-270291878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:15:46 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-71cccdb2-e931-4bf2-aad6-bbdac363a8a8 tempest-CreateVolumesFromImageTest-270291878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:15:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-752875362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=279dd4ad-e97f-4355-9b6a-7a95339ff8aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d53199a49f84f03952fe952a61fc924',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:15:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:15:46Z,use_quota=True,user_id='18e4ee8d00bb4d0e9330a978641a1302',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:15:46 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-71cccdb2-e931-4bf2-aad6-bbdac363a8a8 tempest-CreateVolumesFromImageTest-270291878 None] Creating volume 279dd4ad-e97f-4355-9b6a-7a95339ff8aa {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:15:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-71cccdb2-e931-4bf2-aad6-bbdac363a8a8 tempest-CreateVolumesFromImageTest-270291878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:15:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-71cccdb2-e931-4bf2-aad6-bbdac363a8a8 tempest-CreateVolumesFromImageTest-270291878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:15:46 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-71cccdb2-e931-4bf2-aad6-bbdac363a8a8 tempest-CreateVolumesFromImageTest-270291878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:15:46 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-71cccdb2-e931-4bf2-aad6-bbdac363a8a8 tempest-CreateVolumesFromImageTest-270291878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:15:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-71cccdb2-e931-4bf2-aad6-bbdac363a8a8 tempest-CreateVolumesFromImageTest-270291878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:15:46 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-71cccdb2-e931-4bf2-aad6-bbdac363a8a8 tempest-CreateVolumesFromImageTest-270291878 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:15:46 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-71cccdb2-e931-4bf2-aad6-bbdac363a8a8 tempest-CreateVolumesFromImageTest-270291878 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:15:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-71cccdb2-e931-4bf2-aad6-bbdac363a8a8 tempest-CreateVolumesFromImageTest-270291878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-279dd4ad-e97f-4355-9b6a-7a95339ff8aa 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:15:46 devstack sudo[100060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-279dd4ad-e97f-4355-9b6a-7a95339ff8aa 1073741824 Jul 10 10:15:46 devstack sudo[100060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:15:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-0e406d71-5cc0-4419-98b7-6f752cb0fc87 req-b232f3e0-76ac-44d8-bc2d-72d00b0dea63 tempest-AttachVolumeNegativeTest-1243032650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:15:46 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf83ba96-c295-43ce-b509-4b9e112e11c3 tempest-CreateVolumesFromImageTest-270291878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:15:47 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-bf83ba96-c295-43ce-b509-4b9e112e11c3 tempest-CreateVolumesFromImageTest-270291878 None] Flow 'volume_create_manager' (9fb56953-04be-42fe-aa9c-64322a87d80e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:15:47 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-bf83ba96-c295-43ce-b509-4b9e112e11c3 tempest-CreateVolumesFromImageTest-270291878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (036c9f5d-a218-4034-97f7-4a189e023237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:15:47 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-bf83ba96-c295-43ce-b509-4b9e112e11c3 tempest-CreateVolumesFromImageTest-270291878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (036c9f5d-a218-4034-97f7-4a189e023237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:15:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1205567978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6fab297-63d3-407b-ba2c-68c69d19ce20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d53199a49f84f03952fe952a61fc924',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:15:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:15:47Z,use_quota=True,user_id='18e4ee8d00bb4d0e9330a978641a1302',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:15:47 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-bf83ba96-c295-43ce-b509-4b9e112e11c3 tempest-CreateVolumesFromImageTest-270291878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d57e7f24-84a1-4251-a3f1-5cdb0805d408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:15:47 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-bf83ba96-c295-43ce-b509-4b9e112e11c3 tempest-CreateVolumesFromImageTest-270291878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d57e7f24-84a1-4251-a3f1-5cdb0805d408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:15:47 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-bf83ba96-c295-43ce-b509-4b9e112e11c3 tempest-CreateVolumesFromImageTest-270291878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (064b32da-0ccf-4d70-aa80-cbbbc6f6c46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:15:47 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-bf83ba96-c295-43ce-b509-4b9e112e11c3 tempest-CreateVolumesFromImageTest-270291878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (064b32da-0ccf-4d70-aa80-cbbbc6f6c46d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6fab297-63d3-407b-ba2c-68c69d19ce20', 'volume_name': 'volume-f6fab297-63d3-407b-ba2c-68c69d19ce20', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:15:47 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-bf83ba96-c295-43ce-b509-4b9e112e11c3 tempest-CreateVolumesFromImageTest-270291878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74bff391-c1fc-4d14-a077-08660494a9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:15:47 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-bf83ba96-c295-43ce-b509-4b9e112e11c3 tempest-CreateVolumesFromImageTest-270291878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74bff391-c1fc-4d14-a077-08660494a9f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:15:47 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-bf83ba96-c295-43ce-b509-4b9e112e11c3 tempest-CreateVolumesFromImageTest-270291878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d46f25ae-ebe0-4c64-9dd7-5dc102b9aa43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:15:47 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-bf83ba96-c295-43ce-b509-4b9e112e11c3 tempest-CreateVolumesFromImageTest-270291878 None] Volume f6fab297-63d3-407b-ba2c-68c69d19ce20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6fab297-63d3-407b-ba2c-68c69d19ce20', 'volume_size': 1} Jul 10 10:15:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-bf83ba96-c295-43ce-b509-4b9e112e11c3 tempest-CreateVolumesFromImageTest-270291878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:15:47 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd7aa29d-c0c1-4ab4-aef8-2a9bb3e94c8f tempest-CreateVolumesFromImageTest-270291878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:15:47 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-dd7aa29d-c0c1-4ab4-aef8-2a9bb3e94c8f tempest-CreateVolumesFromImageTest-270291878 None] Flow 'volume_create_manager' (bfdc74e6-951d-4412-8705-fead1bbc3631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:15:47 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-dd7aa29d-c0c1-4ab4-aef8-2a9bb3e94c8f tempest-CreateVolumesFromImageTest-270291878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07ee7439-1e62-4132-969c-685bd281dbf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:15:47 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-dd7aa29d-c0c1-4ab4-aef8-2a9bb3e94c8f tempest-CreateVolumesFromImageTest-270291878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07ee7439-1e62-4132-969c-685bd281dbf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:15:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-889171855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ef86fea-9436-4f46-9c80-0683e6a6cbe3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d53199a49f84f03952fe952a61fc924',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:15:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:15:47Z,use_quota=True,user_id='18e4ee8d00bb4d0e9330a978641a1302',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:15:47 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-dd7aa29d-c0c1-4ab4-aef8-2a9bb3e94c8f tempest-CreateVolumesFromImageTest-270291878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b92ed2d7-d905-4084-bbc2-83c4e6d1a04f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:15:47 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-dd7aa29d-c0c1-4ab4-aef8-2a9bb3e94c8f tempest-CreateVolumesFromImageTest-270291878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b92ed2d7-d905-4084-bbc2-83c4e6d1a04f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:15:47 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-dd7aa29d-c0c1-4ab4-aef8-2a9bb3e94c8f tempest-CreateVolumesFromImageTest-270291878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4d35935-723a-47e3-96d1-18f58dcfa36c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:15:47 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-dd7aa29d-c0c1-4ab4-aef8-2a9bb3e94c8f tempest-CreateVolumesFromImageTest-270291878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4d35935-723a-47e3-96d1-18f58dcfa36c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ef86fea-9436-4f46-9c80-0683e6a6cbe3', 'volume_name': 'volume-2ef86fea-9436-4f46-9c80-0683e6a6cbe3', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:15:47 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-dd7aa29d-c0c1-4ab4-aef8-2a9bb3e94c8f tempest-CreateVolumesFromImageTest-270291878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eceffbab-15a3-4772-b827-cde42569948a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:15:47 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-dd7aa29d-c0c1-4ab4-aef8-2a9bb3e94c8f tempest-CreateVolumesFromImageTest-270291878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eceffbab-15a3-4772-b827-cde42569948a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:15:47 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-dd7aa29d-c0c1-4ab4-aef8-2a9bb3e94c8f tempest-CreateVolumesFromImageTest-270291878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81344714-1f40-49e9-9331-6a2e357dcce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:15:47 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-dd7aa29d-c0c1-4ab4-aef8-2a9bb3e94c8f tempest-CreateVolumesFromImageTest-270291878 None] Volume 2ef86fea-9436-4f46-9c80-0683e6a6cbe3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ef86fea-9436-4f46-9c80-0683e6a6cbe3', 'volume_size': 1} Jul 10 10:15:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-dd7aa29d-c0c1-4ab4-aef8-2a9bb3e94c8f tempest-CreateVolumesFromImageTest-270291878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:15:47 devstack sudo[100060]: pam_unix(sudo:session): session closed for user root Jul 10 10:15:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-71cccdb2-e931-4bf2-aad6-bbdac363a8a8 tempest-CreateVolumesFromImageTest-270291878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-279dd4ad-e97f-4355-9b6a-7a95339ff8aa 1073741824" returned: 0 in 1.572s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:15:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-71cccdb2-e931-4bf2-aad6-bbdac363a8a8 tempest-CreateVolumesFromImageTest-270291878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-279dd4ad-e97f-4355-9b6a-7a95339ff8aa {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:15:48 devstack sudo[100069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-279dd4ad-e97f-4355-9b6a-7a95339ff8aa Jul 10 10:15:48 devstack sudo[100069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:15:48 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-1026b282-7ae1-498b-85d4-55a7b169f3c5 tempest-CreateVolumesFromImageTest-270291878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:15:48 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1026b282-7ae1-498b-85d4-55a7b169f3c5 tempest-CreateVolumesFromImageTest-270291878 None] Flow 'volume_create_manager' (aa9e9c19-98c2-4715-bee9-7938fe56e63c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:15:48 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1026b282-7ae1-498b-85d4-55a7b169f3c5 tempest-CreateVolumesFromImageTest-270291878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bbf0986-21bb-4d31-aa0e-221a3ca1f3bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:15:48 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1026b282-7ae1-498b-85d4-55a7b169f3c5 tempest-CreateVolumesFromImageTest-270291878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bbf0986-21bb-4d31-aa0e-221a3ca1f3bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:15:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-754190802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=923dc375-f22c-4f2d-91ed-e68835d2da25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d53199a49f84f03952fe952a61fc924',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:15:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:15:48Z,use_quota=True,user_id='18e4ee8d00bb4d0e9330a978641a1302',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:15:48 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1026b282-7ae1-498b-85d4-55a7b169f3c5 tempest-CreateVolumesFromImageTest-270291878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56293ace-5e73-444a-8e6e-da29329f9a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:15:48 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1026b282-7ae1-498b-85d4-55a7b169f3c5 tempest-CreateVolumesFromImageTest-270291878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56293ace-5e73-444a-8e6e-da29329f9a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:15:48 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1026b282-7ae1-498b-85d4-55a7b169f3c5 tempest-CreateVolumesFromImageTest-270291878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d2dd1c1-4981-41f0-92a9-1b3202820f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:15:48 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1026b282-7ae1-498b-85d4-55a7b169f3c5 tempest-CreateVolumesFromImageTest-270291878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d2dd1c1-4981-41f0-92a9-1b3202820f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '923dc375-f22c-4f2d-91ed-e68835d2da25', 'volume_name': 'volume-923dc375-f22c-4f2d-91ed-e68835d2da25', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:15:48 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1026b282-7ae1-498b-85d4-55a7b169f3c5 tempest-CreateVolumesFromImageTest-270291878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0f90056-38fe-4bf6-90e1-5fdf8cb3aa11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:15:48 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1026b282-7ae1-498b-85d4-55a7b169f3c5 tempest-CreateVolumesFromImageTest-270291878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0f90056-38fe-4bf6-90e1-5fdf8cb3aa11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:15:48 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1026b282-7ae1-498b-85d4-55a7b169f3c5 tempest-CreateVolumesFromImageTest-270291878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (754681e8-a956-429e-8f50-eb8b9852126d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:15:48 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-1026b282-7ae1-498b-85d4-55a7b169f3c5 tempest-CreateVolumesFromImageTest-270291878 None] Volume 923dc375-f22c-4f2d-91ed-e68835d2da25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-923dc375-f22c-4f2d-91ed-e68835d2da25', 'volume_size': 1} Jul 10 10:15:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-1026b282-7ae1-498b-85d4-55a7b169f3c5 tempest-CreateVolumesFromImageTest-270291878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:15:48 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6a04894-662a-4602-9199-2daa4c84c07d tempest-CreateVolumesFromImageTest-270291878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:15:48 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a6a04894-662a-4602-9199-2daa4c84c07d tempest-CreateVolumesFromImageTest-270291878 None] Flow 'volume_create_manager' (30e9c0cb-a3f3-4230-b5b4-a385447601e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:15:48 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a6a04894-662a-4602-9199-2daa4c84c07d tempest-CreateVolumesFromImageTest-270291878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b012faa3-36dd-4255-99ef-bb2db81caff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:15:48 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a6a04894-662a-4602-9199-2daa4c84c07d tempest-CreateVolumesFromImageTest-270291878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b012faa3-36dd-4255-99ef-bb2db81caff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:15:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1653110253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b22da536-0b63-4309-ba24-045ac460eb50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d53199a49f84f03952fe952a61fc924',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:15:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:15:49Z,use_quota=True,user_id='18e4ee8d00bb4d0e9330a978641a1302',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:15:48 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a6a04894-662a-4602-9199-2daa4c84c07d tempest-CreateVolumesFromImageTest-270291878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8995000a-326e-44e6-a684-0a7413214ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:15:48 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a6a04894-662a-4602-9199-2daa4c84c07d tempest-CreateVolumesFromImageTest-270291878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8995000a-326e-44e6-a684-0a7413214ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:15:48 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a6a04894-662a-4602-9199-2daa4c84c07d tempest-CreateVolumesFromImageTest-270291878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85bb529b-c69e-46dc-9e0e-5569536db286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:15:48 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a6a04894-662a-4602-9199-2daa4c84c07d tempest-CreateVolumesFromImageTest-270291878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85bb529b-c69e-46dc-9e0e-5569536db286) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b22da536-0b63-4309-ba24-045ac460eb50', 'volume_name': 'volume-b22da536-0b63-4309-ba24-045ac460eb50', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:15:48 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a6a04894-662a-4602-9199-2daa4c84c07d tempest-CreateVolumesFromImageTest-270291878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cd017b4-beff-4a0c-93a6-f402a3773eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:15:48 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a6a04894-662a-4602-9199-2daa4c84c07d tempest-CreateVolumesFromImageTest-270291878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cd017b4-beff-4a0c-93a6-f402a3773eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:15:48 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a6a04894-662a-4602-9199-2daa4c84c07d tempest-CreateVolumesFromImageTest-270291878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc06c0ba-c939-4dcb-9423-25635562f7e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:15:48 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-a6a04894-662a-4602-9199-2daa4c84c07d tempest-CreateVolumesFromImageTest-270291878 None] Volume b22da536-0b63-4309-ba24-045ac460eb50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b22da536-0b63-4309-ba24-045ac460eb50', 'volume_size': 1} Jul 10 10:15:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-a6a04894-662a-4602-9199-2daa4c84c07d tempest-CreateVolumesFromImageTest-270291878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:15:49 devstack sudo[100069]: pam_unix(sudo:session): session closed for user root Jul 10 10:15:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-71cccdb2-e931-4bf2-aad6-bbdac363a8a8 tempest-CreateVolumesFromImageTest-270291878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-279dd4ad-e97f-4355-9b6a-7a95339ff8aa" returned: 0 in 0.916s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:15:49 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-71cccdb2-e931-4bf2-aad6-bbdac363a8a8 tempest-CreateVolumesFromImageTest-270291878 None] <== create_volume: return (2646ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:15:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-71cccdb2-e931-4bf2-aad6-bbdac363a8a8 tempest-CreateVolumesFromImageTest-270291878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.653s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:15:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-0e406d71-5cc0-4419-98b7-6f752cb0fc87 req-b232f3e0-76ac-44d8-bc2d-72d00b0dea63 tempest-AttachVolumeNegativeTest-1243032650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.209s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:15:49 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-71cccdb2-e931-4bf2-aad6-bbdac363a8a8 tempest-CreateVolumesFromImageTest-270291878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b464e9ca-6690-4730-b0f2-9b2d3bcabf55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-279dd4ad-e97f-4355-9b6a-7a95339ff8aa', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:15:49 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-71cccdb2-e931-4bf2-aad6-bbdac363a8a8 tempest-CreateVolumesFromImageTest-270291878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d46c70b8-b272-49e5-8803-801927c971c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:15:49 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0375d5e-8943-4739-84ce-3542025f4c1f]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:15:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-0e406d71-5cc0-4419-98b7-6f752cb0fc87 req-b232f3e0-76ac-44d8-bc2d-72d00b0dea63 tempest-AttachVolumeNegativeTest-1243032650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-19a05715-0e72-4458-9e80-d2cbb93d2491 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:15:49 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-71cccdb2-e931-4bf2-aad6-bbdac363a8a8 tempest-CreateVolumesFromImageTest-270291878 None] Volume volume-279dd4ad-e97f-4355-9b6a-7a95339ff8aa (279dd4ad-e97f-4355-9b6a-7a95339ff8aa): created successfully Jul 10 10:15:49 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-71cccdb2-e931-4bf2-aad6-bbdac363a8a8 tempest-CreateVolumesFromImageTest-270291878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d46c70b8-b272-49e5-8803-801927c971c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:15:49 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-71cccdb2-e931-4bf2-aad6-bbdac363a8a8 tempest-CreateVolumesFromImageTest-270291878 None] Flow 'volume_create_manager' (a1bb149d-f442-4a28-97ed-fa958598bec3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:15:49 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-71cccdb2-e931-4bf2-aad6-bbdac363a8a8 tempest-CreateVolumesFromImageTest-270291878 None] Created volume successfully. Jul 10 10:15:49 devstack sudo[100072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-19a05715-0e72-4458-9e80-d2cbb93d2491 Jul 10 10:15:49 devstack sudo[100072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:15:50 devstack sudo[100072]: pam_unix(sudo:session): session closed for user root Jul 10 10:15:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-0e406d71-5cc0-4419-98b7-6f752cb0fc87 req-b232f3e0-76ac-44d8-bc2d-72d00b0dea63 tempest-AttachVolumeNegativeTest-1243032650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-19a05715-0e72-4458-9e80-d2cbb93d2491" returned: 0 in 1.065s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:15:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-0e406d71-5cc0-4419-98b7-6f752cb0fc87 req-b232f3e0-76ac-44d8-bc2d-72d00b0dea63 tempest-AttachVolumeNegativeTest-1243032650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.110s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:15:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-bf83ba96-c295-43ce-b509-4b9e112e11c3 tempest-CreateVolumesFromImageTest-270291878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.962s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:15:50 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-bf83ba96-c295-43ce-b509-4b9e112e11c3 tempest-CreateVolumesFromImageTest-270291878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:15:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1205567978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6fab297-63d3-407b-ba2c-68c69d19ce20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d53199a49f84f03952fe952a61fc924',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:15:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:15:47Z,use_quota=True,user_id='18e4ee8d00bb4d0e9330a978641a1302',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:15:50 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-bf83ba96-c295-43ce-b509-4b9e112e11c3 tempest-CreateVolumesFromImageTest-270291878 None] Creating volume f6fab297-63d3-407b-ba2c-68c69d19ce20 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:15:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-bf83ba96-c295-43ce-b509-4b9e112e11c3 tempest-CreateVolumesFromImageTest-270291878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:15:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-bf83ba96-c295-43ce-b509-4b9e112e11c3 tempest-CreateVolumesFromImageTest-270291878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:15:50 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-bf83ba96-c295-43ce-b509-4b9e112e11c3 tempest-CreateVolumesFromImageTest-270291878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:15:50 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-bf83ba96-c295-43ce-b509-4b9e112e11c3 tempest-CreateVolumesFromImageTest-270291878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:15:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-bf83ba96-c295-43ce-b509-4b9e112e11c3 tempest-CreateVolumesFromImageTest-270291878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:15:50 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-bf83ba96-c295-43ce-b509-4b9e112e11c3 tempest-CreateVolumesFromImageTest-270291878 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:15:50 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-bf83ba96-c295-43ce-b509-4b9e112e11c3 tempest-CreateVolumesFromImageTest-270291878 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:15:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-bf83ba96-c295-43ce-b509-4b9e112e11c3 tempest-CreateVolumesFromImageTest-270291878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f6fab297-63d3-407b-ba2c-68c69d19ce20 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:15:50 devstack sudo[100077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f6fab297-63d3-407b-ba2c-68c69d19ce20 1073741824 Jul 10 10:15:50 devstack sudo[100077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:15:50 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [req-0e406d71-5cc0-4419-98b7-6f752cb0fc87 req-b232f3e0-76ac-44d8-bc2d-72d00b0dea63 tempest-AttachVolumeNegativeTest-1243032650 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091', 'name': 'volume-19a05715-0e72-4458-9e80-d2cbb93d2491', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9f5441d1-6865-4e29-ba50-b029b5215320', 'enforce_multipath': True} {{(pid=87234) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 10:15:50 devstack cinder-volume[87234]: INFO cinder.volume.manager [req-0e406d71-5cc0-4419-98b7-6f752cb0fc87 req-b232f3e0-76ac-44d8-bc2d-72d00b0dea63 tempest-AttachVolumeNegativeTest-1243032650 None] attachment_update completed successfully. Jul 10 10:15:51 devstack sudo[100077]: pam_unix(sudo:session): session closed for user root Jul 10 10:15:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-bf83ba96-c295-43ce-b509-4b9e112e11c3 tempest-CreateVolumesFromImageTest-270291878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f6fab297-63d3-407b-ba2c-68c69d19ce20 1073741824" returned: 0 in 1.090s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:15:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-bf83ba96-c295-43ce-b509-4b9e112e11c3 tempest-CreateVolumesFromImageTest-270291878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f6fab297-63d3-407b-ba2c-68c69d19ce20 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:15:51 devstack sudo[100084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f6fab297-63d3-407b-ba2c-68c69d19ce20 Jul 10 10:15:51 devstack sudo[100084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:15:52 devstack sudo[100084]: pam_unix(sudo:session): session closed for user root Jul 10 10:15:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-bf83ba96-c295-43ce-b509-4b9e112e11c3 tempest-CreateVolumesFromImageTest-270291878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f6fab297-63d3-407b-ba2c-68c69d19ce20" returned: 0 in 0.808s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:15:52 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-bf83ba96-c295-43ce-b509-4b9e112e11c3 tempest-CreateVolumesFromImageTest-270291878 None] <== create_volume: return (1957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:15:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-bf83ba96-c295-43ce-b509-4b9e112e11c3 tempest-CreateVolumesFromImageTest-270291878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.959s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:15:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-dd7aa29d-c0c1-4ab4-aef8-2a9bb3e94c8f tempest-CreateVolumesFromImageTest-270291878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.485s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:15:52 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-dd7aa29d-c0c1-4ab4-aef8-2a9bb3e94c8f tempest-CreateVolumesFromImageTest-270291878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:15:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-889171855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ef86fea-9436-4f46-9c80-0683e6a6cbe3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d53199a49f84f03952fe952a61fc924',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:15:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:15:47Z,use_quota=True,user_id='18e4ee8d00bb4d0e9330a978641a1302',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:15:52 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-dd7aa29d-c0c1-4ab4-aef8-2a9bb3e94c8f tempest-CreateVolumesFromImageTest-270291878 None] Creating volume 2ef86fea-9436-4f46-9c80-0683e6a6cbe3 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:15:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-dd7aa29d-c0c1-4ab4-aef8-2a9bb3e94c8f tempest-CreateVolumesFromImageTest-270291878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:15:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-dd7aa29d-c0c1-4ab4-aef8-2a9bb3e94c8f tempest-CreateVolumesFromImageTest-270291878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:15:52 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-dd7aa29d-c0c1-4ab4-aef8-2a9bb3e94c8f tempest-CreateVolumesFromImageTest-270291878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:15:52 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-dd7aa29d-c0c1-4ab4-aef8-2a9bb3e94c8f tempest-CreateVolumesFromImageTest-270291878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:15:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-dd7aa29d-c0c1-4ab4-aef8-2a9bb3e94c8f tempest-CreateVolumesFromImageTest-270291878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:15:52 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-dd7aa29d-c0c1-4ab4-aef8-2a9bb3e94c8f tempest-CreateVolumesFromImageTest-270291878 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:15:52 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-dd7aa29d-c0c1-4ab4-aef8-2a9bb3e94c8f tempest-CreateVolumesFromImageTest-270291878 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:15:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-dd7aa29d-c0c1-4ab4-aef8-2a9bb3e94c8f tempest-CreateVolumesFromImageTest-270291878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2ef86fea-9436-4f46-9c80-0683e6a6cbe3 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:15:52 devstack sudo[100089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2ef86fea-9436-4f46-9c80-0683e6a6cbe3 1073741824 Jul 10 10:15:52 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-bf83ba96-c295-43ce-b509-4b9e112e11c3 tempest-CreateVolumesFromImageTest-270291878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d46f25ae-ebe0-4c64-9dd7-5dc102b9aa43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6fab297-63d3-407b-ba2c-68c69d19ce20', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:15:52 devstack sudo[100089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:15:52 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-bf83ba96-c295-43ce-b509-4b9e112e11c3 tempest-CreateVolumesFromImageTest-270291878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (197410c0-75af-40d0-a2d9-50bf799ff5b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:15:52 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-bf83ba96-c295-43ce-b509-4b9e112e11c3 tempest-CreateVolumesFromImageTest-270291878 None] Volume volume-f6fab297-63d3-407b-ba2c-68c69d19ce20 (f6fab297-63d3-407b-ba2c-68c69d19ce20): created successfully Jul 10 10:15:52 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-bf83ba96-c295-43ce-b509-4b9e112e11c3 tempest-CreateVolumesFromImageTest-270291878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (197410c0-75af-40d0-a2d9-50bf799ff5b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:15:52 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-bf83ba96-c295-43ce-b509-4b9e112e11c3 tempest-CreateVolumesFromImageTest-270291878 None] Flow 'volume_create_manager' (9fb56953-04be-42fe-aa9c-64322a87d80e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:15:52 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-bf83ba96-c295-43ce-b509-4b9e112e11c3 tempest-CreateVolumesFromImageTest-270291878 None] Created volume successfully. Jul 10 10:15:53 devstack sudo[100089]: pam_unix(sudo:session): session closed for user root Jul 10 10:15:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-dd7aa29d-c0c1-4ab4-aef8-2a9bb3e94c8f tempest-CreateVolumesFromImageTest-270291878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2ef86fea-9436-4f46-9c80-0683e6a6cbe3 1073741824" returned: 0 in 0.965s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:15:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-dd7aa29d-c0c1-4ab4-aef8-2a9bb3e94c8f tempest-CreateVolumesFromImageTest-270291878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2ef86fea-9436-4f46-9c80-0683e6a6cbe3 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:15:53 devstack sudo[100094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2ef86fea-9436-4f46-9c80-0683e6a6cbe3 Jul 10 10:15:53 devstack sudo[100094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:15:53 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-736a7add-8f62-48d9-a95e-ee4513c69ba7 tempest-VolumesCloneNegativeTest-503739409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:15:53 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-736a7add-8f62-48d9-a95e-ee4513c69ba7 tempest-VolumesCloneNegativeTest-503739409 None] Flow 'volume_create_manager' (025cc3bd-f3bb-45ab-85af-9d58d3aa1aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:15:53 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-736a7add-8f62-48d9-a95e-ee4513c69ba7 tempest-VolumesCloneNegativeTest-503739409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b8f93d4-3d1e-4d0f-a4b2-fc210bcd6499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:15:53 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-736a7add-8f62-48d9-a95e-ee4513c69ba7 tempest-VolumesCloneNegativeTest-503739409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b8f93d4-3d1e-4d0f-a4b2-fc210bcd6499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:15:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2013587792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4166acd8-5b84-4e39-a403-5ae2a2e81171,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='419a24b80a68465bb9d7901caa951f30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:15:53Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:15:53Z,use_quota=True,user_id='0dd93653911f4870b754418b83e0f8da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:15:53 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-736a7add-8f62-48d9-a95e-ee4513c69ba7 tempest-VolumesCloneNegativeTest-503739409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (601e4f98-66c8-44c3-8160-c509b5f39543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:15:53 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-736a7add-8f62-48d9-a95e-ee4513c69ba7 tempest-VolumesCloneNegativeTest-503739409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (601e4f98-66c8-44c3-8160-c509b5f39543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:15:53 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-736a7add-8f62-48d9-a95e-ee4513c69ba7 tempest-VolumesCloneNegativeTest-503739409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd186db2-88c0-4dea-958a-202ffcc6ff66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:15:53 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-736a7add-8f62-48d9-a95e-ee4513c69ba7 tempest-VolumesCloneNegativeTest-503739409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd186db2-88c0-4dea-958a-202ffcc6ff66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4166acd8-5b84-4e39-a403-5ae2a2e81171', 'volume_name': 'volume-4166acd8-5b84-4e39-a403-5ae2a2e81171', 'volume_size': 2}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:15:53 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-736a7add-8f62-48d9-a95e-ee4513c69ba7 tempest-VolumesCloneNegativeTest-503739409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e488c519-6b3c-4a00-9a78-5500a48b1533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:15:53 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-736a7add-8f62-48d9-a95e-ee4513c69ba7 tempest-VolumesCloneNegativeTest-503739409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e488c519-6b3c-4a00-9a78-5500a48b1533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:15:53 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-736a7add-8f62-48d9-a95e-ee4513c69ba7 tempest-VolumesCloneNegativeTest-503739409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c59004fa-633f-45d8-9fde-1908b675f846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:15:53 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-736a7add-8f62-48d9-a95e-ee4513c69ba7 tempest-VolumesCloneNegativeTest-503739409 None] Volume 4166acd8-5b84-4e39-a403-5ae2a2e81171: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4166acd8-5b84-4e39-a403-5ae2a2e81171', 'volume_size': 2} Jul 10 10:15:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-736a7add-8f62-48d9-a95e-ee4513c69ba7 tempest-VolumesCloneNegativeTest-503739409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:15:53 devstack sudo[100094]: pam_unix(sudo:session): session closed for user root Jul 10 10:15:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-dd7aa29d-c0c1-4ab4-aef8-2a9bb3e94c8f tempest-CreateVolumesFromImageTest-270291878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2ef86fea-9436-4f46-9c80-0683e6a6cbe3" returned: 0 in 0.722s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:15:53 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-dd7aa29d-c0c1-4ab4-aef8-2a9bb3e94c8f tempest-CreateVolumesFromImageTest-270291878 None] <== create_volume: return (1755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:15:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-dd7aa29d-c0c1-4ab4-aef8-2a9bb3e94c8f tempest-CreateVolumesFromImageTest-270291878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.758s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:15:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-1026b282-7ae1-498b-85d4-55a7b169f3c5 tempest-CreateVolumesFromImageTest-270291878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.456s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:15:53 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-1026b282-7ae1-498b-85d4-55a7b169f3c5 tempest-CreateVolumesFromImageTest-270291878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:15:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-754190802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=923dc375-f22c-4f2d-91ed-e68835d2da25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d53199a49f84f03952fe952a61fc924',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:15:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:15:48Z,use_quota=True,user_id='18e4ee8d00bb4d0e9330a978641a1302',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:15:53 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-1026b282-7ae1-498b-85d4-55a7b169f3c5 tempest-CreateVolumesFromImageTest-270291878 None] Creating volume 923dc375-f22c-4f2d-91ed-e68835d2da25 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:15:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-1026b282-7ae1-498b-85d4-55a7b169f3c5 tempest-CreateVolumesFromImageTest-270291878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:15:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-1026b282-7ae1-498b-85d4-55a7b169f3c5 tempest-CreateVolumesFromImageTest-270291878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:15:53 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-1026b282-7ae1-498b-85d4-55a7b169f3c5 tempest-CreateVolumesFromImageTest-270291878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:15:53 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-1026b282-7ae1-498b-85d4-55a7b169f3c5 tempest-CreateVolumesFromImageTest-270291878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:15:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-1026b282-7ae1-498b-85d4-55a7b169f3c5 tempest-CreateVolumesFromImageTest-270291878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:15:53 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-1026b282-7ae1-498b-85d4-55a7b169f3c5 tempest-CreateVolumesFromImageTest-270291878 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:15:53 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-1026b282-7ae1-498b-85d4-55a7b169f3c5 tempest-CreateVolumesFromImageTest-270291878 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:15:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1026b282-7ae1-498b-85d4-55a7b169f3c5 tempest-CreateVolumesFromImageTest-270291878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-923dc375-f22c-4f2d-91ed-e68835d2da25 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:15:53 devstack sudo[100107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-923dc375-f22c-4f2d-91ed-e68835d2da25 1073741824 Jul 10 10:15:53 devstack sudo[100107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:15:53 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-dd7aa29d-c0c1-4ab4-aef8-2a9bb3e94c8f tempest-CreateVolumesFromImageTest-270291878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81344714-1f40-49e9-9331-6a2e357dcce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ef86fea-9436-4f46-9c80-0683e6a6cbe3', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:15:53 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-dd7aa29d-c0c1-4ab4-aef8-2a9bb3e94c8f tempest-CreateVolumesFromImageTest-270291878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef97d791-fa4c-4ebc-8fa8-e26691250cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:15:53 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-dd7aa29d-c0c1-4ab4-aef8-2a9bb3e94c8f tempest-CreateVolumesFromImageTest-270291878 None] Volume volume-2ef86fea-9436-4f46-9c80-0683e6a6cbe3 (2ef86fea-9436-4f46-9c80-0683e6a6cbe3): created successfully Jul 10 10:15:53 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-dd7aa29d-c0c1-4ab4-aef8-2a9bb3e94c8f tempest-CreateVolumesFromImageTest-270291878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef97d791-fa4c-4ebc-8fa8-e26691250cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:15:53 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-dd7aa29d-c0c1-4ab4-aef8-2a9bb3e94c8f tempest-CreateVolumesFromImageTest-270291878 None] Flow 'volume_create_manager' (bfdc74e6-951d-4412-8705-fead1bbc3631) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:15:53 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-dd7aa29d-c0c1-4ab4-aef8-2a9bb3e94c8f tempest-CreateVolumesFromImageTest-270291878 None] Created volume successfully. Jul 10 10:15:54 devstack sudo[100107]: pam_unix(sudo:session): session closed for user root Jul 10 10:15:54 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1026b282-7ae1-498b-85d4-55a7b169f3c5 tempest-CreateVolumesFromImageTest-270291878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-923dc375-f22c-4f2d-91ed-e68835d2da25 1073741824" returned: 0 in 0.878s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:15:54 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1026b282-7ae1-498b-85d4-55a7b169f3c5 tempest-CreateVolumesFromImageTest-270291878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-923dc375-f22c-4f2d-91ed-e68835d2da25 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:15:54 devstack sudo[100137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-923dc375-f22c-4f2d-91ed-e68835d2da25 Jul 10 10:15:54 devstack sudo[100137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:15:55 devstack sudo[100137]: pam_unix(sudo:session): session closed for user root Jul 10 10:15:55 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1026b282-7ae1-498b-85d4-55a7b169f3c5 tempest-CreateVolumesFromImageTest-270291878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-923dc375-f22c-4f2d-91ed-e68835d2da25" returned: 0 in 0.670s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:15:55 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-1026b282-7ae1-498b-85d4-55a7b169f3c5 tempest-CreateVolumesFromImageTest-270291878 None] <== create_volume: return (1588ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:15:55 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-1026b282-7ae1-498b-85d4-55a7b169f3c5 tempest-CreateVolumesFromImageTest-270291878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.591s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:15:55 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-a6a04894-662a-4602-9199-2daa4c84c07d tempest-CreateVolumesFromImageTest-270291878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.571s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:15:55 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-a6a04894-662a-4602-9199-2daa4c84c07d tempest-CreateVolumesFromImageTest-270291878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:15:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1653110253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b22da536-0b63-4309-ba24-045ac460eb50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d53199a49f84f03952fe952a61fc924',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:15:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:15:49Z,use_quota=True,user_id='18e4ee8d00bb4d0e9330a978641a1302',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:15:55 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-a6a04894-662a-4602-9199-2daa4c84c07d tempest-CreateVolumesFromImageTest-270291878 None] Creating volume b22da536-0b63-4309-ba24-045ac460eb50 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:15:55 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-a6a04894-662a-4602-9199-2daa4c84c07d tempest-CreateVolumesFromImageTest-270291878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:15:55 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-a6a04894-662a-4602-9199-2daa4c84c07d tempest-CreateVolumesFromImageTest-270291878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:15:55 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-a6a04894-662a-4602-9199-2daa4c84c07d tempest-CreateVolumesFromImageTest-270291878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:15:55 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-a6a04894-662a-4602-9199-2daa4c84c07d tempest-CreateVolumesFromImageTest-270291878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:15:55 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-a6a04894-662a-4602-9199-2daa4c84c07d tempest-CreateVolumesFromImageTest-270291878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:15:55 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-a6a04894-662a-4602-9199-2daa4c84c07d tempest-CreateVolumesFromImageTest-270291878 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:15:55 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-a6a04894-662a-4602-9199-2daa4c84c07d tempest-CreateVolumesFromImageTest-270291878 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:15:55 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a6a04894-662a-4602-9199-2daa4c84c07d tempest-CreateVolumesFromImageTest-270291878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b22da536-0b63-4309-ba24-045ac460eb50 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:15:55 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1026b282-7ae1-498b-85d4-55a7b169f3c5 tempest-CreateVolumesFromImageTest-270291878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (754681e8-a956-429e-8f50-eb8b9852126d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-923dc375-f22c-4f2d-91ed-e68835d2da25', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:15:55 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1026b282-7ae1-498b-85d4-55a7b169f3c5 tempest-CreateVolumesFromImageTest-270291878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b4d880c-c24f-41ed-a116-f01efed537e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:15:55 devstack sudo[100140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b22da536-0b63-4309-ba24-045ac460eb50 1073741824 Jul 10 10:15:55 devstack sudo[100140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:15:55 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-1026b282-7ae1-498b-85d4-55a7b169f3c5 tempest-CreateVolumesFromImageTest-270291878 None] Volume volume-923dc375-f22c-4f2d-91ed-e68835d2da25 (923dc375-f22c-4f2d-91ed-e68835d2da25): created successfully Jul 10 10:15:55 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1026b282-7ae1-498b-85d4-55a7b169f3c5 tempest-CreateVolumesFromImageTest-270291878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b4d880c-c24f-41ed-a116-f01efed537e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:15:55 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1026b282-7ae1-498b-85d4-55a7b169f3c5 tempest-CreateVolumesFromImageTest-270291878 None] Flow 'volume_create_manager' (aa9e9c19-98c2-4715-bee9-7938fe56e63c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:15:55 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-1026b282-7ae1-498b-85d4-55a7b169f3c5 tempest-CreateVolumesFromImageTest-270291878 None] Created volume successfully. Jul 10 10:15:56 devstack sudo[100140]: pam_unix(sudo:session): session closed for user root Jul 10 10:15:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a6a04894-662a-4602-9199-2daa4c84c07d tempest-CreateVolumesFromImageTest-270291878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b22da536-0b63-4309-ba24-045ac460eb50 1073741824" returned: 0 in 0.862s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:15:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a6a04894-662a-4602-9199-2daa4c84c07d tempest-CreateVolumesFromImageTest-270291878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b22da536-0b63-4309-ba24-045ac460eb50 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:15:56 devstack sudo[100145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b22da536-0b63-4309-ba24-045ac460eb50 Jul 10 10:15:56 devstack sudo[100145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:15:56 devstack cinder-volume[87234]: INFO cinder.volume.manager [req-f95eb770-e193-40ac-9880-4abb3b4d232e req-d0627bc5-a6cb-4d7e-a2a5-9e9c3938c35a tempest-AttachVolumeNegativeTest-1243032650 None] Terminate volume connection completed successfully. Jul 10 10:15:56 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [req-f95eb770-e193-40ac-9880-4abb3b4d232e req-d0627bc5-a6cb-4d7e-a2a5-9e9c3938c35a tempest-AttachVolumeNegativeTest-1243032650 None] Deleting attachment 9f5441d1-6865-4e29-ba50-b029b5215320. {{(pid=87234) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 10:15:57 devstack sudo[100145]: pam_unix(sudo:session): session closed for user root Jul 10 10:15:57 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a6a04894-662a-4602-9199-2daa4c84c07d tempest-CreateVolumesFromImageTest-270291878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b22da536-0b63-4309-ba24-045ac460eb50" returned: 0 in 0.683s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:15:57 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-a6a04894-662a-4602-9199-2daa4c84c07d tempest-CreateVolumesFromImageTest-270291878 None] <== create_volume: return (1584ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:15:57 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-a6a04894-662a-4602-9199-2daa4c84c07d tempest-CreateVolumesFromImageTest-270291878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.587s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:15:57 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-736a7add-8f62-48d9-a95e-ee4513c69ba7 tempest-VolumesCloneNegativeTest-503739409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.391s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:15:57 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-736a7add-8f62-48d9-a95e-ee4513c69ba7 tempest-VolumesCloneNegativeTest-503739409 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:15:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2013587792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4166acd8-5b84-4e39-a403-5ae2a2e81171,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='419a24b80a68465bb9d7901caa951f30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:15:53Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:15:53Z,use_quota=True,user_id='0dd93653911f4870b754418b83e0f8da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:15:57 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-736a7add-8f62-48d9-a95e-ee4513c69ba7 tempest-VolumesCloneNegativeTest-503739409 None] Creating volume 4166acd8-5b84-4e39-a403-5ae2a2e81171 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:15:57 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-736a7add-8f62-48d9-a95e-ee4513c69ba7 tempest-VolumesCloneNegativeTest-503739409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:15:57 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-736a7add-8f62-48d9-a95e-ee4513c69ba7 tempest-VolumesCloneNegativeTest-503739409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:15:57 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-736a7add-8f62-48d9-a95e-ee4513c69ba7 tempest-VolumesCloneNegativeTest-503739409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:15:57 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-736a7add-8f62-48d9-a95e-ee4513c69ba7 tempest-VolumesCloneNegativeTest-503739409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:15:57 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-736a7add-8f62-48d9-a95e-ee4513c69ba7 tempest-VolumesCloneNegativeTest-503739409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:15:57 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-736a7add-8f62-48d9-a95e-ee4513c69ba7 tempest-VolumesCloneNegativeTest-503739409 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:15:57 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-736a7add-8f62-48d9-a95e-ee4513c69ba7 tempest-VolumesCloneNegativeTest-503739409 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:15:57 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-736a7add-8f62-48d9-a95e-ee4513c69ba7 tempest-VolumesCloneNegativeTest-503739409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-4166acd8-5b84-4e39-a403-5ae2a2e81171 2147483648 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:15:57 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a6a04894-662a-4602-9199-2daa4c84c07d tempest-CreateVolumesFromImageTest-270291878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc06c0ba-c939-4dcb-9423-25635562f7e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b22da536-0b63-4309-ba24-045ac460eb50', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:15:57 devstack sudo[100151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-4166acd8-5b84-4e39-a403-5ae2a2e81171 2147483648 Jul 10 10:15:57 devstack sudo[100151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:15:57 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a6a04894-662a-4602-9199-2daa4c84c07d tempest-CreateVolumesFromImageTest-270291878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad6a6f55-d28f-4159-990b-c082a8945a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:15:57 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-a6a04894-662a-4602-9199-2daa4c84c07d tempest-CreateVolumesFromImageTest-270291878 None] Volume volume-b22da536-0b63-4309-ba24-045ac460eb50 (b22da536-0b63-4309-ba24-045ac460eb50): created successfully Jul 10 10:15:57 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a6a04894-662a-4602-9199-2daa4c84c07d tempest-CreateVolumesFromImageTest-270291878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad6a6f55-d28f-4159-990b-c082a8945a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:15:57 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a6a04894-662a-4602-9199-2daa4c84c07d tempest-CreateVolumesFromImageTest-270291878 None] Flow 'volume_create_manager' (30e9c0cb-a3f3-4230-b5b4-a385447601e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:15:57 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-a6a04894-662a-4602-9199-2daa4c84c07d tempest-CreateVolumesFromImageTest-270291878 None] Created volume successfully. Jul 10 10:15:57 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-54c311a7-6340-405e-9f19-b260f59508d6 tempest-CreateVolumesFromImageTest-270291878 None] Acquiring lock "cinder-b22da536-0b63-4309-ba24-045ac460eb50-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:15:57 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-54c311a7-6340-405e-9f19-b260f59508d6 tempest-CreateVolumesFromImageTest-270291878 None] Lock "cinder-b22da536-0b63-4309-ba24-045ac460eb50-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:15:57 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-54c311a7-6340-405e-9f19-b260f59508d6 tempest-CreateVolumesFromImageTest-270291878 None] Acquiring lock "cinder-quobyte-b22da536-0b63-4309-ba24-045ac460eb50" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:15:57 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-54c311a7-6340-405e-9f19-b260f59508d6 tempest-CreateVolumesFromImageTest-270291878 None] Lock "cinder-quobyte-b22da536-0b63-4309-ba24-045ac460eb50" acquired by "delete_volume" :: waited 0.016s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:15:57 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cdd4858-ff0f-48c0-81e2-d4964a60fef3]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:15:57 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-54c311a7-6340-405e-9f19-b260f59508d6 tempest-CreateVolumesFromImageTest-270291878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b22da536-0b63-4309-ba24-045ac460eb50 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:15:57 devstack sudo[100156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b22da536-0b63-4309-ba24-045ac460eb50 Jul 10 10:15:57 devstack sudo[100156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:15:57 devstack sudo[100151]: pam_unix(sudo:session): session closed for user root Jul 10 10:15:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-736a7add-8f62-48d9-a95e-ee4513c69ba7 tempest-VolumesCloneNegativeTest-503739409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-4166acd8-5b84-4e39-a403-5ae2a2e81171 2147483648" returned: 0 in 0.949s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:15:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-736a7add-8f62-48d9-a95e-ee4513c69ba7 tempest-VolumesCloneNegativeTest-503739409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-4166acd8-5b84-4e39-a403-5ae2a2e81171 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:15:58 devstack sudo[100159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-4166acd8-5b84-4e39-a403-5ae2a2e81171 Jul 10 10:15:58 devstack sudo[100159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:15:58 devstack sudo[100156]: pam_unix(sudo:session): session closed for user root Jul 10 10:15:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-54c311a7-6340-405e-9f19-b260f59508d6 tempest-CreateVolumesFromImageTest-270291878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b22da536-0b63-4309-ba24-045ac460eb50" returned: 0 in 0.784s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:15:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-54c311a7-6340-405e-9f19-b260f59508d6 tempest-CreateVolumesFromImageTest-270291878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b22da536-0b63-4309-ba24-045ac460eb50 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:15:58 devstack sudo[100164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b22da536-0b63-4309-ba24-045ac460eb50 Jul 10 10:15:58 devstack sudo[100164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:15:58 devstack sudo[100159]: pam_unix(sudo:session): session closed for user root Jul 10 10:15:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-736a7add-8f62-48d9-a95e-ee4513c69ba7 tempest-VolumesCloneNegativeTest-503739409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-4166acd8-5b84-4e39-a403-5ae2a2e81171" returned: 0 in 0.647s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:15:58 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-736a7add-8f62-48d9-a95e-ee4513c69ba7 tempest-VolumesCloneNegativeTest-503739409 None] <== create_volume: return (1652ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:15:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-736a7add-8f62-48d9-a95e-ee4513c69ba7 tempest-VolumesCloneNegativeTest-503739409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.655s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:15:58 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-736a7add-8f62-48d9-a95e-ee4513c69ba7 tempest-VolumesCloneNegativeTest-503739409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c59004fa-633f-45d8-9fde-1908b675f846) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4166acd8-5b84-4e39-a403-5ae2a2e81171', 'volume_size': 2}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:15:58 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-736a7add-8f62-48d9-a95e-ee4513c69ba7 tempest-VolumesCloneNegativeTest-503739409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b75fd0a6-83dc-482b-981b-4d2e339cbdf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:15:58 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-736a7add-8f62-48d9-a95e-ee4513c69ba7 tempest-VolumesCloneNegativeTest-503739409 None] Volume volume-4166acd8-5b84-4e39-a403-5ae2a2e81171 (4166acd8-5b84-4e39-a403-5ae2a2e81171): created successfully Jul 10 10:15:58 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-736a7add-8f62-48d9-a95e-ee4513c69ba7 tempest-VolumesCloneNegativeTest-503739409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b75fd0a6-83dc-482b-981b-4d2e339cbdf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:15:58 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-736a7add-8f62-48d9-a95e-ee4513c69ba7 tempest-VolumesCloneNegativeTest-503739409 None] Flow 'volume_create_manager' (025cc3bd-f3bb-45ab-85af-9d58d3aa1aa3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:15:58 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-736a7add-8f62-48d9-a95e-ee4513c69ba7 tempest-VolumesCloneNegativeTest-503739409 None] Created volume successfully. Jul 10 10:15:59 devstack sudo[100164]: pam_unix(sudo:session): session closed for user root Jul 10 10:15:59 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-54c311a7-6340-405e-9f19-b260f59508d6 tempest-CreateVolumesFromImageTest-270291878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b22da536-0b63-4309-ba24-045ac460eb50" returned: 0 in 0.699s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:15:59 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-54c311a7-6340-405e-9f19-b260f59508d6 tempest-CreateVolumesFromImageTest-270291878 None] Lock "cinder-quobyte-b22da536-0b63-4309-ba24-045ac460eb50" released by "delete_volume" :: held 1.527s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:15:59 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-54c311a7-6340-405e-9f19-b260f59508d6 tempest-CreateVolumesFromImageTest-270291878 None] Created reservations ['addeeff5-3be2-4372-b69c-7a942be8ebe8', '847ee680-87cd-4ce8-84fc-719b27fea3df', 'e11d8ec8-d377-46fa-9802-f5879ffd1342', '81b439a3-53a1-4b80-9f7d-53e98149b2c1'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:15:59 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-54c311a7-6340-405e-9f19-b260f59508d6 tempest-CreateVolumesFromImageTest-270291878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:15:59 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-54c311a7-6340-405e-9f19-b260f59508d6 tempest-CreateVolumesFromImageTest-270291878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:15:59 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-54c311a7-6340-405e-9f19-b260f59508d6 tempest-CreateVolumesFromImageTest-270291878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:15:59 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-54c311a7-6340-405e-9f19-b260f59508d6 tempest-CreateVolumesFromImageTest-270291878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:15:59 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-54c311a7-6340-405e-9f19-b260f59508d6 tempest-CreateVolumesFromImageTest-270291878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:15:59 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-54c311a7-6340-405e-9f19-b260f59508d6 tempest-CreateVolumesFromImageTest-270291878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:15:59 devstack sudo[100169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:15:59 devstack sudo[100169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:15:59 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-b981aac1-17af-40eb-aaa6-1d4986959978 tempest-CreateVolumesFromImageTest-270291878 None] Acquiring lock "cinder-923dc375-f22c-4f2d-91ed-e68835d2da25-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:15:59 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-b981aac1-17af-40eb-aaa6-1d4986959978 tempest-CreateVolumesFromImageTest-270291878 None] Lock "cinder-923dc375-f22c-4f2d-91ed-e68835d2da25-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:15:59 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-b981aac1-17af-40eb-aaa6-1d4986959978 tempest-CreateVolumesFromImageTest-270291878 None] Acquiring lock "cinder-quobyte-923dc375-f22c-4f2d-91ed-e68835d2da25" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:16:00 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-b981aac1-17af-40eb-aaa6-1d4986959978 tempest-CreateVolumesFromImageTest-270291878 None] Lock "cinder-quobyte-923dc375-f22c-4f2d-91ed-e68835d2da25" acquired by "delete_volume" :: waited 0.023s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:16:00 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e0f817a-65d6-4a7a-8b5f-f4c577174f76]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:16:00 devstack sudo[100169]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:00 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-b981aac1-17af-40eb-aaa6-1d4986959978 tempest-CreateVolumesFromImageTest-270291878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-923dc375-f22c-4f2d-91ed-e68835d2da25 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:00 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-54c311a7-6340-405e-9f19-b260f59508d6 tempest-CreateVolumesFromImageTest-270291878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.736s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:00 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-54c311a7-6340-405e-9f19-b260f59508d6 tempest-CreateVolumesFromImageTest-270291878 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:16:00 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-ecd4993b-a4bf-43cc-ac78-50c7fbfdf36e tempest-VolumesCloneNegativeTest-503739409 None] Acquiring lock "cinder-4166acd8-5b84-4e39-a403-5ae2a2e81171-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:16:00 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-54c311a7-6340-405e-9f19-b260f59508d6 tempest-CreateVolumesFromImageTest-270291878 None] Deleted volume successfully. Jul 10 10:16:00 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-ecd4993b-a4bf-43cc-ac78-50c7fbfdf36e tempest-VolumesCloneNegativeTest-503739409 None] Lock "cinder-4166acd8-5b84-4e39-a403-5ae2a2e81171-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:16:00 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-54c311a7-6340-405e-9f19-b260f59508d6 tempest-CreateVolumesFromImageTest-270291878 None] Lock "cinder-b22da536-0b63-4309-ba24-045ac460eb50-delete_volume" released by "delete_volume" :: held 2.568s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:16:00 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-ecd4993b-a4bf-43cc-ac78-50c7fbfdf36e tempest-VolumesCloneNegativeTest-503739409 None] Acquiring lock "cinder-quobyte-4166acd8-5b84-4e39-a403-5ae2a2e81171" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:16:00 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-ecd4993b-a4bf-43cc-ac78-50c7fbfdf36e tempest-VolumesCloneNegativeTest-503739409 None] Lock "cinder-quobyte-4166acd8-5b84-4e39-a403-5ae2a2e81171" acquired by "delete_volume" :: waited 0.016s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:16:00 devstack sudo[100177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-923dc375-f22c-4f2d-91ed-e68835d2da25 Jul 10 10:16:00 devstack sudo[100177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:00 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d64b733-58b2-438f-8a78-a1612a5de2a4]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:16:00 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ecd4993b-a4bf-43cc-ac78-50c7fbfdf36e tempest-VolumesCloneNegativeTest-503739409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-4166acd8-5b84-4e39-a403-5ae2a2e81171 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:00 devstack sudo[100183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-4166acd8-5b84-4e39-a403-5ae2a2e81171 Jul 10 10:16:00 devstack sudo[100183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:01 devstack sudo[100177]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:01 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-b981aac1-17af-40eb-aaa6-1d4986959978 tempest-CreateVolumesFromImageTest-270291878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-923dc375-f22c-4f2d-91ed-e68835d2da25" returned: 0 in 1.258s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:01 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-b981aac1-17af-40eb-aaa6-1d4986959978 tempest-CreateVolumesFromImageTest-270291878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-923dc375-f22c-4f2d-91ed-e68835d2da25 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:01 devstack sudo[100183]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:01 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ecd4993b-a4bf-43cc-ac78-50c7fbfdf36e tempest-VolumesCloneNegativeTest-503739409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-4166acd8-5b84-4e39-a403-5ae2a2e81171" returned: 0 in 1.067s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:01 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ecd4993b-a4bf-43cc-ac78-50c7fbfdf36e tempest-VolumesCloneNegativeTest-503739409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-4166acd8-5b84-4e39-a403-5ae2a2e81171 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:01 devstack sudo[100210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-923dc375-f22c-4f2d-91ed-e68835d2da25 Jul 10 10:16:01 devstack sudo[100210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:01 devstack sudo[100211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-4166acd8-5b84-4e39-a403-5ae2a2e81171 Jul 10 10:16:01 devstack sudo[100211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:02 devstack sudo[100210]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-b981aac1-17af-40eb-aaa6-1d4986959978 tempest-CreateVolumesFromImageTest-270291878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-923dc375-f22c-4f2d-91ed-e68835d2da25" returned: 0 in 1.226s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:02 devstack sudo[100211]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ecd4993b-a4bf-43cc-ac78-50c7fbfdf36e tempest-VolumesCloneNegativeTest-503739409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-4166acd8-5b84-4e39-a403-5ae2a2e81171" returned: 0 in 1.205s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:02 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-b981aac1-17af-40eb-aaa6-1d4986959978 tempest-CreateVolumesFromImageTest-270291878 None] Lock "cinder-quobyte-923dc375-f22c-4f2d-91ed-e68835d2da25" released by "delete_volume" :: held 2.578s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:16:02 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-ecd4993b-a4bf-43cc-ac78-50c7fbfdf36e tempest-VolumesCloneNegativeTest-503739409 None] Lock "cinder-quobyte-4166acd8-5b84-4e39-a403-5ae2a2e81171" released by "delete_volume" :: held 2.335s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:16:02 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-b981aac1-17af-40eb-aaa6-1d4986959978 tempest-CreateVolumesFromImageTest-270291878 None] Created reservations ['6a965819-4267-478f-af81-ea69a159b4a7', 'ac09ee91-b730-4da9-9671-ec561f21d9ef', '517f35a2-0ade-483c-89ac-c707b0bc5143', '765e2acf-6449-460e-aab9-2f06baa54ef1'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:16:02 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-ecd4993b-a4bf-43cc-ac78-50c7fbfdf36e tempest-VolumesCloneNegativeTest-503739409 None] Created reservations ['c17584dd-f7ed-4b72-bd8d-04f15020a080', '147ca4c8-35cb-4953-b0cf-d7bf0f4c585f', '5d01dd69-983f-4235-b872-d315b0403b60', 'a04b85c1-fd50-4b54-a536-84f6d33b41e5'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:16:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-b981aac1-17af-40eb-aaa6-1d4986959978 tempest-CreateVolumesFromImageTest-270291878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:16:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-b981aac1-17af-40eb-aaa6-1d4986959978 tempest-CreateVolumesFromImageTest-270291878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:16:02 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-b981aac1-17af-40eb-aaa6-1d4986959978 tempest-CreateVolumesFromImageTest-270291878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:16:02 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-b981aac1-17af-40eb-aaa6-1d4986959978 tempest-CreateVolumesFromImageTest-270291878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:16:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-b981aac1-17af-40eb-aaa6-1d4986959978 tempest-CreateVolumesFromImageTest-270291878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:16:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-b981aac1-17af-40eb-aaa6-1d4986959978 tempest-CreateVolumesFromImageTest-270291878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-ecd4993b-a4bf-43cc-ac78-50c7fbfdf36e tempest-VolumesCloneNegativeTest-503739409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:16:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-ecd4993b-a4bf-43cc-ac78-50c7fbfdf36e tempest-VolumesCloneNegativeTest-503739409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:16:02 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-ecd4993b-a4bf-43cc-ac78-50c7fbfdf36e tempest-VolumesCloneNegativeTest-503739409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:16:02 devstack sudo[100219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:16:02 devstack sudo[100219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:02 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-ecd4993b-a4bf-43cc-ac78-50c7fbfdf36e tempest-VolumesCloneNegativeTest-503739409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:16:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-ecd4993b-a4bf-43cc-ac78-50c7fbfdf36e tempest-VolumesCloneNegativeTest-503739409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:16:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ecd4993b-a4bf-43cc-ac78-50c7fbfdf36e tempest-VolumesCloneNegativeTest-503739409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:02 devstack sudo[100221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:16:02 devstack sudo[100221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:03 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-4859d6c3-8b3d-4782-a2a1-a233d6cbaca8 tempest-CreateVolumesFromImageTest-270291878 None] Acquiring lock "cinder-2ef86fea-9436-4f46-9c80-0683e6a6cbe3-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:16:03 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-4859d6c3-8b3d-4782-a2a1-a233d6cbaca8 tempest-CreateVolumesFromImageTest-270291878 None] Lock "cinder-2ef86fea-9436-4f46-9c80-0683e6a6cbe3-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:16:03 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-4859d6c3-8b3d-4782-a2a1-a233d6cbaca8 tempest-CreateVolumesFromImageTest-270291878 None] Acquiring lock "cinder-quobyte-2ef86fea-9436-4f46-9c80-0683e6a6cbe3" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:16:03 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-4859d6c3-8b3d-4782-a2a1-a233d6cbaca8 tempest-CreateVolumesFromImageTest-270291878 None] Lock "cinder-quobyte-2ef86fea-9436-4f46-9c80-0683e6a6cbe3" acquired by "delete_volume" :: waited 0.035s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:16:03 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[9feda1c5-3ff4-4018-9c16-0991936fcc0e]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:16:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4859d6c3-8b3d-4782-a2a1-a233d6cbaca8 tempest-CreateVolumesFromImageTest-270291878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2ef86fea-9436-4f46-9c80-0683e6a6cbe3 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:03 devstack sudo[100219]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-b981aac1-17af-40eb-aaa6-1d4986959978 tempest-CreateVolumesFromImageTest-270291878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.832s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:03 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-b981aac1-17af-40eb-aaa6-1d4986959978 tempest-CreateVolumesFromImageTest-270291878 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:16:03 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-b981aac1-17af-40eb-aaa6-1d4986959978 tempest-CreateVolumesFromImageTest-270291878 None] Deleted volume successfully. Jul 10 10:16:03 devstack sudo[100221]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ecd4993b-a4bf-43cc-ac78-50c7fbfdf36e tempest-VolumesCloneNegativeTest-503739409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.805s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:03 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-ecd4993b-a4bf-43cc-ac78-50c7fbfdf36e tempest-VolumesCloneNegativeTest-503739409 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:16:03 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-ecd4993b-a4bf-43cc-ac78-50c7fbfdf36e tempest-VolumesCloneNegativeTest-503739409 None] Deleted volume successfully. Jul 10 10:16:03 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-b981aac1-17af-40eb-aaa6-1d4986959978 tempest-CreateVolumesFromImageTest-270291878 None] Lock "cinder-923dc375-f22c-4f2d-91ed-e68835d2da25-delete_volume" released by "delete_volume" :: held 3.712s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:16:03 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-ecd4993b-a4bf-43cc-ac78-50c7fbfdf36e tempest-VolumesCloneNegativeTest-503739409 None] Lock "cinder-4166acd8-5b84-4e39-a403-5ae2a2e81171-delete_volume" released by "delete_volume" :: held 3.472s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:16:03 devstack sudo[100226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2ef86fea-9436-4f46-9c80-0683e6a6cbe3 Jul 10 10:16:03 devstack sudo[100226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:04 devstack sudo[100226]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4859d6c3-8b3d-4782-a2a1-a233d6cbaca8 tempest-CreateVolumesFromImageTest-270291878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2ef86fea-9436-4f46-9c80-0683e6a6cbe3" returned: 0 in 0.886s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4859d6c3-8b3d-4782-a2a1-a233d6cbaca8 tempest-CreateVolumesFromImageTest-270291878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2ef86fea-9436-4f46-9c80-0683e6a6cbe3 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:04 devstack sudo[100231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2ef86fea-9436-4f46-9c80-0683e6a6cbe3 Jul 10 10:16:04 devstack sudo[100231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:05 devstack sudo[100231]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4859d6c3-8b3d-4782-a2a1-a233d6cbaca8 tempest-CreateVolumesFromImageTest-270291878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2ef86fea-9436-4f46-9c80-0683e6a6cbe3" returned: 0 in 0.717s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:05 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-4859d6c3-8b3d-4782-a2a1-a233d6cbaca8 tempest-CreateVolumesFromImageTest-270291878 None] Lock "cinder-quobyte-2ef86fea-9436-4f46-9c80-0683e6a6cbe3" released by "delete_volume" :: held 1.694s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:16:05 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-4859d6c3-8b3d-4782-a2a1-a233d6cbaca8 tempest-CreateVolumesFromImageTest-270291878 None] Created reservations ['37d3f3ea-9c3e-4301-a2cd-394a07e129dc', '42e27dc6-d4ab-49f5-a499-063df3733255', 'ecfad01a-0f43-448b-9ac0-61f4fea619ea', 'c54ba914-6c51-4f2f-be2d-e1dd5ab6e036'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:16:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-4859d6c3-8b3d-4782-a2a1-a233d6cbaca8 tempest-CreateVolumesFromImageTest-270291878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:16:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-4859d6c3-8b3d-4782-a2a1-a233d6cbaca8 tempest-CreateVolumesFromImageTest-270291878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:16:05 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-4859d6c3-8b3d-4782-a2a1-a233d6cbaca8 tempest-CreateVolumesFromImageTest-270291878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:16:05 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-4859d6c3-8b3d-4782-a2a1-a233d6cbaca8 tempest-CreateVolumesFromImageTest-270291878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:16:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-4859d6c3-8b3d-4782-a2a1-a233d6cbaca8 tempest-CreateVolumesFromImageTest-270291878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:16:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4859d6c3-8b3d-4782-a2a1-a233d6cbaca8 tempest-CreateVolumesFromImageTest-270291878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:05 devstack sudo[100234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:16:05 devstack sudo[100234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:05 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-2c7c866a-7170-40d4-9c96-8065f0f64f05 tempest-CreateVolumesFromImageTest-270291878 None] Acquiring lock "cinder-f6fab297-63d3-407b-ba2c-68c69d19ce20-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:16:05 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-2c7c866a-7170-40d4-9c96-8065f0f64f05 tempest-CreateVolumesFromImageTest-270291878 None] Lock "cinder-f6fab297-63d3-407b-ba2c-68c69d19ce20-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:16:05 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-2c7c866a-7170-40d4-9c96-8065f0f64f05 tempest-CreateVolumesFromImageTest-270291878 None] Acquiring lock "cinder-quobyte-f6fab297-63d3-407b-ba2c-68c69d19ce20" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:16:05 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-2c7c866a-7170-40d4-9c96-8065f0f64f05 tempest-CreateVolumesFromImageTest-270291878 None] Lock "cinder-quobyte-f6fab297-63d3-407b-ba2c-68c69d19ce20" acquired by "delete_volume" :: waited 0.022s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:16:05 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[6592ba98-5b88-4846-9bd8-5eb70e0e5797]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:16:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-2c7c866a-7170-40d4-9c96-8065f0f64f05 tempest-CreateVolumesFromImageTest-270291878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f6fab297-63d3-407b-ba2c-68c69d19ce20 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:05 devstack sudo[100236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f6fab297-63d3-407b-ba2c-68c69d19ce20 Jul 10 10:16:05 devstack sudo[100236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:06 devstack sudo[100234]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4859d6c3-8b3d-4782-a2a1-a233d6cbaca8 tempest-CreateVolumesFromImageTest-270291878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.765s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:06 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-4859d6c3-8b3d-4782-a2a1-a233d6cbaca8 tempest-CreateVolumesFromImageTest-270291878 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:16:06 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-4859d6c3-8b3d-4782-a2a1-a233d6cbaca8 tempest-CreateVolumesFromImageTest-270291878 None] Deleted volume successfully. Jul 10 10:16:06 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-4859d6c3-8b3d-4782-a2a1-a233d6cbaca8 tempest-CreateVolumesFromImageTest-270291878 None] Lock "cinder-2ef86fea-9436-4f46-9c80-0683e6a6cbe3-delete_volume" released by "delete_volume" :: held 2.728s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:16:06 devstack sudo[100236]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-2c7c866a-7170-40d4-9c96-8065f0f64f05 tempest-CreateVolumesFromImageTest-270291878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f6fab297-63d3-407b-ba2c-68c69d19ce20" returned: 0 in 0.811s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-2c7c866a-7170-40d4-9c96-8065f0f64f05 tempest-CreateVolumesFromImageTest-270291878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f6fab297-63d3-407b-ba2c-68c69d19ce20 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:06 devstack sudo[100242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f6fab297-63d3-407b-ba2c-68c69d19ce20 Jul 10 10:16:06 devstack sudo[100242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:07 devstack sudo[100242]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-2c7c866a-7170-40d4-9c96-8065f0f64f05 tempest-CreateVolumesFromImageTest-270291878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f6fab297-63d3-407b-ba2c-68c69d19ce20" returned: 0 in 0.780s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:07 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-2c7c866a-7170-40d4-9c96-8065f0f64f05 tempest-CreateVolumesFromImageTest-270291878 None] Lock "cinder-quobyte-f6fab297-63d3-407b-ba2c-68c69d19ce20" released by "delete_volume" :: held 1.657s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:16:07 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-2c7c866a-7170-40d4-9c96-8065f0f64f05 tempest-CreateVolumesFromImageTest-270291878 None] Created reservations ['54e25a89-cdce-4007-be94-17cb0ae07424', 'a57246ca-2666-41ed-8b51-7b3389f98db5', 'c1eba2e2-3b01-4518-acf0-d6aac24ca7f6', '9fab51b9-209b-485c-88b9-a162d8d2397a'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:16:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-2c7c866a-7170-40d4-9c96-8065f0f64f05 tempest-CreateVolumesFromImageTest-270291878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:16:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-2c7c866a-7170-40d4-9c96-8065f0f64f05 tempest-CreateVolumesFromImageTest-270291878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:16:07 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-2c7c866a-7170-40d4-9c96-8065f0f64f05 tempest-CreateVolumesFromImageTest-270291878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:16:07 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-2c7c866a-7170-40d4-9c96-8065f0f64f05 tempest-CreateVolumesFromImageTest-270291878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:16:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-2c7c866a-7170-40d4-9c96-8065f0f64f05 tempest-CreateVolumesFromImageTest-270291878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:16:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-2c7c866a-7170-40d4-9c96-8065f0f64f05 tempest-CreateVolumesFromImageTest-270291878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:07 devstack sudo[100246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:16:07 devstack sudo[100246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:08 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-d58cb830-7cec-4b65-b3ad-12fa6ec6af48 tempest-CreateVolumesFromImageTest-270291878 None] Acquiring lock "cinder-279dd4ad-e97f-4355-9b6a-7a95339ff8aa-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:16:08 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-d58cb830-7cec-4b65-b3ad-12fa6ec6af48 tempest-CreateVolumesFromImageTest-270291878 None] Lock "cinder-279dd4ad-e97f-4355-9b6a-7a95339ff8aa-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:16:08 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-d58cb830-7cec-4b65-b3ad-12fa6ec6af48 tempest-CreateVolumesFromImageTest-270291878 None] Acquiring lock "cinder-quobyte-279dd4ad-e97f-4355-9b6a-7a95339ff8aa" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:16:08 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-629dab67-34f0-43c5-a0b1-1c54d3a44cca tempest-AttachVolumeNegativeTest-1243032650 None] Acquiring lock "cinder-19a05715-0e72-4458-9e80-d2cbb93d2491-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:16:08 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-d58cb830-7cec-4b65-b3ad-12fa6ec6af48 tempest-CreateVolumesFromImageTest-270291878 None] Lock "cinder-quobyte-279dd4ad-e97f-4355-9b6a-7a95339ff8aa" acquired by "delete_volume" :: waited 0.040s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:16:08 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-629dab67-34f0-43c5-a0b1-1c54d3a44cca tempest-AttachVolumeNegativeTest-1243032650 None] Lock "cinder-19a05715-0e72-4458-9e80-d2cbb93d2491-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:16:08 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3953cfc-17c9-4895-8497-4624257e45a8]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:16:08 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-d58cb830-7cec-4b65-b3ad-12fa6ec6af48 tempest-CreateVolumesFromImageTest-270291878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-279dd4ad-e97f-4355-9b6a-7a95339ff8aa {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:08 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-629dab67-34f0-43c5-a0b1-1c54d3a44cca tempest-AttachVolumeNegativeTest-1243032650 None] Acquiring lock "cinder-quobyte-19a05715-0e72-4458-9e80-d2cbb93d2491" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:16:08 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-629dab67-34f0-43c5-a0b1-1c54d3a44cca tempest-AttachVolumeNegativeTest-1243032650 None] Lock "cinder-quobyte-19a05715-0e72-4458-9e80-d2cbb93d2491" acquired by "delete_volume" :: waited 0.024s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:16:08 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab68f0d-e9f3-4bda-86b2-c568d4416334]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:16:08 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-629dab67-34f0-43c5-a0b1-1c54d3a44cca tempest-AttachVolumeNegativeTest-1243032650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-19a05715-0e72-4458-9e80-d2cbb93d2491 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:08 devstack sudo[100248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-279dd4ad-e97f-4355-9b6a-7a95339ff8aa Jul 10 10:16:08 devstack sudo[100248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:08 devstack sudo[100246]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:08 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-2c7c866a-7170-40d4-9c96-8065f0f64f05 tempest-CreateVolumesFromImageTest-270291878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.832s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:08 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-2c7c866a-7170-40d4-9c96-8065f0f64f05 tempest-CreateVolumesFromImageTest-270291878 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:16:08 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-2c7c866a-7170-40d4-9c96-8065f0f64f05 tempest-CreateVolumesFromImageTest-270291878 None] Deleted volume successfully. Jul 10 10:16:08 devstack sudo[100250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-19a05715-0e72-4458-9e80-d2cbb93d2491 Jul 10 10:16:08 devstack sudo[100250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:08 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-2c7c866a-7170-40d4-9c96-8065f0f64f05 tempest-CreateVolumesFromImageTest-270291878 None] Lock "cinder-f6fab297-63d3-407b-ba2c-68c69d19ce20-delete_volume" released by "delete_volume" :: held 2.776s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:16:09 devstack sudo[100248]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:09 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-d58cb830-7cec-4b65-b3ad-12fa6ec6af48 tempest-CreateVolumesFromImageTest-270291878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-279dd4ad-e97f-4355-9b6a-7a95339ff8aa" returned: 0 in 0.905s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:09 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-d58cb830-7cec-4b65-b3ad-12fa6ec6af48 tempest-CreateVolumesFromImageTest-270291878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-279dd4ad-e97f-4355-9b6a-7a95339ff8aa {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:09 devstack sudo[100259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-279dd4ad-e97f-4355-9b6a-7a95339ff8aa Jul 10 10:16:09 devstack sudo[100259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:09 devstack sudo[100250]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:09 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-629dab67-34f0-43c5-a0b1-1c54d3a44cca tempest-AttachVolumeNegativeTest-1243032650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-19a05715-0e72-4458-9e80-d2cbb93d2491" returned: 0 in 0.845s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:09 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-629dab67-34f0-43c5-a0b1-1c54d3a44cca tempest-AttachVolumeNegativeTest-1243032650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-19a05715-0e72-4458-9e80-d2cbb93d2491 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:09 devstack sudo[100261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-19a05715-0e72-4458-9e80-d2cbb93d2491 Jul 10 10:16:09 devstack sudo[100261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:09 devstack sudo[100259]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:09 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-d58cb830-7cec-4b65-b3ad-12fa6ec6af48 tempest-CreateVolumesFromImageTest-270291878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-279dd4ad-e97f-4355-9b6a-7a95339ff8aa" returned: 0 in 0.751s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:09 devstack sudo[100261]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:09 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-629dab67-34f0-43c5-a0b1-1c54d3a44cca tempest-AttachVolumeNegativeTest-1243032650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-19a05715-0e72-4458-9e80-d2cbb93d2491" returned: 0 in 0.722s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:09 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-d58cb830-7cec-4b65-b3ad-12fa6ec6af48 tempest-CreateVolumesFromImageTest-270291878 None] Lock "cinder-quobyte-279dd4ad-e97f-4355-9b6a-7a95339ff8aa" released by "delete_volume" :: held 1.744s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:16:09 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-629dab67-34f0-43c5-a0b1-1c54d3a44cca tempest-AttachVolumeNegativeTest-1243032650 None] Lock "cinder-quobyte-19a05715-0e72-4458-9e80-d2cbb93d2491" released by "delete_volume" :: held 1.624s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:16:09 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-d58cb830-7cec-4b65-b3ad-12fa6ec6af48 tempest-CreateVolumesFromImageTest-270291878 None] Created reservations ['90ae2fe9-0319-4e80-a698-43e19937ac2b', '910c0ea9-5b5f-47ee-827f-32d08fae4737', 'aaa0a067-b4c1-413d-8af7-050d1e88082f', '51a68621-fc23-42bf-8787-68ec5262a7de'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:16:09 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-629dab67-34f0-43c5-a0b1-1c54d3a44cca tempest-AttachVolumeNegativeTest-1243032650 None] Created reservations ['e24e442e-6ef8-44b1-a9d5-781be5fee976', '445d460a-de69-48f8-887d-3f3272b9e93b', '386e13c5-ece0-4cf4-9638-7b5913efd4d3', 'b2827d4b-2a60-4b35-a769-cfbbec5a141f'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:16:10 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-d58cb830-7cec-4b65-b3ad-12fa6ec6af48 tempest-CreateVolumesFromImageTest-270291878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:16:10 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-d58cb830-7cec-4b65-b3ad-12fa6ec6af48 tempest-CreateVolumesFromImageTest-270291878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:16:10 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-d58cb830-7cec-4b65-b3ad-12fa6ec6af48 tempest-CreateVolumesFromImageTest-270291878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:16:10 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-d58cb830-7cec-4b65-b3ad-12fa6ec6af48 tempest-CreateVolumesFromImageTest-270291878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:16:10 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-d58cb830-7cec-4b65-b3ad-12fa6ec6af48 tempest-CreateVolumesFromImageTest-270291878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:16:10 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-d58cb830-7cec-4b65-b3ad-12fa6ec6af48 tempest-CreateVolumesFromImageTest-270291878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:10 devstack sudo[100265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:16:10 devstack sudo[100265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:10 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-629dab67-34f0-43c5-a0b1-1c54d3a44cca tempest-AttachVolumeNegativeTest-1243032650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:16:10 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-629dab67-34f0-43c5-a0b1-1c54d3a44cca tempest-AttachVolumeNegativeTest-1243032650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:16:10 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-629dab67-34f0-43c5-a0b1-1c54d3a44cca tempest-AttachVolumeNegativeTest-1243032650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:16:10 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-629dab67-34f0-43c5-a0b1-1c54d3a44cca tempest-AttachVolumeNegativeTest-1243032650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:16:10 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-629dab67-34f0-43c5-a0b1-1c54d3a44cca tempest-AttachVolumeNegativeTest-1243032650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:16:10 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-629dab67-34f0-43c5-a0b1-1c54d3a44cca tempest-AttachVolumeNegativeTest-1243032650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:10 devstack sudo[100267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:16:10 devstack sudo[100267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:10 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-d43c1c2e-69f3-4e10-8124-e9e05c94e35a tempest-AttachVolumeNegativeTest-1243032650 None] Acquiring lock "cinder-68428cb2-39ae-4076-8966-41d751e1ca59-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:16:10 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-d43c1c2e-69f3-4e10-8124-e9e05c94e35a tempest-AttachVolumeNegativeTest-1243032650 None] Lock "cinder-68428cb2-39ae-4076-8966-41d751e1ca59-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:16:10 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-d43c1c2e-69f3-4e10-8124-e9e05c94e35a tempest-AttachVolumeNegativeTest-1243032650 None] Acquiring lock "cinder-quobyte-68428cb2-39ae-4076-8966-41d751e1ca59" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:16:10 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-d43c1c2e-69f3-4e10-8124-e9e05c94e35a tempest-AttachVolumeNegativeTest-1243032650 None] Lock "cinder-quobyte-68428cb2-39ae-4076-8966-41d751e1ca59" acquired by "delete_volume" :: waited 0.027s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:16:10 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c73501-e565-4e53-a819-ad59ed31ee3d]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:16:10 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-d43c1c2e-69f3-4e10-8124-e9e05c94e35a tempest-AttachVolumeNegativeTest-1243032650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-68428cb2-39ae-4076-8966-41d751e1ca59 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:10 devstack sudo[100265]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:10 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-d58cb830-7cec-4b65-b3ad-12fa6ec6af48 tempest-CreateVolumesFromImageTest-270291878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.894s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:10 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-d58cb830-7cec-4b65-b3ad-12fa6ec6af48 tempest-CreateVolumesFromImageTest-270291878 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:16:10 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-d58cb830-7cec-4b65-b3ad-12fa6ec6af48 tempest-CreateVolumesFromImageTest-270291878 None] Deleted volume successfully. Jul 10 10:16:10 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-d58cb830-7cec-4b65-b3ad-12fa6ec6af48 tempest-CreateVolumesFromImageTest-270291878 None] Lock "cinder-279dd4ad-e97f-4355-9b6a-7a95339ff8aa-delete_volume" released by "delete_volume" :: held 2.945s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:16:11 devstack sudo[100267]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:11 devstack sudo[100271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-68428cb2-39ae-4076-8966-41d751e1ca59 Jul 10 10:16:11 devstack sudo[100271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:11 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-629dab67-34f0-43c5-a0b1-1c54d3a44cca tempest-AttachVolumeNegativeTest-1243032650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.956s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:11 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-629dab67-34f0-43c5-a0b1-1c54d3a44cca tempest-AttachVolumeNegativeTest-1243032650 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:16:11 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-629dab67-34f0-43c5-a0b1-1c54d3a44cca tempest-AttachVolumeNegativeTest-1243032650 None] Deleted volume successfully. Jul 10 10:16:11 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-629dab67-34f0-43c5-a0b1-1c54d3a44cca tempest-AttachVolumeNegativeTest-1243032650 None] Lock "cinder-19a05715-0e72-4458-9e80-d2cbb93d2491-delete_volume" released by "delete_volume" :: held 3.015s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:16:11 devstack sudo[100271]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:11 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-d43c1c2e-69f3-4e10-8124-e9e05c94e35a tempest-AttachVolumeNegativeTest-1243032650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-68428cb2-39ae-4076-8966-41d751e1ca59" returned: 0 in 0.859s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:11 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-d43c1c2e-69f3-4e10-8124-e9e05c94e35a tempest-AttachVolumeNegativeTest-1243032650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-68428cb2-39ae-4076-8966-41d751e1ca59 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:11 devstack sudo[100276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-68428cb2-39ae-4076-8966-41d751e1ca59 Jul 10 10:16:11 devstack sudo[100276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:12 devstack sudo[100276]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-d43c1c2e-69f3-4e10-8124-e9e05c94e35a tempest-AttachVolumeNegativeTest-1243032650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-68428cb2-39ae-4076-8966-41d751e1ca59" returned: 0 in 0.667s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:12 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-d43c1c2e-69f3-4e10-8124-e9e05c94e35a tempest-AttachVolumeNegativeTest-1243032650 None] Lock "cinder-quobyte-68428cb2-39ae-4076-8966-41d751e1ca59" released by "delete_volume" :: held 1.583s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:16:12 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-d43c1c2e-69f3-4e10-8124-e9e05c94e35a tempest-AttachVolumeNegativeTest-1243032650 None] Created reservations ['e1cdfb24-2be9-4bce-9864-714ad61ec6aa', '7ec6abe7-5a7c-4093-a9ad-4dd7acda21c9', 'ae460b84-62db-476c-887c-52fa99cf194c', '320c8276-5854-4b74-863b-62823e0f510a'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:16:13 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-d43c1c2e-69f3-4e10-8124-e9e05c94e35a tempest-AttachVolumeNegativeTest-1243032650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:16:13 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-d43c1c2e-69f3-4e10-8124-e9e05c94e35a tempest-AttachVolumeNegativeTest-1243032650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:16:13 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-d43c1c2e-69f3-4e10-8124-e9e05c94e35a tempest-AttachVolumeNegativeTest-1243032650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:16:13 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-d43c1c2e-69f3-4e10-8124-e9e05c94e35a tempest-AttachVolumeNegativeTest-1243032650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:16:13 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-d43c1c2e-69f3-4e10-8124-e9e05c94e35a tempest-AttachVolumeNegativeTest-1243032650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:16:13 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-d43c1c2e-69f3-4e10-8124-e9e05c94e35a tempest-AttachVolumeNegativeTest-1243032650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:13 devstack sudo[100280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:16:13 devstack sudo[100280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:14 devstack sudo[100280]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:14 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-d43c1c2e-69f3-4e10-8124-e9e05c94e35a tempest-AttachVolumeNegativeTest-1243032650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.712s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:14 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-d43c1c2e-69f3-4e10-8124-e9e05c94e35a tempest-AttachVolumeNegativeTest-1243032650 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:16:14 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-d43c1c2e-69f3-4e10-8124-e9e05c94e35a tempest-AttachVolumeNegativeTest-1243032650 None] Deleted volume successfully. Jul 10 10:16:14 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-d43c1c2e-69f3-4e10-8124-e9e05c94e35a tempest-AttachVolumeNegativeTest-1243032650 None] Lock "cinder-68428cb2-39ae-4076-8966-41d751e1ca59-delete_volume" released by "delete_volume" :: held 3.614s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:16:14 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-418bcd63-3ad5-4df3-8a0b-52f66bf776d9 tempest-AttachVolumeNegativeTest-1243032650 None] Acquiring lock "cinder-d3da148d-8156-426c-b0d4-f2b4ea794e43-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:16:14 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-418bcd63-3ad5-4df3-8a0b-52f66bf776d9 tempest-AttachVolumeNegativeTest-1243032650 None] Lock "cinder-d3da148d-8156-426c-b0d4-f2b4ea794e43-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:16:15 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-418bcd63-3ad5-4df3-8a0b-52f66bf776d9 tempest-AttachVolumeNegativeTest-1243032650 None] Acquiring lock "cinder-quobyte-d3da148d-8156-426c-b0d4-f2b4ea794e43" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:16:15 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-418bcd63-3ad5-4df3-8a0b-52f66bf776d9 tempest-AttachVolumeNegativeTest-1243032650 None] Lock "cinder-quobyte-d3da148d-8156-426c-b0d4-f2b4ea794e43" acquired by "delete_volume" :: waited 0.020s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:16:15 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d636043-4602-4d6a-b70f-267c037d707a]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:16:15 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-418bcd63-3ad5-4df3-8a0b-52f66bf776d9 tempest-AttachVolumeNegativeTest-1243032650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d3da148d-8156-426c-b0d4-f2b4ea794e43 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:15 devstack sudo[100283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d3da148d-8156-426c-b0d4-f2b4ea794e43 Jul 10 10:16:15 devstack sudo[100283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:15 devstack sudo[100283]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:15 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-418bcd63-3ad5-4df3-8a0b-52f66bf776d9 tempest-AttachVolumeNegativeTest-1243032650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d3da148d-8156-426c-b0d4-f2b4ea794e43" returned: 0 in 0.854s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:15 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-418bcd63-3ad5-4df3-8a0b-52f66bf776d9 tempest-AttachVolumeNegativeTest-1243032650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d3da148d-8156-426c-b0d4-f2b4ea794e43 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:15 devstack sudo[100324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d3da148d-8156-426c-b0d4-f2b4ea794e43 Jul 10 10:16:15 devstack sudo[100324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:16 devstack sudo[100324]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-418bcd63-3ad5-4df3-8a0b-52f66bf776d9 tempest-AttachVolumeNegativeTest-1243032650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d3da148d-8156-426c-b0d4-f2b4ea794e43" returned: 0 in 0.718s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:16 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-418bcd63-3ad5-4df3-8a0b-52f66bf776d9 tempest-AttachVolumeNegativeTest-1243032650 None] Lock "cinder-quobyte-d3da148d-8156-426c-b0d4-f2b4ea794e43" released by "delete_volume" :: held 1.654s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:16:16 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-418bcd63-3ad5-4df3-8a0b-52f66bf776d9 tempest-AttachVolumeNegativeTest-1243032650 None] Created reservations ['2a31aab6-5853-4069-bd44-3bb649eadc7b', '97482266-6c6d-4c16-b350-981459693b91', '6f49d839-9378-4f6b-9cad-54fc2025c6b6', 'e1b6aa2f-e1d5-447d-a897-d8f0f47b8075'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:16:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-418bcd63-3ad5-4df3-8a0b-52f66bf776d9 tempest-AttachVolumeNegativeTest-1243032650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:16:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-418bcd63-3ad5-4df3-8a0b-52f66bf776d9 tempest-AttachVolumeNegativeTest-1243032650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:16:17 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-418bcd63-3ad5-4df3-8a0b-52f66bf776d9 tempest-AttachVolumeNegativeTest-1243032650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:16:17 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-418bcd63-3ad5-4df3-8a0b-52f66bf776d9 tempest-AttachVolumeNegativeTest-1243032650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:16:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-418bcd63-3ad5-4df3-8a0b-52f66bf776d9 tempest-AttachVolumeNegativeTest-1243032650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:16:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-418bcd63-3ad5-4df3-8a0b-52f66bf776d9 tempest-AttachVolumeNegativeTest-1243032650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:17 devstack sudo[100332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:16:17 devstack sudo[100332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:18 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-52a6312a-3713-46c6-ada0-cbe967f3246b tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:16:18 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-52a6312a-3713-46c6-ada0-cbe967f3246b tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Flow 'volume_create_manager' (028ffd9d-ee81-46a7-a229-a86dd3ba53a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:16:18 devstack sudo[100332]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:18 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-52a6312a-3713-46c6-ada0-cbe967f3246b tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (616b1eac-06ab-469c-b560-553f7b1155c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:16:18 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-418bcd63-3ad5-4df3-8a0b-52f66bf776d9 tempest-AttachVolumeNegativeTest-1243032650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 1.325s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:18 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-418bcd63-3ad5-4df3-8a0b-52f66bf776d9 tempest-AttachVolumeNegativeTest-1243032650 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:16:18 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-418bcd63-3ad5-4df3-8a0b-52f66bf776d9 tempest-AttachVolumeNegativeTest-1243032650 None] Deleted volume successfully. Jul 10 10:16:18 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-52a6312a-3713-46c6-ada0-cbe967f3246b tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (616b1eac-06ab-469c-b560-553f7b1155c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-966526077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=874dae93-9b7a-4b3a-bcb1-cddae4b9124b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34cae259754a42ffbe85d93e7644aa3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:16:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:16:18Z,use_quota=True,user_id='37bc3046fdd44d7eabd61f7df62e149d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:16:18 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-52a6312a-3713-46c6-ada0-cbe967f3246b tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb2f7b2e-18af-4dda-8fb0-77b1be8007fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:16:18 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-52a6312a-3713-46c6-ada0-cbe967f3246b tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb2f7b2e-18af-4dda-8fb0-77b1be8007fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:16:18 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-52a6312a-3713-46c6-ada0-cbe967f3246b tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6eae275b-ca42-47b0-b049-762c7ae6bb2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:16:18 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-52a6312a-3713-46c6-ada0-cbe967f3246b tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6eae275b-ca42-47b0-b049-762c7ae6bb2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '874dae93-9b7a-4b3a-bcb1-cddae4b9124b', 'volume_name': 'volume-874dae93-9b7a-4b3a-bcb1-cddae4b9124b', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:16:18 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-52a6312a-3713-46c6-ada0-cbe967f3246b tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a49fbfe8-ada9-40c8-91bf-ba65b3346900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:16:18 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-52a6312a-3713-46c6-ada0-cbe967f3246b tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a49fbfe8-ada9-40c8-91bf-ba65b3346900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:16:18 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-52a6312a-3713-46c6-ada0-cbe967f3246b tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34067d82-f16a-4c40-be49-898607582f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:16:18 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-52a6312a-3713-46c6-ada0-cbe967f3246b tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Volume 874dae93-9b7a-4b3a-bcb1-cddae4b9124b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-874dae93-9b7a-4b3a-bcb1-cddae4b9124b', 'volume_size': 1} Jul 10 10:16:18 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-52a6312a-3713-46c6-ada0-cbe967f3246b tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:16:18 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-52a6312a-3713-46c6-ada0-cbe967f3246b tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:16:18 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-52a6312a-3713-46c6-ada0-cbe967f3246b tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-966526077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=874dae93-9b7a-4b3a-bcb1-cddae4b9124b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34cae259754a42ffbe85d93e7644aa3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:16:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:16:18Z,use_quota=True,user_id='37bc3046fdd44d7eabd61f7df62e149d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:16:18 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-52a6312a-3713-46c6-ada0-cbe967f3246b tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Creating volume 874dae93-9b7a-4b3a-bcb1-cddae4b9124b {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:16:18 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-52a6312a-3713-46c6-ada0-cbe967f3246b tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:16:18 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-52a6312a-3713-46c6-ada0-cbe967f3246b tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:16:18 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-52a6312a-3713-46c6-ada0-cbe967f3246b tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:16:18 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-52a6312a-3713-46c6-ada0-cbe967f3246b tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:16:18 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-52a6312a-3713-46c6-ada0-cbe967f3246b tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:16:18 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-52a6312a-3713-46c6-ada0-cbe967f3246b tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:16:18 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-52a6312a-3713-46c6-ada0-cbe967f3246b tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:16:18 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-52a6312a-3713-46c6-ada0-cbe967f3246b tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-874dae93-9b7a-4b3a-bcb1-cddae4b9124b 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:18 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-418bcd63-3ad5-4df3-8a0b-52f66bf776d9 tempest-AttachVolumeNegativeTest-1243032650 None] Lock "cinder-d3da148d-8156-426c-b0d4-f2b4ea794e43-delete_volume" released by "delete_volume" :: held 3.919s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:16:18 devstack sudo[100337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-874dae93-9b7a-4b3a-bcb1-cddae4b9124b 1073741824 Jul 10 10:16:18 devstack sudo[100337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:19 devstack sudo[100337]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:19 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-52a6312a-3713-46c6-ada0-cbe967f3246b tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-874dae93-9b7a-4b3a-bcb1-cddae4b9124b 1073741824" returned: 0 in 1.003s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:19 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-52a6312a-3713-46c6-ada0-cbe967f3246b tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-874dae93-9b7a-4b3a-bcb1-cddae4b9124b {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:19 devstack sudo[100348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-874dae93-9b7a-4b3a-bcb1-cddae4b9124b Jul 10 10:16:19 devstack sudo[100348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:20 devstack sudo[100348]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:20 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-52a6312a-3713-46c6-ada0-cbe967f3246b tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-874dae93-9b7a-4b3a-bcb1-cddae4b9124b" returned: 0 in 0.880s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:20 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-52a6312a-3713-46c6-ada0-cbe967f3246b tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] <== create_volume: return (1933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:16:20 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-52a6312a-3713-46c6-ada0-cbe967f3246b tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.936s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:16:20 devstack cinder-volume[87234]: DEBUG dbcounter [-] [87234] Writing DB stats cinder:SELECT=83,cinder:UPDATE=125,cinder:INSERT=40,cinder:DELETE=13 {{(pid=87234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 10:16:20 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-52a6312a-3713-46c6-ada0-cbe967f3246b tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34067d82-f16a-4c40-be49-898607582f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-874dae93-9b7a-4b3a-bcb1-cddae4b9124b', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:16:20 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-52a6312a-3713-46c6-ada0-cbe967f3246b tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (535b4c0f-f8f1-4ea2-8fc4-54fa79ccf40c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:16:20 devstack cinder-volume[87234]: DEBUG dbcounter [-] [87234] Writing DB stats cinder:UPDATE=115,cinder:SELECT=99,cinder:INSERT=22,cinder:DELETE=6 {{(pid=87234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 10:16:20 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-52a6312a-3713-46c6-ada0-cbe967f3246b tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Volume volume-874dae93-9b7a-4b3a-bcb1-cddae4b9124b (874dae93-9b7a-4b3a-bcb1-cddae4b9124b): created successfully Jul 10 10:16:20 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-52a6312a-3713-46c6-ada0-cbe967f3246b tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (535b4c0f-f8f1-4ea2-8fc4-54fa79ccf40c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:16:20 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-52a6312a-3713-46c6-ada0-cbe967f3246b tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Flow 'volume_create_manager' (028ffd9d-ee81-46a7-a229-a86dd3ba53a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:16:20 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-52a6312a-3713-46c6-ada0-cbe967f3246b tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Created volume successfully. Jul 10 10:16:22 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-58585180-1b74-4631-b95f-86e719e63705 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:16:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-58585180-1b74-4631-b95f-86e719e63705 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Flow 'volume_create_manager' (2b245735-80ad-45a3-8d0f-7b67c7f3b690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:16:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-58585180-1b74-4631-b95f-86e719e63705 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a88b0731-6b27-4433-a36b-8244d03e7a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:16:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-58585180-1b74-4631-b95f-86e719e63705 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a88b0731-6b27-4433-a36b-8244d03e7a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:16:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1088436683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a98ede4-80e2-4d2a-afae-eb6b6da2ae3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34cae259754a42ffbe85d93e7644aa3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:16:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:16:22Z,use_quota=True,user_id='37bc3046fdd44d7eabd61f7df62e149d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:16:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-58585180-1b74-4631-b95f-86e719e63705 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7575f71e-b38f-4232-85e8-5f9c9eeb393a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:16:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-58585180-1b74-4631-b95f-86e719e63705 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7575f71e-b38f-4232-85e8-5f9c9eeb393a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:16:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-58585180-1b74-4631-b95f-86e719e63705 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e2ee61e-70ec-47d8-a3d1-030f82680c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:16:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-58585180-1b74-4631-b95f-86e719e63705 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e2ee61e-70ec-47d8-a3d1-030f82680c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a98ede4-80e2-4d2a-afae-eb6b6da2ae3b', 'volume_name': 'volume-8a98ede4-80e2-4d2a-afae-eb6b6da2ae3b', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:16:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-58585180-1b74-4631-b95f-86e719e63705 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f12fb3af-7423-41f2-b3f2-43fec7d69c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:16:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-58585180-1b74-4631-b95f-86e719e63705 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f12fb3af-7423-41f2-b3f2-43fec7d69c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:16:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-58585180-1b74-4631-b95f-86e719e63705 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fe8ba2a-2b98-4c00-bdba-529abb4aaf61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:16:22 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-58585180-1b74-4631-b95f-86e719e63705 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Volume 8a98ede4-80e2-4d2a-afae-eb6b6da2ae3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a98ede4-80e2-4d2a-afae-eb6b6da2ae3b', 'volume_size': 1} Jul 10 10:16:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-58585180-1b74-4631-b95f-86e719e63705 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:16:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-58585180-1b74-4631-b95f-86e719e63705 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:16:22 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-58585180-1b74-4631-b95f-86e719e63705 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:16:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1088436683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a98ede4-80e2-4d2a-afae-eb6b6da2ae3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34cae259754a42ffbe85d93e7644aa3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:16:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:16:22Z,use_quota=True,user_id='37bc3046fdd44d7eabd61f7df62e149d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:16:22 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-58585180-1b74-4631-b95f-86e719e63705 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Creating volume 8a98ede4-80e2-4d2a-afae-eb6b6da2ae3b {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:16:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-58585180-1b74-4631-b95f-86e719e63705 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:16:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-58585180-1b74-4631-b95f-86e719e63705 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:16:22 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-58585180-1b74-4631-b95f-86e719e63705 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:16:22 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-58585180-1b74-4631-b95f-86e719e63705 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:16:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-58585180-1b74-4631-b95f-86e719e63705 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:16:22 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-58585180-1b74-4631-b95f-86e719e63705 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:16:22 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-58585180-1b74-4631-b95f-86e719e63705 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:16:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-58585180-1b74-4631-b95f-86e719e63705 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8a98ede4-80e2-4d2a-afae-eb6b6da2ae3b 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:22 devstack sudo[100372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8a98ede4-80e2-4d2a-afae-eb6b6da2ae3b 1073741824 Jul 10 10:16:22 devstack sudo[100372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:22 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-444eed84-2c77-4279-891e-219515c4ebea tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:16:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-444eed84-2c77-4279-891e-219515c4ebea tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Flow 'volume_create_manager' (56b0678a-2940-4969-a02e-b7048c0c7e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:16:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-444eed84-2c77-4279-891e-219515c4ebea tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7658ee2-90a4-42b5-9e80-00dded551392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:16:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-444eed84-2c77-4279-891e-219515c4ebea tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7658ee2-90a4-42b5-9e80-00dded551392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:16:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-66492870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84e1378a-ce89-4874-b6c3-16c35305dbdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34cae259754a42ffbe85d93e7644aa3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:16:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:16:23Z,use_quota=True,user_id='37bc3046fdd44d7eabd61f7df62e149d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:16:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-444eed84-2c77-4279-891e-219515c4ebea tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9ac75e4-8df9-4cd3-b47c-bab818a8250e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:16:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-444eed84-2c77-4279-891e-219515c4ebea tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9ac75e4-8df9-4cd3-b47c-bab818a8250e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:16:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-444eed84-2c77-4279-891e-219515c4ebea tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f642eed-4fb8-4e0f-a4f1-38858d72d1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:16:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-444eed84-2c77-4279-891e-219515c4ebea tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f642eed-4fb8-4e0f-a4f1-38858d72d1e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84e1378a-ce89-4874-b6c3-16c35305dbdc', 'volume_name': 'volume-84e1378a-ce89-4874-b6c3-16c35305dbdc', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:16:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-444eed84-2c77-4279-891e-219515c4ebea tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8e75cbc-2690-47ce-bc72-d75f90633cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:16:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-444eed84-2c77-4279-891e-219515c4ebea tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8e75cbc-2690-47ce-bc72-d75f90633cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:16:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-444eed84-2c77-4279-891e-219515c4ebea tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bf9df19-7019-4bf2-9efd-650ae3d4341d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:16:22 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-444eed84-2c77-4279-891e-219515c4ebea tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Volume 84e1378a-ce89-4874-b6c3-16c35305dbdc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84e1378a-ce89-4874-b6c3-16c35305dbdc', 'volume_size': 1} Jul 10 10:16:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-444eed84-2c77-4279-891e-219515c4ebea tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:16:23 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8b60fd9-8058-43ce-80ff-2d9f62935478 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:16:23 devstack sudo[100372]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:23 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c8b60fd9-8058-43ce-80ff-2d9f62935478 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Flow 'volume_create_manager' (9569fc46-3dd8-4c62-a303-1fc3068bcddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:16:23 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c8b60fd9-8058-43ce-80ff-2d9f62935478 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe9fdc86-a04a-4df0-92f6-08cde00131c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:16:23 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-58585180-1b74-4631-b95f-86e719e63705 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8a98ede4-80e2-4d2a-afae-eb6b6da2ae3b 1073741824" returned: 0 in 1.265s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:23 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c8b60fd9-8058-43ce-80ff-2d9f62935478 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe9fdc86-a04a-4df0-92f6-08cde00131c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:16:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1108497862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa0fbe3f-b01b-472f-858d-faa81a7b376a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34cae259754a42ffbe85d93e7644aa3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:16:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:16:24Z,use_quota=True,user_id='37bc3046fdd44d7eabd61f7df62e149d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:16:23 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c8b60fd9-8058-43ce-80ff-2d9f62935478 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd410f4d-7b21-4772-bcb3-3af4ce3cfeb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:16:23 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c8b60fd9-8058-43ce-80ff-2d9f62935478 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd410f4d-7b21-4772-bcb3-3af4ce3cfeb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:16:23 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c8b60fd9-8058-43ce-80ff-2d9f62935478 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bc0ff1c-8cb6-4243-bc28-10cb42274523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:16:23 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c8b60fd9-8058-43ce-80ff-2d9f62935478 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bc0ff1c-8cb6-4243-bc28-10cb42274523) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa0fbe3f-b01b-472f-858d-faa81a7b376a', 'volume_name': 'volume-fa0fbe3f-b01b-472f-858d-faa81a7b376a', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:16:23 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c8b60fd9-8058-43ce-80ff-2d9f62935478 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e84f093e-7ada-48db-9d82-3aad4cd3285d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:16:23 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c8b60fd9-8058-43ce-80ff-2d9f62935478 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e84f093e-7ada-48db-9d82-3aad4cd3285d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:16:23 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c8b60fd9-8058-43ce-80ff-2d9f62935478 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79ae56fd-3981-4fc5-b83d-58b13d2c42bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:16:23 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-c8b60fd9-8058-43ce-80ff-2d9f62935478 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Volume fa0fbe3f-b01b-472f-858d-faa81a7b376a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa0fbe3f-b01b-472f-858d-faa81a7b376a', 'volume_size': 1} Jul 10 10:16:23 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-c8b60fd9-8058-43ce-80ff-2d9f62935478 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:16:23 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-58585180-1b74-4631-b95f-86e719e63705 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8a98ede4-80e2-4d2a-afae-eb6b6da2ae3b {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:23 devstack sudo[100378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8a98ede4-80e2-4d2a-afae-eb6b6da2ae3b Jul 10 10:16:23 devstack sudo[100378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:24 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1c099ed-545e-4fbb-ad22-9dcd0633a18d tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:16:24 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f1c099ed-545e-4fbb-ad22-9dcd0633a18d tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Flow 'volume_create_manager' (62afbcfb-f042-4122-b7bc-2f591daf7086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:16:24 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f1c099ed-545e-4fbb-ad22-9dcd0633a18d tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1a9b424-5ffb-43f2-b687-8f68c384b47b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:16:24 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f1c099ed-545e-4fbb-ad22-9dcd0633a18d tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1a9b424-5ffb-43f2-b687-8f68c384b47b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:16:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1782656710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4243a04b-ea1b-4b21-a1e7-196aedb2fbba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34cae259754a42ffbe85d93e7644aa3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:16:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:16:24Z,use_quota=True,user_id='37bc3046fdd44d7eabd61f7df62e149d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:16:24 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f1c099ed-545e-4fbb-ad22-9dcd0633a18d tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4155483-ea5f-40f0-ad4e-8ec669155a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:16:24 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f1c099ed-545e-4fbb-ad22-9dcd0633a18d tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4155483-ea5f-40f0-ad4e-8ec669155a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:16:24 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f1c099ed-545e-4fbb-ad22-9dcd0633a18d tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (643fdcc1-7d83-4661-a895-3b2f5f7312f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:16:24 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f1c099ed-545e-4fbb-ad22-9dcd0633a18d tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (643fdcc1-7d83-4661-a895-3b2f5f7312f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4243a04b-ea1b-4b21-a1e7-196aedb2fbba', 'volume_name': 'volume-4243a04b-ea1b-4b21-a1e7-196aedb2fbba', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:16:24 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f1c099ed-545e-4fbb-ad22-9dcd0633a18d tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35c3eb00-18bf-42f1-816c-767ff7e888aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:16:24 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f1c099ed-545e-4fbb-ad22-9dcd0633a18d tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35c3eb00-18bf-42f1-816c-767ff7e888aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:16:24 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f1c099ed-545e-4fbb-ad22-9dcd0633a18d tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1d957cd-b8ec-40b0-9534-2f51ef7c51c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:16:24 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-f1c099ed-545e-4fbb-ad22-9dcd0633a18d tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Volume 4243a04b-ea1b-4b21-a1e7-196aedb2fbba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4243a04b-ea1b-4b21-a1e7-196aedb2fbba', 'volume_size': 1} Jul 10 10:16:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f1c099ed-545e-4fbb-ad22-9dcd0633a18d tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:16:24 devstack sudo[100378]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-58585180-1b74-4631-b95f-86e719e63705 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8a98ede4-80e2-4d2a-afae-eb6b6da2ae3b" returned: 0 in 0.930s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:24 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-58585180-1b74-4631-b95f-86e719e63705 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] <== create_volume: return (2343ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:16:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-58585180-1b74-4631-b95f-86e719e63705 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.346s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:16:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-444eed84-2c77-4279-891e-219515c4ebea tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.800s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:16:24 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-444eed84-2c77-4279-891e-219515c4ebea tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:16:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-66492870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84e1378a-ce89-4874-b6c3-16c35305dbdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34cae259754a42ffbe85d93e7644aa3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:16:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:16:23Z,use_quota=True,user_id='37bc3046fdd44d7eabd61f7df62e149d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:16:24 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-444eed84-2c77-4279-891e-219515c4ebea tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Creating volume 84e1378a-ce89-4874-b6c3-16c35305dbdc {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:16:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-444eed84-2c77-4279-891e-219515c4ebea tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:16:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-444eed84-2c77-4279-891e-219515c4ebea tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:16:24 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-444eed84-2c77-4279-891e-219515c4ebea tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:16:24 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-444eed84-2c77-4279-891e-219515c4ebea tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:16:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-444eed84-2c77-4279-891e-219515c4ebea tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:16:24 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-444eed84-2c77-4279-891e-219515c4ebea tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:16:24 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-444eed84-2c77-4279-891e-219515c4ebea tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:16:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-444eed84-2c77-4279-891e-219515c4ebea tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-84e1378a-ce89-4874-b6c3-16c35305dbdc 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:24 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-58585180-1b74-4631-b95f-86e719e63705 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fe8ba2a-2b98-4c00-bdba-529abb4aaf61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a98ede4-80e2-4d2a-afae-eb6b6da2ae3b', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:16:24 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-58585180-1b74-4631-b95f-86e719e63705 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64f5938b-936b-40f4-bfb9-250c34b4078a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:16:24 devstack sudo[100382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-84e1378a-ce89-4874-b6c3-16c35305dbdc 1073741824 Jul 10 10:16:24 devstack sudo[100382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:24 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-101d87df-e88e-42e5-abbc-0fcba5bec13e tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:16:24 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-101d87df-e88e-42e5-abbc-0fcba5bec13e tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Flow 'volume_create_manager' (95ef0a88-6805-44f6-bc70-0d49c1211d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:16:24 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-101d87df-e88e-42e5-abbc-0fcba5bec13e tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c341fb0-2650-49ff-9762-083013547a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:16:24 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-58585180-1b74-4631-b95f-86e719e63705 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Volume volume-8a98ede4-80e2-4d2a-afae-eb6b6da2ae3b (8a98ede4-80e2-4d2a-afae-eb6b6da2ae3b): created successfully Jul 10 10:16:24 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-58585180-1b74-4631-b95f-86e719e63705 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64f5938b-936b-40f4-bfb9-250c34b4078a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:16:24 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-58585180-1b74-4631-b95f-86e719e63705 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Flow 'volume_create_manager' (2b245735-80ad-45a3-8d0f-7b67c7f3b690) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:16:24 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-101d87df-e88e-42e5-abbc-0fcba5bec13e tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c341fb0-2650-49ff-9762-083013547a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:16:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-495250932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95492dc8-d21e-43a8-9642-d983b74b235e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34cae259754a42ffbe85d93e7644aa3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:16:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:16:25Z,use_quota=True,user_id='37bc3046fdd44d7eabd61f7df62e149d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:16:24 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-101d87df-e88e-42e5-abbc-0fcba5bec13e tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67bdbc28-a71a-4ccc-8d62-81b87af12898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:16:24 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-101d87df-e88e-42e5-abbc-0fcba5bec13e tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67bdbc28-a71a-4ccc-8d62-81b87af12898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:16:24 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-101d87df-e88e-42e5-abbc-0fcba5bec13e tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a64948c2-bf90-4fd1-bfb5-70461cc40715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:16:24 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-101d87df-e88e-42e5-abbc-0fcba5bec13e tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a64948c2-bf90-4fd1-bfb5-70461cc40715) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95492dc8-d21e-43a8-9642-d983b74b235e', 'volume_name': 'volume-95492dc8-d21e-43a8-9642-d983b74b235e', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:16:24 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-101d87df-e88e-42e5-abbc-0fcba5bec13e tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f264ffe2-0209-48cf-9a62-a792ff200685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:16:24 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-101d87df-e88e-42e5-abbc-0fcba5bec13e tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f264ffe2-0209-48cf-9a62-a792ff200685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:16:24 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-101d87df-e88e-42e5-abbc-0fcba5bec13e tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2a33088-3a2f-4f86-a124-2c815d71d470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:16:24 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-101d87df-e88e-42e5-abbc-0fcba5bec13e tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Volume 95492dc8-d21e-43a8-9642-d983b74b235e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95492dc8-d21e-43a8-9642-d983b74b235e', 'volume_size': 1} Jul 10 10:16:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-101d87df-e88e-42e5-abbc-0fcba5bec13e tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:16:24 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-58585180-1b74-4631-b95f-86e719e63705 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Created volume successfully. Jul 10 10:16:25 devstack sudo[100382]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:25 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-444eed84-2c77-4279-891e-219515c4ebea tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-84e1378a-ce89-4874-b6c3-16c35305dbdc 1073741824" returned: 0 in 1.109s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:25 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-444eed84-2c77-4279-891e-219515c4ebea tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-84e1378a-ce89-4874-b6c3-16c35305dbdc {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:25 devstack sudo[100388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-84e1378a-ce89-4874-b6c3-16c35305dbdc Jul 10 10:16:25 devstack sudo[100388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:26 devstack sudo[100388]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-444eed84-2c77-4279-891e-219515c4ebea tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-84e1378a-ce89-4874-b6c3-16c35305dbdc" returned: 0 in 0.837s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:26 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-444eed84-2c77-4279-891e-219515c4ebea tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] <== create_volume: return (2006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:16:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-444eed84-2c77-4279-891e-219515c4ebea tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.013s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:16:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-c8b60fd9-8058-43ce-80ff-2d9f62935478 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.986s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:16:26 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-c8b60fd9-8058-43ce-80ff-2d9f62935478 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:16:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1108497862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa0fbe3f-b01b-472f-858d-faa81a7b376a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34cae259754a42ffbe85d93e7644aa3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:16:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:16:24Z,use_quota=True,user_id='37bc3046fdd44d7eabd61f7df62e149d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:16:26 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-c8b60fd9-8058-43ce-80ff-2d9f62935478 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Creating volume fa0fbe3f-b01b-472f-858d-faa81a7b376a {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:16:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-c8b60fd9-8058-43ce-80ff-2d9f62935478 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:16:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-c8b60fd9-8058-43ce-80ff-2d9f62935478 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:16:26 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-c8b60fd9-8058-43ce-80ff-2d9f62935478 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:16:26 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-c8b60fd9-8058-43ce-80ff-2d9f62935478 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:16:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-c8b60fd9-8058-43ce-80ff-2d9f62935478 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:16:26 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-c8b60fd9-8058-43ce-80ff-2d9f62935478 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:16:26 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-c8b60fd9-8058-43ce-80ff-2d9f62935478 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:16:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c8b60fd9-8058-43ce-80ff-2d9f62935478 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-fa0fbe3f-b01b-472f-858d-faa81a7b376a 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:26 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-444eed84-2c77-4279-891e-219515c4ebea tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bf9df19-7019-4bf2-9efd-650ae3d4341d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84e1378a-ce89-4874-b6c3-16c35305dbdc', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:16:26 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-444eed84-2c77-4279-891e-219515c4ebea tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38ce0e7e-41db-490d-bb0d-5b67d6a82bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:16:26 devstack sudo[100392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-fa0fbe3f-b01b-472f-858d-faa81a7b376a 1073741824 Jul 10 10:16:26 devstack sudo[100392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:26 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-444eed84-2c77-4279-891e-219515c4ebea tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Volume volume-84e1378a-ce89-4874-b6c3-16c35305dbdc (84e1378a-ce89-4874-b6c3-16c35305dbdc): created successfully Jul 10 10:16:26 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-444eed84-2c77-4279-891e-219515c4ebea tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38ce0e7e-41db-490d-bb0d-5b67d6a82bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:16:26 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-444eed84-2c77-4279-891e-219515c4ebea tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Flow 'volume_create_manager' (56b0678a-2940-4969-a02e-b7048c0c7e97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:16:26 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-444eed84-2c77-4279-891e-219515c4ebea tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Created volume successfully. Jul 10 10:16:27 devstack cinder-volume[87234]: INFO cinder.volume.manager [req-35aef8b8-7c25-423f-bbe1-d91190f1a246 req-c5033ff7-c9df-426c-80d3-ee3346e55e73 tempest-TestShelveInstance-276001208 None] Terminate volume connection completed successfully. Jul 10 10:16:27 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [req-35aef8b8-7c25-423f-bbe1-d91190f1a246 req-c5033ff7-c9df-426c-80d3-ee3346e55e73 tempest-TestShelveInstance-276001208 None] Deleting attachment 1cd849b5-a850-4cc4-acf2-f285986a8026. {{(pid=87234) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 10:16:27 devstack sudo[100392]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c8b60fd9-8058-43ce-80ff-2d9f62935478 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-fa0fbe3f-b01b-472f-858d-faa81a7b376a 1073741824" returned: 0 in 1.110s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c8b60fd9-8058-43ce-80ff-2d9f62935478 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-fa0fbe3f-b01b-472f-858d-faa81a7b376a {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:27 devstack sudo[100399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-fa0fbe3f-b01b-472f-858d-faa81a7b376a Jul 10 10:16:27 devstack sudo[100399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:28 devstack cinder-volume[87234]: DEBUG cinder.coordination [req-35aef8b8-7c25-423f-bbe1-d91190f1a246 req-42247419-f059-48dd-8fcb-839cb55078cc tempest-TestShelveInstance-276001208 None] Acquiring lock "cinder-0475ede2-b806-4549-95bd-25c6bb4298ff-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:16:28 devstack cinder-volume[87234]: DEBUG cinder.coordination [req-35aef8b8-7c25-423f-bbe1-d91190f1a246 req-42247419-f059-48dd-8fcb-839cb55078cc tempest-TestShelveInstance-276001208 None] Lock "cinder-0475ede2-b806-4549-95bd-25c6bb4298ff-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:16:28 devstack cinder-volume[87234]: DEBUG cinder.coordination [req-35aef8b8-7c25-423f-bbe1-d91190f1a246 req-42247419-f059-48dd-8fcb-839cb55078cc tempest-TestShelveInstance-276001208 None] Acquiring lock "cinder-quobyte-0475ede2-b806-4549-95bd-25c6bb4298ff" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:16:28 devstack cinder-volume[87234]: DEBUG cinder.coordination [req-35aef8b8-7c25-423f-bbe1-d91190f1a246 req-42247419-f059-48dd-8fcb-839cb55078cc tempest-TestShelveInstance-276001208 None] Lock "cinder-quobyte-0475ede2-b806-4549-95bd-25c6bb4298ff" acquired by "delete_volume" :: waited 0.026s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:16:28 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f64f4c-71cb-4fd6-bb06-0d738ecf83a7]: (4, 'raw') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:16:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-35aef8b8-7c25-423f-bbe1-d91190f1a246 req-42247419-f059-48dd-8fcb-839cb55078cc tempest-TestShelveInstance-276001208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0475ede2-b806-4549-95bd-25c6bb4298ff {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:28 devstack sudo[100401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0475ede2-b806-4549-95bd-25c6bb4298ff Jul 10 10:16:28 devstack sudo[100401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:28 devstack sudo[100399]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c8b60fd9-8058-43ce-80ff-2d9f62935478 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-fa0fbe3f-b01b-472f-858d-faa81a7b376a" returned: 0 in 0.869s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:28 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-c8b60fd9-8058-43ce-80ff-2d9f62935478 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] <== create_volume: return (2044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:16:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-c8b60fd9-8058-43ce-80ff-2d9f62935478 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.047s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:16:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f1c099ed-545e-4fbb-ad22-9dcd0633a18d tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.402s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:16:28 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f1c099ed-545e-4fbb-ad22-9dcd0633a18d tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:16:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1782656710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4243a04b-ea1b-4b21-a1e7-196aedb2fbba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34cae259754a42ffbe85d93e7644aa3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:16:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:16:24Z,use_quota=True,user_id='37bc3046fdd44d7eabd61f7df62e149d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:16:28 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-f1c099ed-545e-4fbb-ad22-9dcd0633a18d tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Creating volume 4243a04b-ea1b-4b21-a1e7-196aedb2fbba {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:16:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f1c099ed-545e-4fbb-ad22-9dcd0633a18d tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:16:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f1c099ed-545e-4fbb-ad22-9dcd0633a18d tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:16:28 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f1c099ed-545e-4fbb-ad22-9dcd0633a18d tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:16:28 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f1c099ed-545e-4fbb-ad22-9dcd0633a18d tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:16:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f1c099ed-545e-4fbb-ad22-9dcd0633a18d tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:16:28 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f1c099ed-545e-4fbb-ad22-9dcd0633a18d tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:16:28 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-f1c099ed-545e-4fbb-ad22-9dcd0633a18d tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:16:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f1c099ed-545e-4fbb-ad22-9dcd0633a18d tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-4243a04b-ea1b-4b21-a1e7-196aedb2fbba 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:28 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c8b60fd9-8058-43ce-80ff-2d9f62935478 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79ae56fd-3981-4fc5-b83d-58b13d2c42bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa0fbe3f-b01b-472f-858d-faa81a7b376a', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:16:28 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c8b60fd9-8058-43ce-80ff-2d9f62935478 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbc56c73-5e73-43ea-97e0-dab58a726a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:16:28 devstack sudo[100404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-4243a04b-ea1b-4b21-a1e7-196aedb2fbba 1073741824 Jul 10 10:16:28 devstack sudo[100404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:28 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-c8b60fd9-8058-43ce-80ff-2d9f62935478 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Volume volume-fa0fbe3f-b01b-472f-858d-faa81a7b376a (fa0fbe3f-b01b-472f-858d-faa81a7b376a): created successfully Jul 10 10:16:28 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c8b60fd9-8058-43ce-80ff-2d9f62935478 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbc56c73-5e73-43ea-97e0-dab58a726a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:16:28 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c8b60fd9-8058-43ce-80ff-2d9f62935478 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Flow 'volume_create_manager' (9569fc46-3dd8-4c62-a303-1fc3068bcddc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:16:28 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-c8b60fd9-8058-43ce-80ff-2d9f62935478 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Created volume successfully. Jul 10 10:16:29 devstack sudo[100401]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:29 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-35aef8b8-7c25-423f-bbe1-d91190f1a246 req-42247419-f059-48dd-8fcb-839cb55078cc tempest-TestShelveInstance-276001208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0475ede2-b806-4549-95bd-25c6bb4298ff" returned: 0 in 1.322s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:29 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-35aef8b8-7c25-423f-bbe1-d91190f1a246 req-42247419-f059-48dd-8fcb-839cb55078cc tempest-TestShelveInstance-276001208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0475ede2-b806-4549-95bd-25c6bb4298ff {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:29 devstack sudo[100415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0475ede2-b806-4549-95bd-25c6bb4298ff Jul 10 10:16:29 devstack sudo[100415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f1c099ed-545e-4fbb-ad22-9dcd0633a18d tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-4243a04b-ea1b-4b21-a1e7-196aedb2fbba 1073741824" returned: 0 in 1.371s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:30 devstack sudo[100404]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f1c099ed-545e-4fbb-ad22-9dcd0633a18d tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-4243a04b-ea1b-4b21-a1e7-196aedb2fbba {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:30 devstack sudo[100421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-4243a04b-ea1b-4b21-a1e7-196aedb2fbba Jul 10 10:16:30 devstack sudo[100421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:30 devstack sudo[100415]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-35aef8b8-7c25-423f-bbe1-d91190f1a246 req-42247419-f059-48dd-8fcb-839cb55078cc tempest-TestShelveInstance-276001208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0475ede2-b806-4549-95bd-25c6bb4298ff" returned: 1 in 1.090s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-35aef8b8-7c25-423f-bbe1-d91190f1a246 req-42247419-f059-48dd-8fcb-839cb55078cc tempest-TestShelveInstance-276001208 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0475ede2-b806-4549-95bd-25c6bb4298ff' failed. Not Retrying. {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 10:16:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-35aef8b8-7c25-423f-bbe1-d91190f1a246 req-42247419-f059-48dd-8fcb-839cb55078cc tempest-TestShelveInstance-276001208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0475ede2-b806-4549-95bd-25c6bb4298ff {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:30 devstack sudo[100427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0475ede2-b806-4549-95bd-25c6bb4298ff Jul 10 10:16:30 devstack sudo[100427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:31 devstack sudo[100421]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f1c099ed-545e-4fbb-ad22-9dcd0633a18d tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-4243a04b-ea1b-4b21-a1e7-196aedb2fbba" returned: 0 in 1.090s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:31 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f1c099ed-545e-4fbb-ad22-9dcd0633a18d tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] <== create_volume: return (2550ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:16:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f1c099ed-545e-4fbb-ad22-9dcd0633a18d tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.554s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:16:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-101d87df-e88e-42e5-abbc-0fcba5bec13e tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.416s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:16:31 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-101d87df-e88e-42e5-abbc-0fcba5bec13e tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:16:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-495250932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95492dc8-d21e-43a8-9642-d983b74b235e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34cae259754a42ffbe85d93e7644aa3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:16:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:16:25Z,use_quota=True,user_id='37bc3046fdd44d7eabd61f7df62e149d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:16:31 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-101d87df-e88e-42e5-abbc-0fcba5bec13e tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Creating volume 95492dc8-d21e-43a8-9642-d983b74b235e {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:16:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-101d87df-e88e-42e5-abbc-0fcba5bec13e tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:16:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-101d87df-e88e-42e5-abbc-0fcba5bec13e tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:16:31 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-101d87df-e88e-42e5-abbc-0fcba5bec13e tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:16:31 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-101d87df-e88e-42e5-abbc-0fcba5bec13e tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:16:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-101d87df-e88e-42e5-abbc-0fcba5bec13e tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:16:31 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-101d87df-e88e-42e5-abbc-0fcba5bec13e tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:16:31 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-101d87df-e88e-42e5-abbc-0fcba5bec13e tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:16:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-101d87df-e88e-42e5-abbc-0fcba5bec13e tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-95492dc8-d21e-43a8-9642-d983b74b235e 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:31 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f1c099ed-545e-4fbb-ad22-9dcd0633a18d tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1d957cd-b8ec-40b0-9534-2f51ef7c51c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4243a04b-ea1b-4b21-a1e7-196aedb2fbba', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:16:31 devstack sudo[100430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-95492dc8-d21e-43a8-9642-d983b74b235e 1073741824 Jul 10 10:16:31 devstack sudo[100430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:31 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f1c099ed-545e-4fbb-ad22-9dcd0633a18d tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00b16c47-a92e-4368-947c-fc3bf6ebe68e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:16:31 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-f1c099ed-545e-4fbb-ad22-9dcd0633a18d tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Volume volume-4243a04b-ea1b-4b21-a1e7-196aedb2fbba (4243a04b-ea1b-4b21-a1e7-196aedb2fbba): created successfully Jul 10 10:16:31 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f1c099ed-545e-4fbb-ad22-9dcd0633a18d tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00b16c47-a92e-4368-947c-fc3bf6ebe68e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:16:31 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f1c099ed-545e-4fbb-ad22-9dcd0633a18d tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Flow 'volume_create_manager' (62afbcfb-f042-4122-b7bc-2f591daf7086) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:16:31 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-f1c099ed-545e-4fbb-ad22-9dcd0633a18d tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Created volume successfully. Jul 10 10:16:31 devstack sudo[100427]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-35aef8b8-7c25-423f-bbe1-d91190f1a246 req-42247419-f059-48dd-8fcb-839cb55078cc tempest-TestShelveInstance-276001208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0475ede2-b806-4549-95bd-25c6bb4298ff" returned: 0 in 1.062s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:31 devstack cinder-volume[87234]: DEBUG cinder.coordination [req-35aef8b8-7c25-423f-bbe1-d91190f1a246 req-42247419-f059-48dd-8fcb-839cb55078cc tempest-TestShelveInstance-276001208 None] Lock "cinder-quobyte-0475ede2-b806-4549-95bd-25c6bb4298ff" released by "delete_volume" :: held 3.591s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:16:32 devstack cinder-volume[87234]: DEBUG cinder.quota [req-35aef8b8-7c25-423f-bbe1-d91190f1a246 req-42247419-f059-48dd-8fcb-839cb55078cc tempest-TestShelveInstance-276001208 None] Created reservations ['8e7ad4f5-debf-469b-a783-fabfcea3acb8', '408a995a-15f9-47ba-9059-03659ed7b910', '98de4b38-39f1-438c-81ea-193b7f7f59c2', '70547bd8-e08f-4e20-a516-09edb5332891'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:16:32 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-35aef8b8-7c25-423f-bbe1-d91190f1a246 req-42247419-f059-48dd-8fcb-839cb55078cc tempest-TestShelveInstance-276001208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:16:32 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-35aef8b8-7c25-423f-bbe1-d91190f1a246 req-42247419-f059-48dd-8fcb-839cb55078cc tempest-TestShelveInstance-276001208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:16:32 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [req-35aef8b8-7c25-423f-bbe1-d91190f1a246 req-42247419-f059-48dd-8fcb-839cb55078cc tempest-TestShelveInstance-276001208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:16:32 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [req-35aef8b8-7c25-423f-bbe1-d91190f1a246 req-42247419-f059-48dd-8fcb-839cb55078cc tempest-TestShelveInstance-276001208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:16:32 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-35aef8b8-7c25-423f-bbe1-d91190f1a246 req-42247419-f059-48dd-8fcb-839cb55078cc tempest-TestShelveInstance-276001208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:16:32 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-35aef8b8-7c25-423f-bbe1-d91190f1a246 req-42247419-f059-48dd-8fcb-839cb55078cc tempest-TestShelveInstance-276001208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:32 devstack sudo[100433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:16:32 devstack sudo[100433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:32 devstack sudo[100430]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:32 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-101d87df-e88e-42e5-abbc-0fcba5bec13e tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-95492dc8-d21e-43a8-9642-d983b74b235e 1073741824" returned: 0 in 1.567s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-101d87df-e88e-42e5-abbc-0fcba5bec13e tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-95492dc8-d21e-43a8-9642-d983b74b235e {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:33 devstack sudo[100439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-95492dc8-d21e-43a8-9642-d983b74b235e Jul 10 10:16:33 devstack sudo[100439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:33 devstack sudo[100433]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-35aef8b8-7c25-423f-bbe1-d91190f1a246 req-42247419-f059-48dd-8fcb-839cb55078cc tempest-TestShelveInstance-276001208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 1.160s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:33 devstack cinder-volume[87234]: DEBUG cinder.manager [req-35aef8b8-7c25-423f-bbe1-d91190f1a246 req-42247419-f059-48dd-8fcb-839cb55078cc tempest-TestShelveInstance-276001208 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:16:33 devstack cinder-volume[87234]: INFO cinder.volume.manager [req-35aef8b8-7c25-423f-bbe1-d91190f1a246 req-42247419-f059-48dd-8fcb-839cb55078cc tempest-TestShelveInstance-276001208 None] Deleted volume successfully. Jul 10 10:16:33 devstack cinder-volume[87234]: DEBUG cinder.coordination [req-35aef8b8-7c25-423f-bbe1-d91190f1a246 req-42247419-f059-48dd-8fcb-839cb55078cc tempest-TestShelveInstance-276001208 None] Lock "cinder-0475ede2-b806-4549-95bd-25c6bb4298ff-delete_volume" released by "delete_volume" :: held 5.118s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:16:33 devstack sudo[100439]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-101d87df-e88e-42e5-abbc-0fcba5bec13e tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-95492dc8-d21e-43a8-9642-d983b74b235e" returned: 0 in 0.841s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:33 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-101d87df-e88e-42e5-abbc-0fcba5bec13e tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] <== create_volume: return (2483ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:16:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-101d87df-e88e-42e5-abbc-0fcba5bec13e tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.486s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:16:33 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-101d87df-e88e-42e5-abbc-0fcba5bec13e tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2a33088-3a2f-4f86-a124-2c815d71d470) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95492dc8-d21e-43a8-9642-d983b74b235e', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:16:33 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-101d87df-e88e-42e5-abbc-0fcba5bec13e tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da8aa9ec-6630-4dc7-9f4a-1e511d3de65c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:16:33 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-101d87df-e88e-42e5-abbc-0fcba5bec13e tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Volume volume-95492dc8-d21e-43a8-9642-d983b74b235e (95492dc8-d21e-43a8-9642-d983b74b235e): created successfully Jul 10 10:16:33 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-101d87df-e88e-42e5-abbc-0fcba5bec13e tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da8aa9ec-6630-4dc7-9f4a-1e511d3de65c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:16:33 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-101d87df-e88e-42e5-abbc-0fcba5bec13e tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Flow 'volume_create_manager' (95ef0a88-6805-44f6-bc70-0d49c1211d2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:16:33 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-101d87df-e88e-42e5-abbc-0fcba5bec13e tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Created volume successfully. Jul 10 10:16:34 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [req-e462ca2b-79f9-462a-8ca9-98746cf0e5dc req-4b611596-2d61-40a1-bc21-b6b4f813b473 tempest-VolumesSnapshotsTestJSON-1141189464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:16:34 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [req-e462ca2b-79f9-462a-8ca9-98746cf0e5dc req-4b611596-2d61-40a1-bc21-b6b4f813b473 tempest-VolumesSnapshotsTestJSON-1141189464 None] Flow 'volume_create_manager' (2d59cf75-6ad2-4c4a-910c-16d274f7c42b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:16:34 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [req-e462ca2b-79f9-462a-8ca9-98746cf0e5dc req-4b611596-2d61-40a1-bc21-b6b4f813b473 tempest-VolumesSnapshotsTestJSON-1141189464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a459d520-a777-4f91-9c7d-9eef75d3a0e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:16:34 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [req-e462ca2b-79f9-462a-8ca9-98746cf0e5dc req-4b611596-2d61-40a1-bc21-b6b4f813b473 tempest-VolumesSnapshotsTestJSON-1141189464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a459d520-a777-4f91-9c7d-9eef75d3a0e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:16:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1735570270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b48b9cd4-6ee4-480e-b0cd-8d078fe4d025,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b57ae823284a471d93f55f21de0c7c2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:16:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:16:34Z,use_quota=True,user_id='54524ec315124425943529aa3d9c6a18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:16:34 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [req-e462ca2b-79f9-462a-8ca9-98746cf0e5dc req-4b611596-2d61-40a1-bc21-b6b4f813b473 tempest-VolumesSnapshotsTestJSON-1141189464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f1fb3ba-d511-4341-b692-c0564906fd72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:16:34 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [req-e462ca2b-79f9-462a-8ca9-98746cf0e5dc req-4b611596-2d61-40a1-bc21-b6b4f813b473 tempest-VolumesSnapshotsTestJSON-1141189464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f1fb3ba-d511-4341-b692-c0564906fd72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:16:34 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [req-e462ca2b-79f9-462a-8ca9-98746cf0e5dc req-4b611596-2d61-40a1-bc21-b6b4f813b473 tempest-VolumesSnapshotsTestJSON-1141189464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e24695a2-2328-4e34-a9a4-5f7b297cf5a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:16:34 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [req-e462ca2b-79f9-462a-8ca9-98746cf0e5dc req-4b611596-2d61-40a1-bc21-b6b4f813b473 tempest-VolumesSnapshotsTestJSON-1141189464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e24695a2-2328-4e34-a9a4-5f7b297cf5a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b48b9cd4-6ee4-480e-b0cd-8d078fe4d025', 'volume_name': 'volume-b48b9cd4-6ee4-480e-b0cd-8d078fe4d025', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:16:34 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [req-e462ca2b-79f9-462a-8ca9-98746cf0e5dc req-4b611596-2d61-40a1-bc21-b6b4f813b473 tempest-VolumesSnapshotsTestJSON-1141189464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f481e4dc-fdad-47a1-9185-e3519b37a6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:16:34 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [req-e462ca2b-79f9-462a-8ca9-98746cf0e5dc req-4b611596-2d61-40a1-bc21-b6b4f813b473 tempest-VolumesSnapshotsTestJSON-1141189464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f481e4dc-fdad-47a1-9185-e3519b37a6a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:16:34 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [req-e462ca2b-79f9-462a-8ca9-98746cf0e5dc req-4b611596-2d61-40a1-bc21-b6b4f813b473 tempest-VolumesSnapshotsTestJSON-1141189464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd6c5cd1-bc80-48a8-be7a-5462e082c15d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:16:34 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [req-e462ca2b-79f9-462a-8ca9-98746cf0e5dc req-4b611596-2d61-40a1-bc21-b6b4f813b473 tempest-VolumesSnapshotsTestJSON-1141189464 None] Volume b48b9cd4-6ee4-480e-b0cd-8d078fe4d025: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b48b9cd4-6ee4-480e-b0cd-8d078fe4d025', 'volume_size': 1} Jul 10 10:16:34 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-e462ca2b-79f9-462a-8ca9-98746cf0e5dc req-4b611596-2d61-40a1-bc21-b6b4f813b473 tempest-VolumesSnapshotsTestJSON-1141189464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:16:34 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-e462ca2b-79f9-462a-8ca9-98746cf0e5dc req-4b611596-2d61-40a1-bc21-b6b4f813b473 tempest-VolumesSnapshotsTestJSON-1141189464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:16:34 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [req-e462ca2b-79f9-462a-8ca9-98746cf0e5dc req-4b611596-2d61-40a1-bc21-b6b4f813b473 tempest-VolumesSnapshotsTestJSON-1141189464 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:16:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1735570270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b48b9cd4-6ee4-480e-b0cd-8d078fe4d025,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b57ae823284a471d93f55f21de0c7c2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:16:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:16:34Z,use_quota=True,user_id='54524ec315124425943529aa3d9c6a18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:16:34 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [req-e462ca2b-79f9-462a-8ca9-98746cf0e5dc req-4b611596-2d61-40a1-bc21-b6b4f813b473 tempest-VolumesSnapshotsTestJSON-1141189464 None] Creating volume b48b9cd4-6ee4-480e-b0cd-8d078fe4d025 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:16:34 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-e462ca2b-79f9-462a-8ca9-98746cf0e5dc req-4b611596-2d61-40a1-bc21-b6b4f813b473 tempest-VolumesSnapshotsTestJSON-1141189464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:16:34 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-e462ca2b-79f9-462a-8ca9-98746cf0e5dc req-4b611596-2d61-40a1-bc21-b6b4f813b473 tempest-VolumesSnapshotsTestJSON-1141189464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:16:34 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [req-e462ca2b-79f9-462a-8ca9-98746cf0e5dc req-4b611596-2d61-40a1-bc21-b6b4f813b473 tempest-VolumesSnapshotsTestJSON-1141189464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:16:34 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [req-e462ca2b-79f9-462a-8ca9-98746cf0e5dc req-4b611596-2d61-40a1-bc21-b6b4f813b473 tempest-VolumesSnapshotsTestJSON-1141189464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:16:34 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-e462ca2b-79f9-462a-8ca9-98746cf0e5dc req-4b611596-2d61-40a1-bc21-b6b4f813b473 tempest-VolumesSnapshotsTestJSON-1141189464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:16:34 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [req-e462ca2b-79f9-462a-8ca9-98746cf0e5dc req-4b611596-2d61-40a1-bc21-b6b4f813b473 tempest-VolumesSnapshotsTestJSON-1141189464 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:16:34 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [req-e462ca2b-79f9-462a-8ca9-98746cf0e5dc req-4b611596-2d61-40a1-bc21-b6b4f813b473 tempest-VolumesSnapshotsTestJSON-1141189464 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:16:34 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-e462ca2b-79f9-462a-8ca9-98746cf0e5dc req-4b611596-2d61-40a1-bc21-b6b4f813b473 tempest-VolumesSnapshotsTestJSON-1141189464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b48b9cd4-6ee4-480e-b0cd-8d078fe4d025 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:34 devstack sudo[100443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b48b9cd4-6ee4-480e-b0cd-8d078fe4d025 1073741824 Jul 10 10:16:34 devstack sudo[100443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:34 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f115d664-85a7-42ad-8ddc-3495eb6136dd tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Acquiring lock "cinder-95492dc8-d21e-43a8-9642-d983b74b235e-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:16:35 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f115d664-85a7-42ad-8ddc-3495eb6136dd tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Lock "cinder-95492dc8-d21e-43a8-9642-d983b74b235e-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:16:35 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f115d664-85a7-42ad-8ddc-3495eb6136dd tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Acquiring lock "cinder-quobyte-95492dc8-d21e-43a8-9642-d983b74b235e" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:16:35 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f115d664-85a7-42ad-8ddc-3495eb6136dd tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Lock "cinder-quobyte-95492dc8-d21e-43a8-9642-d983b74b235e" acquired by "delete_volume" :: waited 0.021s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:16:35 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa61fcff-10ca-4cd1-bb3a-4ccbf509384f]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:16:35 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f115d664-85a7-42ad-8ddc-3495eb6136dd tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-95492dc8-d21e-43a8-9642-d983b74b235e {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:35 devstack sudo[100449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-95492dc8-d21e-43a8-9642-d983b74b235e Jul 10 10:16:35 devstack sudo[100449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:35 devstack sudo[100443]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:35 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-e462ca2b-79f9-462a-8ca9-98746cf0e5dc req-4b611596-2d61-40a1-bc21-b6b4f813b473 tempest-VolumesSnapshotsTestJSON-1141189464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b48b9cd4-6ee4-480e-b0cd-8d078fe4d025 1073741824" returned: 0 in 1.112s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:35 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-e462ca2b-79f9-462a-8ca9-98746cf0e5dc req-4b611596-2d61-40a1-bc21-b6b4f813b473 tempest-VolumesSnapshotsTestJSON-1141189464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b48b9cd4-6ee4-480e-b0cd-8d078fe4d025 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:35 devstack sudo[100452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b48b9cd4-6ee4-480e-b0cd-8d078fe4d025 Jul 10 10:16:35 devstack sudo[100452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:36 devstack sudo[100449]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:36 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f115d664-85a7-42ad-8ddc-3495eb6136dd tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-95492dc8-d21e-43a8-9642-d983b74b235e" returned: 0 in 1.085s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:36 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f115d664-85a7-42ad-8ddc-3495eb6136dd tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-95492dc8-d21e-43a8-9642-d983b74b235e {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:36 devstack sudo[100457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-95492dc8-d21e-43a8-9642-d983b74b235e Jul 10 10:16:36 devstack sudo[100457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:36 devstack sudo[100452]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:36 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-e462ca2b-79f9-462a-8ca9-98746cf0e5dc req-4b611596-2d61-40a1-bc21-b6b4f813b473 tempest-VolumesSnapshotsTestJSON-1141189464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b48b9cd4-6ee4-480e-b0cd-8d078fe4d025" returned: 0 in 0.880s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:36 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [req-e462ca2b-79f9-462a-8ca9-98746cf0e5dc req-4b611596-2d61-40a1-bc21-b6b4f813b473 tempest-VolumesSnapshotsTestJSON-1141189464 None] <== create_volume: return (2059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:16:36 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-e462ca2b-79f9-462a-8ca9-98746cf0e5dc req-4b611596-2d61-40a1-bc21-b6b4f813b473 tempest-VolumesSnapshotsTestJSON-1141189464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.066s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:16:36 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [req-e462ca2b-79f9-462a-8ca9-98746cf0e5dc req-4b611596-2d61-40a1-bc21-b6b4f813b473 tempest-VolumesSnapshotsTestJSON-1141189464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd6c5cd1-bc80-48a8-be7a-5462e082c15d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b48b9cd4-6ee4-480e-b0cd-8d078fe4d025', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:16:36 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [req-e462ca2b-79f9-462a-8ca9-98746cf0e5dc req-4b611596-2d61-40a1-bc21-b6b4f813b473 tempest-VolumesSnapshotsTestJSON-1141189464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06d4a033-dbd6-4b5e-b5cc-500c4c68d814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:16:36 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [req-e462ca2b-79f9-462a-8ca9-98746cf0e5dc req-4b611596-2d61-40a1-bc21-b6b4f813b473 tempest-VolumesSnapshotsTestJSON-1141189464 None] Volume volume-b48b9cd4-6ee4-480e-b0cd-8d078fe4d025 (b48b9cd4-6ee4-480e-b0cd-8d078fe4d025): created successfully Jul 10 10:16:36 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [req-e462ca2b-79f9-462a-8ca9-98746cf0e5dc req-4b611596-2d61-40a1-bc21-b6b4f813b473 tempest-VolumesSnapshotsTestJSON-1141189464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06d4a033-dbd6-4b5e-b5cc-500c4c68d814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:16:36 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [req-e462ca2b-79f9-462a-8ca9-98746cf0e5dc req-4b611596-2d61-40a1-bc21-b6b4f813b473 tempest-VolumesSnapshotsTestJSON-1141189464 None] Flow 'volume_create_manager' (2d59cf75-6ad2-4c4a-910c-16d274f7c42b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:16:36 devstack cinder-volume[87234]: INFO cinder.volume.manager [req-e462ca2b-79f9-462a-8ca9-98746cf0e5dc req-4b611596-2d61-40a1-bc21-b6b4f813b473 tempest-VolumesSnapshotsTestJSON-1141189464 None] Created volume successfully. Jul 10 10:16:37 devstack sudo[100457]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:37 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f115d664-85a7-42ad-8ddc-3495eb6136dd tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-95492dc8-d21e-43a8-9642-d983b74b235e" returned: 0 in 0.864s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:37 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f115d664-85a7-42ad-8ddc-3495eb6136dd tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Lock "cinder-quobyte-95492dc8-d21e-43a8-9642-d983b74b235e" released by "delete_volume" :: held 2.006s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:16:37 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-f115d664-85a7-42ad-8ddc-3495eb6136dd tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Created reservations ['4e5f5a34-708c-4d76-b9d9-07a908effecb', '9faa8b4c-7a03-4df4-bae5-2891297b71b9', '9714f9a4-3fe6-4d85-88f4-00d652d9a22f', 'c346814f-bab9-42da-813c-2ab3347bb3d1'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:16:37 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f115d664-85a7-42ad-8ddc-3495eb6136dd tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:16:37 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f115d664-85a7-42ad-8ddc-3495eb6136dd tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:16:37 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f115d664-85a7-42ad-8ddc-3495eb6136dd tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:16:37 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f115d664-85a7-42ad-8ddc-3495eb6136dd tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:16:37 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f115d664-85a7-42ad-8ddc-3495eb6136dd tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:16:37 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f115d664-85a7-42ad-8ddc-3495eb6136dd tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:37 devstack sudo[100462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:16:37 devstack sudo[100462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:38 devstack sudo[100462]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f115d664-85a7-42ad-8ddc-3495eb6136dd tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.882s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:38 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-f115d664-85a7-42ad-8ddc-3495eb6136dd tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:16:38 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-f115d664-85a7-42ad-8ddc-3495eb6136dd tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Deleted volume successfully. Jul 10 10:16:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-ebea616b-c2a6-4396-bacf-9b30aa67d669 req-7f0034e1-8bfb-4cd9-81d4-39cb65ab5124 tempest-VolumesSnapshotsTestJSON-1141189464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:16:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-ebea616b-c2a6-4396-bacf-9b30aa67d669 req-7f0034e1-8bfb-4cd9-81d4-39cb65ab5124 tempest-VolumesSnapshotsTestJSON-1141189464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:16:38 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [req-ebea616b-c2a6-4396-bacf-9b30aa67d669 req-7f0034e1-8bfb-4cd9-81d4-39cb65ab5124 tempest-VolumesSnapshotsTestJSON-1141189464 None] Creating offline snapshot 7c304aca-0d22-48be-a46b-cd47e4107283 of volume b48b9cd4-6ee4-480e-b0cd-8d078fe4d025 {{(pid=87234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 10:16:38 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f115d664-85a7-42ad-8ddc-3495eb6136dd tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Lock "cinder-95492dc8-d21e-43a8-9642-d983b74b235e-delete_volume" released by "delete_volume" :: held 3.260s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:16:38 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d85e2f9-dc07-43e8-aacb-6d62eee85e7c]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:16:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-ebea616b-c2a6-4396-bacf-9b30aa67d669 req-7f0034e1-8bfb-4cd9-81d4-39cb65ab5124 tempest-VolumesSnapshotsTestJSON-1141189464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b48b9cd4-6ee4-480e-b0cd-8d078fe4d025 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:38 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-4083b6c2-e5be-4f74-870d-1a3e470b53cc tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Acquiring lock "cinder-4243a04b-ea1b-4b21-a1e7-196aedb2fbba-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:16:38 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-4083b6c2-e5be-4f74-870d-1a3e470b53cc tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Lock "cinder-4243a04b-ea1b-4b21-a1e7-196aedb2fbba-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:16:38 devstack sudo[100465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b48b9cd4-6ee4-480e-b0cd-8d078fe4d025 Jul 10 10:16:38 devstack sudo[100465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:38 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-4083b6c2-e5be-4f74-870d-1a3e470b53cc tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Acquiring lock "cinder-quobyte-4243a04b-ea1b-4b21-a1e7-196aedb2fbba" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:16:38 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-4083b6c2-e5be-4f74-870d-1a3e470b53cc tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Lock "cinder-quobyte-4243a04b-ea1b-4b21-a1e7-196aedb2fbba" acquired by "delete_volume" :: waited 0.016s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:16:38 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[9971a0fb-9aaa-42dc-a312-8feee7041a98]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:16:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4083b6c2-e5be-4f74-870d-1a3e470b53cc tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-4243a04b-ea1b-4b21-a1e7-196aedb2fbba {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:38 devstack sudo[100467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-4243a04b-ea1b-4b21-a1e7-196aedb2fbba Jul 10 10:16:38 devstack sudo[100467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:39 devstack sudo[100465]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:39 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-ebea616b-c2a6-4396-bacf-9b30aa67d669 req-7f0034e1-8bfb-4cd9-81d4-39cb65ab5124 tempest-VolumesSnapshotsTestJSON-1141189464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b48b9cd4-6ee4-480e-b0cd-8d078fe4d025" returned: 0 in 1.024s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:39 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-ebea616b-c2a6-4396-bacf-9b30aa67d669 req-7f0034e1-8bfb-4cd9-81d4-39cb65ab5124 tempest-VolumesSnapshotsTestJSON-1141189464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b48b9cd4-6ee4-480e-b0cd-8d078fe4d025,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b48b9cd4-6ee4-480e-b0cd-8d078fe4d025.7c304aca-0d22-48be-a46b-cd47e4107283 1G {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:39 devstack sudo[100473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b48b9cd4-6ee4-480e-b0cd-8d078fe4d025,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b48b9cd4-6ee4-480e-b0cd-8d078fe4d025.7c304aca-0d22-48be-a46b-cd47e4107283 1G Jul 10 10:16:39 devstack sudo[100473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:39 devstack sudo[100467]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:39 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4083b6c2-e5be-4f74-870d-1a3e470b53cc tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-4243a04b-ea1b-4b21-a1e7-196aedb2fbba" returned: 0 in 1.193s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:39 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4083b6c2-e5be-4f74-870d-1a3e470b53cc tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-4243a04b-ea1b-4b21-a1e7-196aedb2fbba {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:39 devstack sudo[100479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-4243a04b-ea1b-4b21-a1e7-196aedb2fbba Jul 10 10:16:39 devstack sudo[100479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:40 devstack sudo[100473]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-ebea616b-c2a6-4396-bacf-9b30aa67d669 req-7f0034e1-8bfb-4cd9-81d4-39cb65ab5124 tempest-VolumesSnapshotsTestJSON-1141189464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b48b9cd4-6ee4-480e-b0cd-8d078fe4d025,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b48b9cd4-6ee4-480e-b0cd-8d078fe4d025.7c304aca-0d22-48be-a46b-cd47e4107283 1G" returned: 0 in 1.094s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-ebea616b-c2a6-4396-bacf-9b30aa67d669 req-7f0034e1-8bfb-4cd9-81d4-39cb65ab5124 tempest-VolumesSnapshotsTestJSON-1141189464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b48b9cd4-6ee4-480e-b0cd-8d078fe4d025 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b48b9cd4-6ee4-480e-b0cd-8d078fe4d025.7c304aca-0d22-48be-a46b-cd47e4107283 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:40 devstack sudo[100485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b48b9cd4-6ee4-480e-b0cd-8d078fe4d025 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b48b9cd4-6ee4-480e-b0cd-8d078fe4d025.7c304aca-0d22-48be-a46b-cd47e4107283 Jul 10 10:16:40 devstack sudo[100485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:40 devstack sudo[100479]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4083b6c2-e5be-4f74-870d-1a3e470b53cc tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-4243a04b-ea1b-4b21-a1e7-196aedb2fbba" returned: 0 in 0.786s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:40 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-4083b6c2-e5be-4f74-870d-1a3e470b53cc tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Lock "cinder-quobyte-4243a04b-ea1b-4b21-a1e7-196aedb2fbba" released by "delete_volume" :: held 2.060s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:16:40 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-4083b6c2-e5be-4f74-870d-1a3e470b53cc tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Created reservations ['f13a0773-d480-43f3-8968-862d57db0896', 'b8eaedef-7954-42e2-9b7f-93e132062faf', '1f41dbcf-3440-449f-a224-eab3ac4f9be4', 'dee7ed3b-b0ed-4dca-b624-0759876bea67'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:16:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-4083b6c2-e5be-4f74-870d-1a3e470b53cc tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:16:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-4083b6c2-e5be-4f74-870d-1a3e470b53cc tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:16:40 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-4083b6c2-e5be-4f74-870d-1a3e470b53cc tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:16:40 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-4083b6c2-e5be-4f74-870d-1a3e470b53cc tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:16:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-4083b6c2-e5be-4f74-870d-1a3e470b53cc tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:16:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4083b6c2-e5be-4f74-870d-1a3e470b53cc tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:40 devstack sudo[100488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:16:40 devstack sudo[100488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:41 devstack sudo[100485]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-ebea616b-c2a6-4396-bacf-9b30aa67d669 req-7f0034e1-8bfb-4cd9-81d4-39cb65ab5124 tempest-VolumesSnapshotsTestJSON-1141189464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b48b9cd4-6ee4-480e-b0cd-8d078fe4d025 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b48b9cd4-6ee4-480e-b0cd-8d078fe4d025.7c304aca-0d22-48be-a46b-cd47e4107283" returned: 0 in 0.925s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:41 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [req-ebea616b-c2a6-4396-bacf-9b30aa67d669 req-7f0034e1-8bfb-4cd9-81d4-39cb65ab5124 tempest-VolumesSnapshotsTestJSON-1141189464 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b48b9cd4-6ee4-480e-b0cd-8d078fe4d025.7c304aca-0d22-48be-a46b-cd47e4107283 is being set with open permissions: ugo+rw Jul 10 10:16:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-ebea616b-c2a6-4396-bacf-9b30aa67d669 req-7f0034e1-8bfb-4cd9-81d4-39cb65ab5124 tempest-VolumesSnapshotsTestJSON-1141189464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b48b9cd4-6ee4-480e-b0cd-8d078fe4d025.7c304aca-0d22-48be-a46b-cd47e4107283 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:41 devstack sudo[100495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b48b9cd4-6ee4-480e-b0cd-8d078fe4d025.7c304aca-0d22-48be-a46b-cd47e4107283 Jul 10 10:16:41 devstack sudo[100495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:41 devstack sudo[100488]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4083b6c2-e5be-4f74-870d-1a3e470b53cc tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.834s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:41 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-4083b6c2-e5be-4f74-870d-1a3e470b53cc tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:16:41 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-4083b6c2-e5be-4f74-870d-1a3e470b53cc tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Deleted volume successfully. Jul 10 10:16:41 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-4083b6c2-e5be-4f74-870d-1a3e470b53cc tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Lock "cinder-4243a04b-ea1b-4b21-a1e7-196aedb2fbba-delete_volume" released by "delete_volume" :: held 3.254s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:16:41 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-0842ff8c-781e-45da-b636-e3dada1b6f3e tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Acquiring lock "cinder-fa0fbe3f-b01b-472f-858d-faa81a7b376a-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:16:41 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-0842ff8c-781e-45da-b636-e3dada1b6f3e tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Lock "cinder-fa0fbe3f-b01b-472f-858d-faa81a7b376a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:16:41 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-0842ff8c-781e-45da-b636-e3dada1b6f3e tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Acquiring lock "cinder-quobyte-fa0fbe3f-b01b-472f-858d-faa81a7b376a" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:16:41 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-0842ff8c-781e-45da-b636-e3dada1b6f3e tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Lock "cinder-quobyte-fa0fbe3f-b01b-472f-858d-faa81a7b376a" acquired by "delete_volume" :: waited 0.027s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:16:42 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[84bfb4a3-44f9-49e2-900a-7390165829ce]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:16:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0842ff8c-781e-45da-b636-e3dada1b6f3e tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-fa0fbe3f-b01b-472f-858d-faa81a7b376a {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:42 devstack cinder-volume[87234]: DEBUG oslo_service.periodic_task [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 10:16:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:16:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:16:42 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:16:42 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:16:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:16:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:42 devstack sudo[100500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:16:42 devstack sudo[100500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:42 devstack sudo[100499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-fa0fbe3f-b01b-472f-858d-faa81a7b376a Jul 10 10:16:42 devstack sudo[100499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:42 devstack sudo[100495]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-ebea616b-c2a6-4396-bacf-9b30aa67d669 req-7f0034e1-8bfb-4cd9-81d4-39cb65ab5124 tempest-VolumesSnapshotsTestJSON-1141189464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b48b9cd4-6ee4-480e-b0cd-8d078fe4d025.7c304aca-0d22-48be-a46b-cd47e4107283" returned: 0 in 0.870s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-ebea616b-c2a6-4396-bacf-9b30aa67d669 req-7f0034e1-8bfb-4cd9-81d4-39cb65ab5124 tempest-VolumesSnapshotsTestJSON-1141189464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b48b9cd4-6ee4-480e-b0cd-8d078fe4d025.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:42 devstack sudo[100503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b48b9cd4-6ee4-480e-b0cd-8d078fe4d025.info Jul 10 10:16:42 devstack sudo[100503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:43 devstack sudo[100499]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0842ff8c-781e-45da-b636-e3dada1b6f3e tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-fa0fbe3f-b01b-472f-858d-faa81a7b376a" returned: 0 in 1.041s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0842ff8c-781e-45da-b636-e3dada1b6f3e tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-fa0fbe3f-b01b-472f-858d-faa81a7b376a {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:43 devstack sudo[100509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-fa0fbe3f-b01b-472f-858d-faa81a7b376a Jul 10 10:16:43 devstack sudo[100509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:43 devstack sudo[100503]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-ebea616b-c2a6-4396-bacf-9b30aa67d669 req-7f0034e1-8bfb-4cd9-81d4-39cb65ab5124 tempest-VolumesSnapshotsTestJSON-1141189464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b48b9cd4-6ee4-480e-b0cd-8d078fe4d025.info" returned: 0 in 1.039s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:43 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [req-ebea616b-c2a6-4396-bacf-9b30aa67d669 req-7f0034e1-8bfb-4cd9-81d4-39cb65ab5124 tempest-VolumesSnapshotsTestJSON-1141189464 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b48b9cd4-6ee4-480e-b0cd-8d078fe4d025.info is being set with open permissions: ugo+rw Jul 10 10:16:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-ebea616b-c2a6-4396-bacf-9b30aa67d669 req-7f0034e1-8bfb-4cd9-81d4-39cb65ab5124 tempest-VolumesSnapshotsTestJSON-1141189464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b48b9cd4-6ee4-480e-b0cd-8d078fe4d025.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:43 devstack sudo[100500]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 1.248s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:43 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:16:43 devstack cinder-volume[87234]: DEBUG oslo_service.periodic_task [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Running periodic task VolumeManager._thread_info {{(pid=87234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 10:16:43 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] thread count: 28 {{(pid=87234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 10:16:43 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] thread info: [<_MainThread(MainThread, started 131600773742720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 10:16:43 devstack sudo[100515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b48b9cd4-6ee4-480e-b0cd-8d078fe4d025.info Jul 10 10:16:43 devstack sudo[100515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:43 devstack sudo[100509]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0842ff8c-781e-45da-b636-e3dada1b6f3e tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-fa0fbe3f-b01b-472f-858d-faa81a7b376a" returned: 0 in 0.849s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:43 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-0842ff8c-781e-45da-b636-e3dada1b6f3e tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Lock "cinder-quobyte-fa0fbe3f-b01b-472f-858d-faa81a7b376a" released by "delete_volume" :: held 1.955s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:16:44 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-0842ff8c-781e-45da-b636-e3dada1b6f3e tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Created reservations ['0d442c8e-06ae-4476-940d-afccf536862a', '72353f40-ce06-41eb-8504-daefc239cf1a', '8c50839c-d1f2-41d9-93cb-384ad48e04e2', 'debd1a5b-6a37-4355-b137-c940c9f41bd3'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:16:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-0842ff8c-781e-45da-b636-e3dada1b6f3e tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:16:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-0842ff8c-781e-45da-b636-e3dada1b6f3e tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:16:44 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-0842ff8c-781e-45da-b636-e3dada1b6f3e tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:16:44 devstack sudo[100515]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:44 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-0842ff8c-781e-45da-b636-e3dada1b6f3e tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:16:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-0842ff8c-781e-45da-b636-e3dada1b6f3e tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:16:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0842ff8c-781e-45da-b636-e3dada1b6f3e tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-ebea616b-c2a6-4396-bacf-9b30aa67d669 req-7f0034e1-8bfb-4cd9-81d4-39cb65ab5124 tempest-VolumesSnapshotsTestJSON-1141189464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b48b9cd4-6ee4-480e-b0cd-8d078fe4d025.info" returned: 0 in 0.821s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:44 devstack sudo[100520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:16:44 devstack sudo[100520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-ebea616b-c2a6-4396-bacf-9b30aa67d669 req-7f0034e1-8bfb-4cd9-81d4-39cb65ab5124 tempest-VolumesSnapshotsTestJSON-1141189464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.984s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:16:44 devstack cinder-volume[87234]: INFO cinder.volume.manager [req-ebea616b-c2a6-4396-bacf-9b30aa67d669 req-7f0034e1-8bfb-4cd9-81d4-39cb65ab5124 tempest-VolumesSnapshotsTestJSON-1141189464 None] Create snapshot completed successfully Jul 10 10:16:44 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-2ea94edd-62fc-4569-8069-66ef58f3e173 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Acquiring lock "cinder-84e1378a-ce89-4874-b6c3-16c35305dbdc-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:16:44 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-2ea94edd-62fc-4569-8069-66ef58f3e173 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Lock "cinder-84e1378a-ce89-4874-b6c3-16c35305dbdc-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:16:44 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-2ea94edd-62fc-4569-8069-66ef58f3e173 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Acquiring lock "cinder-quobyte-84e1378a-ce89-4874-b6c3-16c35305dbdc" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:16:44 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-2ea94edd-62fc-4569-8069-66ef58f3e173 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Lock "cinder-quobyte-84e1378a-ce89-4874-b6c3-16c35305dbdc" acquired by "delete_volume" :: waited 0.017s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:16:44 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[892f5a04-89a8-45b7-ae7e-732c0b186d42]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:16:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-2ea94edd-62fc-4569-8069-66ef58f3e173 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-84e1378a-ce89-4874-b6c3-16c35305dbdc {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:44 devstack sudo[100522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-84e1378a-ce89-4874-b6c3-16c35305dbdc Jul 10 10:16:44 devstack sudo[100522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:44 devstack sudo[100520]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0842ff8c-781e-45da-b636-e3dada1b6f3e tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.818s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:44 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-0842ff8c-781e-45da-b636-e3dada1b6f3e tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:16:44 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-0842ff8c-781e-45da-b636-e3dada1b6f3e tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Deleted volume successfully. Jul 10 10:16:45 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-0842ff8c-781e-45da-b636-e3dada1b6f3e tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Lock "cinder-fa0fbe3f-b01b-472f-858d-faa81a7b376a-delete_volume" released by "delete_volume" :: held 3.109s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:16:45 devstack cinder-volume[87234]: DEBUG cinder.coordination [req-0a9faa63-36fc-4380-bcae-bcf50ede488e req-6b3823d1-1670-4a57-b3d1-f786521500d1 tempest-VolumesSnapshotsTestJSON-1141189464 None] Acquiring lock "cinder-7c304aca-0d22-48be-a46b-cd47e4107283-delete_snapshot" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:16:45 devstack cinder-volume[87234]: DEBUG cinder.coordination [req-0a9faa63-36fc-4380-bcae-bcf50ede488e req-6b3823d1-1670-4a57-b3d1-f786521500d1 tempest-VolumesSnapshotsTestJSON-1141189464 None] Lock "cinder-7c304aca-0d22-48be-a46b-cd47e4107283-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:16:45 devstack cinder-volume[87234]: DEBUG cinder.coordination [req-0a9faa63-36fc-4380-bcae-bcf50ede488e req-6b3823d1-1670-4a57-b3d1-f786521500d1 tempest-VolumesSnapshotsTestJSON-1141189464 None] Acquiring lock "cinder-quobyte-b48b9cd4-6ee4-480e-b0cd-8d078fe4d025" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:16:45 devstack cinder-volume[87234]: DEBUG cinder.coordination [req-0a9faa63-36fc-4380-bcae-bcf50ede488e req-6b3823d1-1670-4a57-b3d1-f786521500d1 tempest-VolumesSnapshotsTestJSON-1141189464 None] Lock "cinder-quobyte-b48b9cd4-6ee4-480e-b0cd-8d078fe4d025" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:16:45 devstack cinder-volume[87234]: DEBUG cinder.coordination [req-0a9faa63-36fc-4380-bcae-bcf50ede488e req-6b3823d1-1670-4a57-b3d1-f786521500d1 tempest-VolumesSnapshotsTestJSON-1141189464 None] Acquiring lock "cinder-quobyte-7c304aca-0d22-48be-a46b-cd47e4107283" by "_delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:16:45 devstack cinder-volume[87234]: DEBUG cinder.coordination [req-0a9faa63-36fc-4380-bcae-bcf50ede488e req-6b3823d1-1670-4a57-b3d1-f786521500d1 tempest-VolumesSnapshotsTestJSON-1141189464 None] Lock "cinder-quobyte-7c304aca-0d22-48be-a46b-cd47e4107283" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:16:45 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [req-0a9faa63-36fc-4380-bcae-bcf50ede488e req-6b3823d1-1670-4a57-b3d1-f786521500d1 tempest-VolumesSnapshotsTestJSON-1141189464 None] Deleting offline snapshot 7c304aca-0d22-48be-a46b-cd47e4107283 of volume b48b9cd4-6ee4-480e-b0cd-8d078fe4d025 {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 10:16:45 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [req-0a9faa63-36fc-4380-bcae-bcf50ede488e req-6b3823d1-1670-4a57-b3d1-f786521500d1 tempest-VolumesSnapshotsTestJSON-1141189464 None] snapshot_file for this snap is: volume-b48b9cd4-6ee4-480e-b0cd-8d078fe4d025.7c304aca-0d22-48be-a46b-cd47e4107283 {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 10:16:45 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[212dbdc8-e3bc-46d4-86c7-61a8a6ed8d38]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:16:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-0a9faa63-36fc-4380-bcae-bcf50ede488e req-6b3823d1-1670-4a57-b3d1-f786521500d1 tempest-VolumesSnapshotsTestJSON-1141189464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b48b9cd4-6ee4-480e-b0cd-8d078fe4d025.7c304aca-0d22-48be-a46b-cd47e4107283 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:45 devstack sudo[100522]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-2ea94edd-62fc-4569-8069-66ef58f3e173 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-84e1378a-ce89-4874-b6c3-16c35305dbdc" returned: 0 in 0.951s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-2ea94edd-62fc-4569-8069-66ef58f3e173 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-84e1378a-ce89-4874-b6c3-16c35305dbdc {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:45 devstack sudo[100530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b48b9cd4-6ee4-480e-b0cd-8d078fe4d025.7c304aca-0d22-48be-a46b-cd47e4107283 Jul 10 10:16:45 devstack sudo[100530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:45 devstack sudo[100531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-84e1378a-ce89-4874-b6c3-16c35305dbdc Jul 10 10:16:45 devstack sudo[100531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:46 devstack sudo[100530]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-0a9faa63-36fc-4380-bcae-bcf50ede488e req-6b3823d1-1670-4a57-b3d1-f786521500d1 tempest-VolumesSnapshotsTestJSON-1141189464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b48b9cd4-6ee4-480e-b0cd-8d078fe4d025.7c304aca-0d22-48be-a46b-cd47e4107283" returned: 0 in 0.845s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:46 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [req-0a9faa63-36fc-4380-bcae-bcf50ede488e req-6b3823d1-1670-4a57-b3d1-f786521500d1 tempest-VolumesSnapshotsTestJSON-1141189464 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b48b9cd4-6ee4-480e-b0cd-8d078fe4d025(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 10:16:46 devstack sudo[100531]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-2ea94edd-62fc-4569-8069-66ef58f3e173 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-84e1378a-ce89-4874-b6c3-16c35305dbdc" returned: 0 in 0.757s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:46 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba39f5f5-bcb5-4bff-b7a4-93246218c8be]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:16:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-0a9faa63-36fc-4380-bcae-bcf50ede488e req-6b3823d1-1670-4a57-b3d1-f786521500d1 tempest-VolumesSnapshotsTestJSON-1141189464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b48b9cd4-6ee4-480e-b0cd-8d078fe4d025 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:46 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-2ea94edd-62fc-4569-8069-66ef58f3e173 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Lock "cinder-quobyte-84e1378a-ce89-4874-b6c3-16c35305dbdc" released by "delete_volume" :: held 1.774s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:16:46 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-2ea94edd-62fc-4569-8069-66ef58f3e173 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Created reservations ['8713405e-0a28-47bc-b9df-694db19c4b5a', '191d4bf2-5d9c-43ae-8ff3-5d69804bbf88', '96ad25f3-8209-48b2-ab45-fa1fc2f62c05', '9e8ef889-19d0-4f25-98da-be176125e6ab'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:16:46 devstack sudo[100538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b48b9cd4-6ee4-480e-b0cd-8d078fe4d025 Jul 10 10:16:46 devstack sudo[100538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-2ea94edd-62fc-4569-8069-66ef58f3e173 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:16:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-2ea94edd-62fc-4569-8069-66ef58f3e173 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:16:46 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-2ea94edd-62fc-4569-8069-66ef58f3e173 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:16:46 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-2ea94edd-62fc-4569-8069-66ef58f3e173 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:16:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-2ea94edd-62fc-4569-8069-66ef58f3e173 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:16:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-2ea94edd-62fc-4569-8069-66ef58f3e173 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:46 devstack sudo[100540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:16:46 devstack sudo[100540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:46 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-2c9cd637-195e-4626-bfe9-2f67d368146d tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Acquiring lock "cinder-8a98ede4-80e2-4d2a-afae-eb6b6da2ae3b-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:16:46 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-2c9cd637-195e-4626-bfe9-2f67d368146d tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Lock "cinder-8a98ede4-80e2-4d2a-afae-eb6b6da2ae3b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:16:46 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-2c9cd637-195e-4626-bfe9-2f67d368146d tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Acquiring lock "cinder-quobyte-8a98ede4-80e2-4d2a-afae-eb6b6da2ae3b" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:16:46 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-2c9cd637-195e-4626-bfe9-2f67d368146d tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Lock "cinder-quobyte-8a98ede4-80e2-4d2a-afae-eb6b6da2ae3b" acquired by "delete_volume" :: waited 0.020s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:16:46 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2570a5c-0b3d-4305-b3a7-a738b47e3168]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:16:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-2c9cd637-195e-4626-bfe9-2f67d368146d tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8a98ede4-80e2-4d2a-afae-eb6b6da2ae3b {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:46 devstack sudo[100542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8a98ede4-80e2-4d2a-afae-eb6b6da2ae3b Jul 10 10:16:46 devstack sudo[100542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:47 devstack sudo[100538]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-0a9faa63-36fc-4380-bcae-bcf50ede488e req-6b3823d1-1670-4a57-b3d1-f786521500d1 tempest-VolumesSnapshotsTestJSON-1141189464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b48b9cd4-6ee4-480e-b0cd-8d078fe4d025" returned: 0 in 1.008s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-0a9faa63-36fc-4380-bcae-bcf50ede488e req-6b3823d1-1670-4a57-b3d1-f786521500d1 tempest-VolumesSnapshotsTestJSON-1141189464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b48b9cd4-6ee4-480e-b0cd-8d078fe4d025.7c304aca-0d22-48be-a46b-cd47e4107283 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:47 devstack sudo[100540]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-2ea94edd-62fc-4569-8069-66ef58f3e173 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.842s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:47 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-2ea94edd-62fc-4569-8069-66ef58f3e173 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:16:47 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-2ea94edd-62fc-4569-8069-66ef58f3e173 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Deleted volume successfully. Jul 10 10:16:47 devstack sudo[100549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b48b9cd4-6ee4-480e-b0cd-8d078fe4d025.7c304aca-0d22-48be-a46b-cd47e4107283 Jul 10 10:16:47 devstack sudo[100549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:47 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-2ea94edd-62fc-4569-8069-66ef58f3e173 tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Lock "cinder-84e1378a-ce89-4874-b6c3-16c35305dbdc-delete_volume" released by "delete_volume" :: held 2.888s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:16:47 devstack sudo[100542]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-2c9cd637-195e-4626-bfe9-2f67d368146d tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8a98ede4-80e2-4d2a-afae-eb6b6da2ae3b" returned: 0 in 1.005s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-2c9cd637-195e-4626-bfe9-2f67d368146d tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8a98ede4-80e2-4d2a-afae-eb6b6da2ae3b {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:47 devstack sudo[100554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8a98ede4-80e2-4d2a-afae-eb6b6da2ae3b Jul 10 10:16:47 devstack sudo[100554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:47 devstack sudo[100549]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-0a9faa63-36fc-4380-bcae-bcf50ede488e req-6b3823d1-1670-4a57-b3d1-f786521500d1 tempest-VolumesSnapshotsTestJSON-1141189464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b48b9cd4-6ee4-480e-b0cd-8d078fe4d025.7c304aca-0d22-48be-a46b-cd47e4107283" returned: 0 in 0.816s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-0a9faa63-36fc-4380-bcae-bcf50ede488e req-6b3823d1-1670-4a57-b3d1-f786521500d1 tempest-VolumesSnapshotsTestJSON-1141189464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b48b9cd4-6ee4-480e-b0cd-8d078fe4d025.7c304aca-0d22-48be-a46b-cd47e4107283 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:48 devstack sudo[100559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b48b9cd4-6ee4-480e-b0cd-8d078fe4d025.7c304aca-0d22-48be-a46b-cd47e4107283 Jul 10 10:16:48 devstack sudo[100559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:48 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-9de0c9da-697f-417c-8ca7-2dae5cc949f3 tempest-CinderUnicodeTest-941235044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:16:48 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9de0c9da-697f-417c-8ca7-2dae5cc949f3 tempest-CinderUnicodeTest-941235044 None] Flow 'volume_create_manager' (638b1e31-e8c9-4178-b4fa-8dd782cb6650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:16:48 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9de0c9da-697f-417c-8ca7-2dae5cc949f3 tempest-CinderUnicodeTest-941235044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0d1bcfc-d8c3-4b1a-9518-6e1e0cffa325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:16:48 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9de0c9da-697f-417c-8ca7-2dae5cc949f3 tempest-CinderUnicodeTest-941235044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0d1bcfc-d8c3-4b1a-9518-6e1e0cffa325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:16:48Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73ba8d3f-9119-4dbc-87fe-d79e3c857634,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6c5ac57ab5a4c0fab037041cc21bd4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:16:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:16:48Z,use_quota=True,user_id='d4e4d9eea7544c31ae3fbda235eb5724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:16:48 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9de0c9da-697f-417c-8ca7-2dae5cc949f3 tempest-CinderUnicodeTest-941235044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fca18b4-65d9-459c-908c-63edda73c2c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:16:48 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9de0c9da-697f-417c-8ca7-2dae5cc949f3 tempest-CinderUnicodeTest-941235044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fca18b4-65d9-459c-908c-63edda73c2c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:16:48 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9de0c9da-697f-417c-8ca7-2dae5cc949f3 tempest-CinderUnicodeTest-941235044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee35325b-3e6e-4530-9916-4bd1ed85422e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:16:48 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9de0c9da-697f-417c-8ca7-2dae5cc949f3 tempest-CinderUnicodeTest-941235044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee35325b-3e6e-4530-9916-4bd1ed85422e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73ba8d3f-9119-4dbc-87fe-d79e3c857634', 'volume_name': 'volume-73ba8d3f-9119-4dbc-87fe-d79e3c857634', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:16:48 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9de0c9da-697f-417c-8ca7-2dae5cc949f3 tempest-CinderUnicodeTest-941235044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8889203d-32e0-4607-9cd6-21324965248e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:16:48 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9de0c9da-697f-417c-8ca7-2dae5cc949f3 tempest-CinderUnicodeTest-941235044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8889203d-32e0-4607-9cd6-21324965248e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:16:48 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9de0c9da-697f-417c-8ca7-2dae5cc949f3 tempest-CinderUnicodeTest-941235044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7764cf3c-8e13-4225-9ec3-f32b85a73c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:16:48 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-9de0c9da-697f-417c-8ca7-2dae5cc949f3 tempest-CinderUnicodeTest-941235044 None] Volume 73ba8d3f-9119-4dbc-87fe-d79e3c857634: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73ba8d3f-9119-4dbc-87fe-d79e3c857634', 'volume_size': 1} Jul 10 10:16:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-9de0c9da-697f-417c-8ca7-2dae5cc949f3 tempest-CinderUnicodeTest-941235044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:16:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-9de0c9da-697f-417c-8ca7-2dae5cc949f3 tempest-CinderUnicodeTest-941235044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:16:48 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-9de0c9da-697f-417c-8ca7-2dae5cc949f3 tempest-CinderUnicodeTest-941235044 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:16:48Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73ba8d3f-9119-4dbc-87fe-d79e3c857634,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6c5ac57ab5a4c0fab037041cc21bd4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:16:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:16:48Z,use_quota=True,user_id='d4e4d9eea7544c31ae3fbda235eb5724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:16:48 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-9de0c9da-697f-417c-8ca7-2dae5cc949f3 tempest-CinderUnicodeTest-941235044 None] Creating volume 73ba8d3f-9119-4dbc-87fe-d79e3c857634 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:16:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-9de0c9da-697f-417c-8ca7-2dae5cc949f3 tempest-CinderUnicodeTest-941235044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:16:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-9de0c9da-697f-417c-8ca7-2dae5cc949f3 tempest-CinderUnicodeTest-941235044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:16:48 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-9de0c9da-697f-417c-8ca7-2dae5cc949f3 tempest-CinderUnicodeTest-941235044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:16:48 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-9de0c9da-697f-417c-8ca7-2dae5cc949f3 tempest-CinderUnicodeTest-941235044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:16:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-9de0c9da-697f-417c-8ca7-2dae5cc949f3 tempest-CinderUnicodeTest-941235044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:16:48 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-9de0c9da-697f-417c-8ca7-2dae5cc949f3 tempest-CinderUnicodeTest-941235044 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:16:48 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-9de0c9da-697f-417c-8ca7-2dae5cc949f3 tempest-CinderUnicodeTest-941235044 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:16:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9de0c9da-697f-417c-8ca7-2dae5cc949f3 tempest-CinderUnicodeTest-941235044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-73ba8d3f-9119-4dbc-87fe-d79e3c857634 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:48 devstack sudo[100562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-73ba8d3f-9119-4dbc-87fe-d79e3c857634 1073741824 Jul 10 10:16:48 devstack sudo[100562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:48 devstack sudo[100554]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-2c9cd637-195e-4626-bfe9-2f67d368146d tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8a98ede4-80e2-4d2a-afae-eb6b6da2ae3b" returned: 0 in 0.867s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:48 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-2c9cd637-195e-4626-bfe9-2f67d368146d tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Lock "cinder-quobyte-8a98ede4-80e2-4d2a-afae-eb6b6da2ae3b" released by "delete_volume" :: held 1.934s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:16:48 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-2c9cd637-195e-4626-bfe9-2f67d368146d tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Created reservations ['b2a7a0de-098b-491e-be2b-bfd07f83d255', 'c80841b5-90cb-4f66-aa48-e361b29e93a5', '8f38e188-6e0f-442b-889c-0478e573a955', '9732bea3-2b3f-4802-a41c-d496a5d52c62'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:16:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-2c9cd637-195e-4626-bfe9-2f67d368146d tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:16:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-2c9cd637-195e-4626-bfe9-2f67d368146d tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:16:48 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-2c9cd637-195e-4626-bfe9-2f67d368146d tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:16:48 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-2c9cd637-195e-4626-bfe9-2f67d368146d tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:16:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-2c9cd637-195e-4626-bfe9-2f67d368146d tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:16:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-2c9cd637-195e-4626-bfe9-2f67d368146d tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:48 devstack sudo[100565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:16:48 devstack sudo[100565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:48 devstack sudo[100559]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-0a9faa63-36fc-4380-bcae-bcf50ede488e req-6b3823d1-1670-4a57-b3d1-f786521500d1 tempest-VolumesSnapshotsTestJSON-1141189464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b48b9cd4-6ee4-480e-b0cd-8d078fe4d025.7c304aca-0d22-48be-a46b-cd47e4107283" returned: 0 in 0.875s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:48 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-42a9f421-b77a-47d4-8865-52b4040ccb0b tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Acquiring lock "cinder-874dae93-9b7a-4b3a-bcb1-cddae4b9124b-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:16:48 devstack cinder-volume[87234]: DEBUG cinder.coordination [req-0a9faa63-36fc-4380-bcae-bcf50ede488e req-6b3823d1-1670-4a57-b3d1-f786521500d1 tempest-VolumesSnapshotsTestJSON-1141189464 None] Lock "cinder-quobyte-7c304aca-0d22-48be-a46b-cd47e4107283" released by "_delete_snapshot" :: held 3.726s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:16:48 devstack cinder-volume[87234]: DEBUG cinder.coordination [req-0a9faa63-36fc-4380-bcae-bcf50ede488e req-6b3823d1-1670-4a57-b3d1-f786521500d1 tempest-VolumesSnapshotsTestJSON-1141189464 None] Lock "cinder-quobyte-b48b9cd4-6ee4-480e-b0cd-8d078fe4d025" released by "delete_snapshot" :: held 3.780s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:16:48 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-42a9f421-b77a-47d4-8865-52b4040ccb0b tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Lock "cinder-874dae93-9b7a-4b3a-bcb1-cddae4b9124b-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:16:49 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-42a9f421-b77a-47d4-8865-52b4040ccb0b tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Acquiring lock "cinder-quobyte-874dae93-9b7a-4b3a-bcb1-cddae4b9124b" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:16:49 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-42a9f421-b77a-47d4-8865-52b4040ccb0b tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Lock "cinder-quobyte-874dae93-9b7a-4b3a-bcb1-cddae4b9124b" acquired by "delete_volume" :: waited 0.027s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:16:49 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d9c492b-73c7-41f8-858f-93e32dd53125]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:16:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-42a9f421-b77a-47d4-8865-52b4040ccb0b tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-874dae93-9b7a-4b3a-bcb1-cddae4b9124b {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:49 devstack cinder-volume[87234]: DEBUG cinder.quota [req-0a9faa63-36fc-4380-bcae-bcf50ede488e req-6b3823d1-1670-4a57-b3d1-f786521500d1 tempest-VolumesSnapshotsTestJSON-1141189464 None] Created reservations ['7d664243-22e2-4655-843d-99e65d031b22', 'e777252a-a702-4f2b-b2c4-771d05029f53', '0125b5b3-4012-4b88-9fe8-797c8c40f4b2', 'e430339a-1c8c-4d05-8330-02aeccc35edf'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:16:49 devstack sudo[100567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-874dae93-9b7a-4b3a-bcb1-cddae4b9124b Jul 10 10:16:49 devstack sudo[100567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:49 devstack cinder-volume[87234]: INFO cinder.volume.manager [req-0a9faa63-36fc-4380-bcae-bcf50ede488e req-6b3823d1-1670-4a57-b3d1-f786521500d1 tempest-VolumesSnapshotsTestJSON-1141189464 None] Delete snapshot completed successfully. Jul 10 10:16:49 devstack cinder-volume[87234]: DEBUG cinder.coordination [req-0a9faa63-36fc-4380-bcae-bcf50ede488e req-6b3823d1-1670-4a57-b3d1-f786521500d1 tempest-VolumesSnapshotsTestJSON-1141189464 None] Lock "cinder-7c304aca-0d22-48be-a46b-cd47e4107283-delete_snapshot" released by "delete_snapshot" :: held 4.223s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:16:49 devstack cinder-volume[87234]: DEBUG cinder.coordination [req-bdc6160c-747a-43db-8c43-b2e4f99d73a1 req-e00e347c-6af5-4670-a8a6-1dd40b9aae2c tempest-VolumesSnapshotsTestJSON-1141189464 None] Acquiring lock "cinder-b48b9cd4-6ee4-480e-b0cd-8d078fe4d025-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:16:49 devstack cinder-volume[87234]: DEBUG cinder.coordination [req-bdc6160c-747a-43db-8c43-b2e4f99d73a1 req-e00e347c-6af5-4670-a8a6-1dd40b9aae2c tempest-VolumesSnapshotsTestJSON-1141189464 None] Lock "cinder-b48b9cd4-6ee4-480e-b0cd-8d078fe4d025-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:16:49 devstack cinder-volume[87234]: DEBUG cinder.coordination [req-bdc6160c-747a-43db-8c43-b2e4f99d73a1 req-e00e347c-6af5-4670-a8a6-1dd40b9aae2c tempest-VolumesSnapshotsTestJSON-1141189464 None] Acquiring lock "cinder-quobyte-b48b9cd4-6ee4-480e-b0cd-8d078fe4d025" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:16:49 devstack cinder-volume[87234]: DEBUG cinder.coordination [req-bdc6160c-747a-43db-8c43-b2e4f99d73a1 req-e00e347c-6af5-4670-a8a6-1dd40b9aae2c tempest-VolumesSnapshotsTestJSON-1141189464 None] Lock "cinder-quobyte-b48b9cd4-6ee4-480e-b0cd-8d078fe4d025" acquired by "delete_volume" :: waited 0.036s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:16:49 devstack sudo[100565]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-2c9cd637-195e-4626-bfe9-2f67d368146d tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 1.226s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:50 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-2c9cd637-195e-4626-bfe9-2f67d368146d tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:16:50 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a98f6b-accb-4917-bf9d-37b5c2765fc6]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:16:50 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-2c9cd637-195e-4626-bfe9-2f67d368146d tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Deleted volume successfully. Jul 10 10:16:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-bdc6160c-747a-43db-8c43-b2e4f99d73a1 req-e00e347c-6af5-4670-a8a6-1dd40b9aae2c tempest-VolumesSnapshotsTestJSON-1141189464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b48b9cd4-6ee4-480e-b0cd-8d078fe4d025 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:50 devstack sudo[100562]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9de0c9da-697f-417c-8ca7-2dae5cc949f3 tempest-CinderUnicodeTest-941235044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-73ba8d3f-9119-4dbc-87fe-d79e3c857634 1073741824" returned: 0 in 1.604s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:50 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-2c9cd637-195e-4626-bfe9-2f67d368146d tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Lock "cinder-8a98ede4-80e2-4d2a-afae-eb6b6da2ae3b-delete_volume" released by "delete_volume" :: held 3.478s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:16:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9de0c9da-697f-417c-8ca7-2dae5cc949f3 tempest-CinderUnicodeTest-941235044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-73ba8d3f-9119-4dbc-87fe-d79e3c857634 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:50 devstack sudo[100576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-73ba8d3f-9119-4dbc-87fe-d79e3c857634 Jul 10 10:16:50 devstack sudo[100576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:50 devstack sudo[100574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b48b9cd4-6ee4-480e-b0cd-8d078fe4d025 Jul 10 10:16:50 devstack sudo[100574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:50 devstack sudo[100567]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-42a9f421-b77a-47d4-8865-52b4040ccb0b tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-874dae93-9b7a-4b3a-bcb1-cddae4b9124b" returned: 0 in 1.500s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-42a9f421-b77a-47d4-8865-52b4040ccb0b tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-874dae93-9b7a-4b3a-bcb1-cddae4b9124b {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:50 devstack sudo[100592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-874dae93-9b7a-4b3a-bcb1-cddae4b9124b Jul 10 10:16:50 devstack sudo[100592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:51 devstack sudo[100576]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9de0c9da-697f-417c-8ca7-2dae5cc949f3 tempest-CinderUnicodeTest-941235044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-73ba8d3f-9119-4dbc-87fe-d79e3c857634" returned: 0 in 1.099s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:51 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-9de0c9da-697f-417c-8ca7-2dae5cc949f3 tempest-CinderUnicodeTest-941235044 None] <== create_volume: return (2786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:16:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-9de0c9da-697f-417c-8ca7-2dae5cc949f3 tempest-CinderUnicodeTest-941235044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.794s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:16:51 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9de0c9da-697f-417c-8ca7-2dae5cc949f3 tempest-CinderUnicodeTest-941235044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7764cf3c-8e13-4225-9ec3-f32b85a73c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73ba8d3f-9119-4dbc-87fe-d79e3c857634', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:16:51 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9de0c9da-697f-417c-8ca7-2dae5cc949f3 tempest-CinderUnicodeTest-941235044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ebae963-8bc3-47b5-a677-942d85d471ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:16:51 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-9de0c9da-697f-417c-8ca7-2dae5cc949f3 tempest-CinderUnicodeTest-941235044 None] Volume volume-73ba8d3f-9119-4dbc-87fe-d79e3c857634 (73ba8d3f-9119-4dbc-87fe-d79e3c857634): created successfully Jul 10 10:16:51 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9de0c9da-697f-417c-8ca7-2dae5cc949f3 tempest-CinderUnicodeTest-941235044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ebae963-8bc3-47b5-a677-942d85d471ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:16:51 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9de0c9da-697f-417c-8ca7-2dae5cc949f3 tempest-CinderUnicodeTest-941235044 None] Flow 'volume_create_manager' (638b1e31-e8c9-4178-b4fa-8dd782cb6650) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:16:51 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-9de0c9da-697f-417c-8ca7-2dae5cc949f3 tempest-CinderUnicodeTest-941235044 None] Created volume successfully. Jul 10 10:16:51 devstack sudo[100574]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-bdc6160c-747a-43db-8c43-b2e4f99d73a1 req-e00e347c-6af5-4670-a8a6-1dd40b9aae2c tempest-VolumesSnapshotsTestJSON-1141189464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b48b9cd4-6ee4-480e-b0cd-8d078fe4d025" returned: 0 in 1.336s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-bdc6160c-747a-43db-8c43-b2e4f99d73a1 req-e00e347c-6af5-4670-a8a6-1dd40b9aae2c tempest-VolumesSnapshotsTestJSON-1141189464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b48b9cd4-6ee4-480e-b0cd-8d078fe4d025 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:51 devstack sudo[100604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b48b9cd4-6ee4-480e-b0cd-8d078fe4d025 Jul 10 10:16:51 devstack sudo[100604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:51 devstack sudo[100592]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-42a9f421-b77a-47d4-8865-52b4040ccb0b tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-874dae93-9b7a-4b3a-bcb1-cddae4b9124b" returned: 0 in 1.016s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:51 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-42a9f421-b77a-47d4-8865-52b4040ccb0b tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Lock "cinder-quobyte-874dae93-9b7a-4b3a-bcb1-cddae4b9124b" released by "delete_volume" :: held 2.589s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:16:51 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-42a9f421-b77a-47d4-8865-52b4040ccb0b tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Created reservations ['7b91296e-119b-487f-ac53-88817b10b57b', 'f776f115-285a-424e-856a-3a30ba1baa84', 'c05d8b85-bc73-4638-9a69-29624544c4f6', '12412705-29de-49c6-a137-58d7d0f6a416'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:16:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-42a9f421-b77a-47d4-8865-52b4040ccb0b tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:16:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-42a9f421-b77a-47d4-8865-52b4040ccb0b tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:16:51 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-42a9f421-b77a-47d4-8865-52b4040ccb0b tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:16:51 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-42a9f421-b77a-47d4-8865-52b4040ccb0b tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:16:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-42a9f421-b77a-47d4-8865-52b4040ccb0b tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:16:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-42a9f421-b77a-47d4-8865-52b4040ccb0b tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:51 devstack sudo[100607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:16:51 devstack sudo[100607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:52 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a7ebc50-2c92-4e58-8984-50f1815f0370 tempest-CinderUnicodeTest-941235044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:16:52 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5a7ebc50-2c92-4e58-8984-50f1815f0370 tempest-CinderUnicodeTest-941235044 None] Flow 'volume_create_manager' (033106fe-b7d7-49f4-bddc-e2b2a2d1fc00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:16:52 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5a7ebc50-2c92-4e58-8984-50f1815f0370 tempest-CinderUnicodeTest-941235044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a0c98fd-526d-4eb9-b1af-e513907f0c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:16:52 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5a7ebc50-2c92-4e58-8984-50f1815f0370 tempest-CinderUnicodeTest-941235044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a0c98fd-526d-4eb9-b1af-e513907f0c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:16:52Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1052494607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94ff91cf-7806-4b91-9779-87cad58f9a9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6c5ac57ab5a4c0fab037041cc21bd4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:16:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:16:52Z,use_quota=True,user_id='d4e4d9eea7544c31ae3fbda235eb5724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:16:52 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5a7ebc50-2c92-4e58-8984-50f1815f0370 tempest-CinderUnicodeTest-941235044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f7f654d-7c09-484a-94fd-ebb59de398ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:16:52 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5a7ebc50-2c92-4e58-8984-50f1815f0370 tempest-CinderUnicodeTest-941235044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f7f654d-7c09-484a-94fd-ebb59de398ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:16:52 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5a7ebc50-2c92-4e58-8984-50f1815f0370 tempest-CinderUnicodeTest-941235044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd35e30a-bbcd-4d07-91d6-0f24ebad7016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:16:52 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5a7ebc50-2c92-4e58-8984-50f1815f0370 tempest-CinderUnicodeTest-941235044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd35e30a-bbcd-4d07-91d6-0f24ebad7016) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94ff91cf-7806-4b91-9779-87cad58f9a9d', 'volume_name': 'volume-94ff91cf-7806-4b91-9779-87cad58f9a9d', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:16:52 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5a7ebc50-2c92-4e58-8984-50f1815f0370 tempest-CinderUnicodeTest-941235044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (927366b1-d2eb-47d2-abd7-399584d4b27d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:16:52 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5a7ebc50-2c92-4e58-8984-50f1815f0370 tempest-CinderUnicodeTest-941235044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (927366b1-d2eb-47d2-abd7-399584d4b27d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:16:52 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5a7ebc50-2c92-4e58-8984-50f1815f0370 tempest-CinderUnicodeTest-941235044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f50e9cf-aaab-4627-8e55-9d672747c753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:16:52 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-5a7ebc50-2c92-4e58-8984-50f1815f0370 tempest-CinderUnicodeTest-941235044 None] Volume 94ff91cf-7806-4b91-9779-87cad58f9a9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94ff91cf-7806-4b91-9779-87cad58f9a9d', 'volume_size': 1} Jul 10 10:16:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-5a7ebc50-2c92-4e58-8984-50f1815f0370 tempest-CinderUnicodeTest-941235044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:16:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-5a7ebc50-2c92-4e58-8984-50f1815f0370 tempest-CinderUnicodeTest-941235044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:16:52 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-5a7ebc50-2c92-4e58-8984-50f1815f0370 tempest-CinderUnicodeTest-941235044 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:16:52Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1052494607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94ff91cf-7806-4b91-9779-87cad58f9a9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6c5ac57ab5a4c0fab037041cc21bd4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:16:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:16:52Z,use_quota=True,user_id='d4e4d9eea7544c31ae3fbda235eb5724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:16:52 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-5a7ebc50-2c92-4e58-8984-50f1815f0370 tempest-CinderUnicodeTest-941235044 None] Creating volume 94ff91cf-7806-4b91-9779-87cad58f9a9d {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:16:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-5a7ebc50-2c92-4e58-8984-50f1815f0370 tempest-CinderUnicodeTest-941235044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:16:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-5a7ebc50-2c92-4e58-8984-50f1815f0370 tempest-CinderUnicodeTest-941235044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:16:52 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-5a7ebc50-2c92-4e58-8984-50f1815f0370 tempest-CinderUnicodeTest-941235044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:16:52 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-5a7ebc50-2c92-4e58-8984-50f1815f0370 tempest-CinderUnicodeTest-941235044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:16:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-5a7ebc50-2c92-4e58-8984-50f1815f0370 tempest-CinderUnicodeTest-941235044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:16:52 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-5a7ebc50-2c92-4e58-8984-50f1815f0370 tempest-CinderUnicodeTest-941235044 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:16:52 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-5a7ebc50-2c92-4e58-8984-50f1815f0370 tempest-CinderUnicodeTest-941235044 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:16:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5a7ebc50-2c92-4e58-8984-50f1815f0370 tempest-CinderUnicodeTest-941235044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94ff91cf-7806-4b91-9779-87cad58f9a9d 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:52 devstack sudo[100610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94ff91cf-7806-4b91-9779-87cad58f9a9d 1073741824 Jul 10 10:16:52 devstack sudo[100610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:52 devstack sudo[100604]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-bdc6160c-747a-43db-8c43-b2e4f99d73a1 req-e00e347c-6af5-4670-a8a6-1dd40b9aae2c tempest-VolumesSnapshotsTestJSON-1141189464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b48b9cd4-6ee4-480e-b0cd-8d078fe4d025" returned: 0 in 0.845s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:52 devstack cinder-volume[87234]: DEBUG cinder.coordination [req-bdc6160c-747a-43db-8c43-b2e4f99d73a1 req-e00e347c-6af5-4670-a8a6-1dd40b9aae2c tempest-VolumesSnapshotsTestJSON-1141189464 None] Lock "cinder-quobyte-b48b9cd4-6ee4-480e-b0cd-8d078fe4d025" released by "delete_volume" :: held 2.293s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:16:52 devstack cinder-volume[87234]: DEBUG cinder.quota [req-bdc6160c-747a-43db-8c43-b2e4f99d73a1 req-e00e347c-6af5-4670-a8a6-1dd40b9aae2c tempest-VolumesSnapshotsTestJSON-1141189464 None] Created reservations ['c53dc7a1-b317-4844-8efb-1bdd75fbb234', '1cbc4d67-c753-477a-a978-c50bdd8909f8', 'd9904fc2-5af8-4cf5-a9a6-c3ff0a8da585', '3c06ddbe-f627-42e9-800a-2a9066a66ab7'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:16:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-bdc6160c-747a-43db-8c43-b2e4f99d73a1 req-e00e347c-6af5-4670-a8a6-1dd40b9aae2c tempest-VolumesSnapshotsTestJSON-1141189464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:16:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-bdc6160c-747a-43db-8c43-b2e4f99d73a1 req-e00e347c-6af5-4670-a8a6-1dd40b9aae2c tempest-VolumesSnapshotsTestJSON-1141189464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:16:52 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [req-bdc6160c-747a-43db-8c43-b2e4f99d73a1 req-e00e347c-6af5-4670-a8a6-1dd40b9aae2c tempest-VolumesSnapshotsTestJSON-1141189464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:16:52 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [req-bdc6160c-747a-43db-8c43-b2e4f99d73a1 req-e00e347c-6af5-4670-a8a6-1dd40b9aae2c tempest-VolumesSnapshotsTestJSON-1141189464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:16:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-bdc6160c-747a-43db-8c43-b2e4f99d73a1 req-e00e347c-6af5-4670-a8a6-1dd40b9aae2c tempest-VolumesSnapshotsTestJSON-1141189464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:16:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-bdc6160c-747a-43db-8c43-b2e4f99d73a1 req-e00e347c-6af5-4670-a8a6-1dd40b9aae2c tempest-VolumesSnapshotsTestJSON-1141189464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:52 devstack sudo[100612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:16:52 devstack sudo[100612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:52 devstack sudo[100607]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-42a9f421-b77a-47d4-8865-52b4040ccb0b tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.919s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:52 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-42a9f421-b77a-47d4-8865-52b4040ccb0b tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:16:52 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-42a9f421-b77a-47d4-8865-52b4040ccb0b tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Deleted volume successfully. Jul 10 10:16:52 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-42a9f421-b77a-47d4-8865-52b4040ccb0b tempest-CreateVolumesFromSourceVolumeTest-1990888017 None] Lock "cinder-874dae93-9b7a-4b3a-bcb1-cddae4b9124b-delete_volume" released by "delete_volume" :: held 3.756s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:16:53 devstack sudo[100612]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-bdc6160c-747a-43db-8c43-b2e4f99d73a1 req-e00e347c-6af5-4670-a8a6-1dd40b9aae2c tempest-VolumesSnapshotsTestJSON-1141189464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.846s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:53 devstack cinder-volume[87234]: DEBUG cinder.manager [req-bdc6160c-747a-43db-8c43-b2e4f99d73a1 req-e00e347c-6af5-4670-a8a6-1dd40b9aae2c tempest-VolumesSnapshotsTestJSON-1141189464 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:16:53 devstack cinder-volume[87234]: INFO cinder.volume.manager [req-bdc6160c-747a-43db-8c43-b2e4f99d73a1 req-e00e347c-6af5-4670-a8a6-1dd40b9aae2c tempest-VolumesSnapshotsTestJSON-1141189464 None] Deleted volume successfully. Jul 10 10:16:53 devstack cinder-volume[87234]: DEBUG cinder.coordination [req-bdc6160c-747a-43db-8c43-b2e4f99d73a1 req-e00e347c-6af5-4670-a8a6-1dd40b9aae2c tempest-VolumesSnapshotsTestJSON-1141189464 None] Lock "cinder-b48b9cd4-6ee4-480e-b0cd-8d078fe4d025-delete_volume" released by "delete_volume" :: held 3.482s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:16:53 devstack sudo[100610]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5a7ebc50-2c92-4e58-8984-50f1815f0370 tempest-CinderUnicodeTest-941235044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94ff91cf-7806-4b91-9779-87cad58f9a9d 1073741824" returned: 0 in 1.174s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5a7ebc50-2c92-4e58-8984-50f1815f0370 tempest-CinderUnicodeTest-941235044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94ff91cf-7806-4b91-9779-87cad58f9a9d {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:53 devstack sudo[100619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94ff91cf-7806-4b91-9779-87cad58f9a9d Jul 10 10:16:53 devstack sudo[100619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:54 devstack sudo[100619]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:54 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5a7ebc50-2c92-4e58-8984-50f1815f0370 tempest-CinderUnicodeTest-941235044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94ff91cf-7806-4b91-9779-87cad58f9a9d" returned: 0 in 0.839s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:54 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-5a7ebc50-2c92-4e58-8984-50f1815f0370 tempest-CinderUnicodeTest-941235044 None] <== create_volume: return (2064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:16:54 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-5a7ebc50-2c92-4e58-8984-50f1815f0370 tempest-CinderUnicodeTest-941235044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.071s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:16:54 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5a7ebc50-2c92-4e58-8984-50f1815f0370 tempest-CinderUnicodeTest-941235044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f50e9cf-aaab-4627-8e55-9d672747c753) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94ff91cf-7806-4b91-9779-87cad58f9a9d', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:16:54 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5a7ebc50-2c92-4e58-8984-50f1815f0370 tempest-CinderUnicodeTest-941235044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cebdd0a-38e7-4bac-a551-adeff7e381e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:16:54 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-5a7ebc50-2c92-4e58-8984-50f1815f0370 tempest-CinderUnicodeTest-941235044 None] Volume volume-94ff91cf-7806-4b91-9779-87cad58f9a9d (94ff91cf-7806-4b91-9779-87cad58f9a9d): created successfully Jul 10 10:16:54 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5a7ebc50-2c92-4e58-8984-50f1815f0370 tempest-CinderUnicodeTest-941235044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cebdd0a-38e7-4bac-a551-adeff7e381e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:16:54 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5a7ebc50-2c92-4e58-8984-50f1815f0370 tempest-CinderUnicodeTest-941235044 None] Flow 'volume_create_manager' (033106fe-b7d7-49f4-bddc-e2b2a2d1fc00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:16:54 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-5a7ebc50-2c92-4e58-8984-50f1815f0370 tempest-CinderUnicodeTest-941235044 None] Created volume successfully. Jul 10 10:16:55 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-246369f5-e3cd-4ca8-aa51-217edbcccb26 tempest-CinderUnicodeTest-941235044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:16:55 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-246369f5-e3cd-4ca8-aa51-217edbcccb26 tempest-CinderUnicodeTest-941235044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:16:55 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-246369f5-e3cd-4ca8-aa51-217edbcccb26 tempest-CinderUnicodeTest-941235044 None] Creating offline snapshot b02fbabc-bb84-4f96-b5cd-cddb600e3305 of volume 94ff91cf-7806-4b91-9779-87cad58f9a9d {{(pid=87234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 10:16:55 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d4ca3b-de44-4a0f-b0ac-8a4d87192408]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:16:55 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-246369f5-e3cd-4ca8-aa51-217edbcccb26 tempest-CinderUnicodeTest-941235044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94ff91cf-7806-4b91-9779-87cad58f9a9d {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:56 devstack sudo[100664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94ff91cf-7806-4b91-9779-87cad58f9a9d Jul 10 10:16:56 devstack sudo[100664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:56 devstack sudo[100664]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-246369f5-e3cd-4ca8-aa51-217edbcccb26 tempest-CinderUnicodeTest-941235044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94ff91cf-7806-4b91-9779-87cad58f9a9d" returned: 0 in 1.089s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-246369f5-e3cd-4ca8-aa51-217edbcccb26 tempest-CinderUnicodeTest-941235044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94ff91cf-7806-4b91-9779-87cad58f9a9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94ff91cf-7806-4b91-9779-87cad58f9a9d.b02fbabc-bb84-4f96-b5cd-cddb600e3305 1G {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:56 devstack sudo[100693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94ff91cf-7806-4b91-9779-87cad58f9a9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94ff91cf-7806-4b91-9779-87cad58f9a9d.b02fbabc-bb84-4f96-b5cd-cddb600e3305 1G Jul 10 10:16:56 devstack sudo[100693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:57 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-04424404-7330-4b98-877a-ec80ab3a562f tempest-ProjectReaderTests-48876304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:16:57 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-04424404-7330-4b98-877a-ec80ab3a562f tempest-ProjectReaderTests-48876304 None] Flow 'volume_create_manager' (c3f9c69d-b08e-465d-8c9d-b0880f0cbb9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:16:57 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-04424404-7330-4b98-877a-ec80ab3a562f tempest-ProjectReaderTests-48876304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5db352a6-3e73-41ef-ac62-1972071589b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:16:57 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-04424404-7330-4b98-877a-ec80ab3a562f tempest-ProjectReaderTests-48876304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5db352a6-3e73-41ef-ac62-1972071589b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:16:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-982444625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1fb842c-439a-4132-b505-4263d46de309,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6ff6e84af264a95a932ebd6de99fb8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:16:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:16:57Z,use_quota=True,user_id='667e1409e48a405fbebe1954788fbb15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:16:57 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-04424404-7330-4b98-877a-ec80ab3a562f tempest-ProjectReaderTests-48876304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa26ab2a-b380-4c81-9e82-4dd757e187e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:16:57 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-04424404-7330-4b98-877a-ec80ab3a562f tempest-ProjectReaderTests-48876304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa26ab2a-b380-4c81-9e82-4dd757e187e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:16:57 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-04424404-7330-4b98-877a-ec80ab3a562f tempest-ProjectReaderTests-48876304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (543bfc87-51a9-45d6-88e7-37c43f5a1123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:16:57 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-04424404-7330-4b98-877a-ec80ab3a562f tempest-ProjectReaderTests-48876304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (543bfc87-51a9-45d6-88e7-37c43f5a1123) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1fb842c-439a-4132-b505-4263d46de309', 'volume_name': 'volume-d1fb842c-439a-4132-b505-4263d46de309', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:16:57 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-04424404-7330-4b98-877a-ec80ab3a562f tempest-ProjectReaderTests-48876304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7125be1-5ac3-42ab-a1f0-6f96e6381640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:16:57 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-04424404-7330-4b98-877a-ec80ab3a562f tempest-ProjectReaderTests-48876304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7125be1-5ac3-42ab-a1f0-6f96e6381640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:16:57 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-04424404-7330-4b98-877a-ec80ab3a562f tempest-ProjectReaderTests-48876304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a23fde24-a016-4d14-b4d7-5657485fecec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:16:57 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-04424404-7330-4b98-877a-ec80ab3a562f tempest-ProjectReaderTests-48876304 None] Volume d1fb842c-439a-4132-b505-4263d46de309: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1fb842c-439a-4132-b505-4263d46de309', 'volume_size': 1} Jul 10 10:16:57 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-04424404-7330-4b98-877a-ec80ab3a562f tempest-ProjectReaderTests-48876304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:16:57 devstack sudo[100693]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-246369f5-e3cd-4ca8-aa51-217edbcccb26 tempest-CinderUnicodeTest-941235044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94ff91cf-7806-4b91-9779-87cad58f9a9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94ff91cf-7806-4b91-9779-87cad58f9a9d.b02fbabc-bb84-4f96-b5cd-cddb600e3305 1G" returned: 0 in 1.095s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-246369f5-e3cd-4ca8-aa51-217edbcccb26 tempest-CinderUnicodeTest-941235044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94ff91cf-7806-4b91-9779-87cad58f9a9d -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94ff91cf-7806-4b91-9779-87cad58f9a9d.b02fbabc-bb84-4f96-b5cd-cddb600e3305 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:58 devstack sudo[100702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94ff91cf-7806-4b91-9779-87cad58f9a9d -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94ff91cf-7806-4b91-9779-87cad58f9a9d.b02fbabc-bb84-4f96-b5cd-cddb600e3305 Jul 10 10:16:58 devstack sudo[100702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:58 devstack sudo[100702]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-246369f5-e3cd-4ca8-aa51-217edbcccb26 tempest-CinderUnicodeTest-941235044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94ff91cf-7806-4b91-9779-87cad58f9a9d -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94ff91cf-7806-4b91-9779-87cad58f9a9d.b02fbabc-bb84-4f96-b5cd-cddb600e3305" returned: 0 in 0.945s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:58 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-246369f5-e3cd-4ca8-aa51-217edbcccb26 tempest-CinderUnicodeTest-941235044 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94ff91cf-7806-4b91-9779-87cad58f9a9d.b02fbabc-bb84-4f96-b5cd-cddb600e3305 is being set with open permissions: ugo+rw Jul 10 10:16:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-246369f5-e3cd-4ca8-aa51-217edbcccb26 tempest-CinderUnicodeTest-941235044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94ff91cf-7806-4b91-9779-87cad58f9a9d.b02fbabc-bb84-4f96-b5cd-cddb600e3305 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:59 devstack sudo[100708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94ff91cf-7806-4b91-9779-87cad58f9a9d.b02fbabc-bb84-4f96-b5cd-cddb600e3305 Jul 10 10:16:59 devstack sudo[100708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:16:59 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [req-46bfb9fe-0397-47f1-a362-2474360c1a0a req-64ad86ef-a254-49e8-987b-95273a247781 tempest-VolumesGetTestJSON-1053387314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:16:59 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [req-46bfb9fe-0397-47f1-a362-2474360c1a0a req-64ad86ef-a254-49e8-987b-95273a247781 tempest-VolumesGetTestJSON-1053387314 None] Flow 'volume_create_manager' (2c56f549-7979-4914-af2f-49e30d4df94f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:16:59 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [req-46bfb9fe-0397-47f1-a362-2474360c1a0a req-64ad86ef-a254-49e8-987b-95273a247781 tempest-VolumesGetTestJSON-1053387314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e71cd6d-0ca6-4917-b2bb-e2df4017d736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:16:59 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [req-46bfb9fe-0397-47f1-a362-2474360c1a0a req-64ad86ef-a254-49e8-987b-95273a247781 tempest-VolumesGetTestJSON-1053387314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e71cd6d-0ca6-4917-b2bb-e2df4017d736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:16:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-436703561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33275cf6-62e4-43cb-bab7-3419ea918a59,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6721d004ba1d4e2389abaa16cf8845d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:16:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:16:59Z,use_quota=True,user_id='3d7bc42edc184d52a6cab9b4ff40a184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:16:59 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [req-46bfb9fe-0397-47f1-a362-2474360c1a0a req-64ad86ef-a254-49e8-987b-95273a247781 tempest-VolumesGetTestJSON-1053387314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02feac7c-597c-4a2e-a385-807a8634a0c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:16:59 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [req-46bfb9fe-0397-47f1-a362-2474360c1a0a req-64ad86ef-a254-49e8-987b-95273a247781 tempest-VolumesGetTestJSON-1053387314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02feac7c-597c-4a2e-a385-807a8634a0c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:16:59 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [req-46bfb9fe-0397-47f1-a362-2474360c1a0a req-64ad86ef-a254-49e8-987b-95273a247781 tempest-VolumesGetTestJSON-1053387314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc087bde-0ad3-4c6a-9df6-eca63d616b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:16:59 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [req-46bfb9fe-0397-47f1-a362-2474360c1a0a req-64ad86ef-a254-49e8-987b-95273a247781 tempest-VolumesGetTestJSON-1053387314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc087bde-0ad3-4c6a-9df6-eca63d616b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33275cf6-62e4-43cb-bab7-3419ea918a59', 'volume_name': 'volume-33275cf6-62e4-43cb-bab7-3419ea918a59', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:16:59 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [req-46bfb9fe-0397-47f1-a362-2474360c1a0a req-64ad86ef-a254-49e8-987b-95273a247781 tempest-VolumesGetTestJSON-1053387314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4460a60b-fde9-4b64-872b-9194cc636f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:16:59 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [req-46bfb9fe-0397-47f1-a362-2474360c1a0a req-64ad86ef-a254-49e8-987b-95273a247781 tempest-VolumesGetTestJSON-1053387314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4460a60b-fde9-4b64-872b-9194cc636f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:16:59 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [req-46bfb9fe-0397-47f1-a362-2474360c1a0a req-64ad86ef-a254-49e8-987b-95273a247781 tempest-VolumesGetTestJSON-1053387314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf9f2c4e-6353-45d9-8b22-4c541145a519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:16:59 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [req-46bfb9fe-0397-47f1-a362-2474360c1a0a req-64ad86ef-a254-49e8-987b-95273a247781 tempest-VolumesGetTestJSON-1053387314 None] Volume 33275cf6-62e4-43cb-bab7-3419ea918a59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33275cf6-62e4-43cb-bab7-3419ea918a59', 'volume_size': 1} Jul 10 10:16:59 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-46bfb9fe-0397-47f1-a362-2474360c1a0a req-64ad86ef-a254-49e8-987b-95273a247781 tempest-VolumesGetTestJSON-1053387314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:16:59 devstack sudo[100708]: pam_unix(sudo:session): session closed for user root Jul 10 10:16:59 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-246369f5-e3cd-4ca8-aa51-217edbcccb26 tempest-CinderUnicodeTest-941235044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94ff91cf-7806-4b91-9779-87cad58f9a9d.b02fbabc-bb84-4f96-b5cd-cddb600e3305" returned: 0 in 0.851s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:16:59 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-246369f5-e3cd-4ca8-aa51-217edbcccb26 tempest-CinderUnicodeTest-941235044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94ff91cf-7806-4b91-9779-87cad58f9a9d.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:16:59 devstack sudo[100712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94ff91cf-7806-4b91-9779-87cad58f9a9d.info Jul 10 10:16:59 devstack sudo[100712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:17:00 devstack sudo[100712]: pam_unix(sudo:session): session closed for user root Jul 10 10:17:00 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-246369f5-e3cd-4ca8-aa51-217edbcccb26 tempest-CinderUnicodeTest-941235044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94ff91cf-7806-4b91-9779-87cad58f9a9d.info" returned: 0 in 0.874s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:17:00 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-246369f5-e3cd-4ca8-aa51-217edbcccb26 tempest-CinderUnicodeTest-941235044 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94ff91cf-7806-4b91-9779-87cad58f9a9d.info is being set with open permissions: ugo+rw Jul 10 10:17:00 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-246369f5-e3cd-4ca8-aa51-217edbcccb26 tempest-CinderUnicodeTest-941235044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94ff91cf-7806-4b91-9779-87cad58f9a9d.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:17:00 devstack sudo[100726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94ff91cf-7806-4b91-9779-87cad58f9a9d.info Jul 10 10:17:00 devstack sudo[100726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:17:01 devstack sudo[100726]: pam_unix(sudo:session): session closed for user root Jul 10 10:17:01 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-246369f5-e3cd-4ca8-aa51-217edbcccb26 tempest-CinderUnicodeTest-941235044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94ff91cf-7806-4b91-9779-87cad58f9a9d.info" returned: 0 in 0.759s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:17:01 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-246369f5-e3cd-4ca8-aa51-217edbcccb26 tempest-CinderUnicodeTest-941235044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.797s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:17:01 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-04424404-7330-4b98-877a-ec80ab3a562f tempest-ProjectReaderTests-48876304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.950s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:17:01 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-04424404-7330-4b98-877a-ec80ab3a562f tempest-ProjectReaderTests-48876304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:16:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-982444625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1fb842c-439a-4132-b505-4263d46de309,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6ff6e84af264a95a932ebd6de99fb8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:16:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:16:57Z,use_quota=True,user_id='667e1409e48a405fbebe1954788fbb15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:17:01 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-04424404-7330-4b98-877a-ec80ab3a562f tempest-ProjectReaderTests-48876304 None] Creating volume d1fb842c-439a-4132-b505-4263d46de309 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:17:01 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-04424404-7330-4b98-877a-ec80ab3a562f tempest-ProjectReaderTests-48876304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:17:01 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-04424404-7330-4b98-877a-ec80ab3a562f tempest-ProjectReaderTests-48876304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:17:01 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-04424404-7330-4b98-877a-ec80ab3a562f tempest-ProjectReaderTests-48876304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:17:01 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-04424404-7330-4b98-877a-ec80ab3a562f tempest-ProjectReaderTests-48876304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:17:01 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-04424404-7330-4b98-877a-ec80ab3a562f tempest-ProjectReaderTests-48876304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:17:01 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-04424404-7330-4b98-877a-ec80ab3a562f tempest-ProjectReaderTests-48876304 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:17:01 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-04424404-7330-4b98-877a-ec80ab3a562f tempest-ProjectReaderTests-48876304 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:17:01 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-04424404-7330-4b98-877a-ec80ab3a562f tempest-ProjectReaderTests-48876304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d1fb842c-439a-4132-b505-4263d46de309 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:17:01 devstack sudo[100733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d1fb842c-439a-4132-b505-4263d46de309 1073741824 Jul 10 10:17:01 devstack sudo[100733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:17:01 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-246369f5-e3cd-4ca8-aa51-217edbcccb26 tempest-CinderUnicodeTest-941235044 None] Create snapshot completed successfully Jul 10 10:17:02 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-0c9582d2-6595-4f25-83c3-798155750821 tempest-CinderUnicodeTest-941235044 None] Acquiring lock "cinder-b02fbabc-bb84-4f96-b5cd-cddb600e3305-delete_snapshot" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:17:02 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-0c9582d2-6595-4f25-83c3-798155750821 tempest-CinderUnicodeTest-941235044 None] Lock "cinder-b02fbabc-bb84-4f96-b5cd-cddb600e3305-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:17:02 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-0c9582d2-6595-4f25-83c3-798155750821 tempest-CinderUnicodeTest-941235044 None] Acquiring lock "cinder-quobyte-94ff91cf-7806-4b91-9779-87cad58f9a9d" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:17:02 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-0c9582d2-6595-4f25-83c3-798155750821 tempest-CinderUnicodeTest-941235044 None] Lock "cinder-quobyte-94ff91cf-7806-4b91-9779-87cad58f9a9d" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:17:02 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-0c9582d2-6595-4f25-83c3-798155750821 tempest-CinderUnicodeTest-941235044 None] Acquiring lock "cinder-quobyte-b02fbabc-bb84-4f96-b5cd-cddb600e3305" by "_delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:17:02 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-0c9582d2-6595-4f25-83c3-798155750821 tempest-CinderUnicodeTest-941235044 None] Lock "cinder-quobyte-b02fbabc-bb84-4f96-b5cd-cddb600e3305" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:17:02 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-0c9582d2-6595-4f25-83c3-798155750821 tempest-CinderUnicodeTest-941235044 None] Deleting offline snapshot b02fbabc-bb84-4f96-b5cd-cddb600e3305 of volume 94ff91cf-7806-4b91-9779-87cad58f9a9d {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 10:17:02 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-0c9582d2-6595-4f25-83c3-798155750821 tempest-CinderUnicodeTest-941235044 None] snapshot_file for this snap is: volume-94ff91cf-7806-4b91-9779-87cad58f9a9d.b02fbabc-bb84-4f96-b5cd-cddb600e3305 {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 10:17:02 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9e1765-f806-49a2-b610-dae4afea269b]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:17:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0c9582d2-6595-4f25-83c3-798155750821 tempest-CinderUnicodeTest-941235044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94ff91cf-7806-4b91-9779-87cad58f9a9d.b02fbabc-bb84-4f96-b5cd-cddb600e3305 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:17:02 devstack sudo[100738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94ff91cf-7806-4b91-9779-87cad58f9a9d.b02fbabc-bb84-4f96-b5cd-cddb600e3305 Jul 10 10:17:02 devstack sudo[100738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:17:02 devstack sudo[100733]: pam_unix(sudo:session): session closed for user root Jul 10 10:17:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-04424404-7330-4b98-877a-ec80ab3a562f tempest-ProjectReaderTests-48876304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d1fb842c-439a-4132-b505-4263d46de309 1073741824" returned: 0 in 1.054s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:17:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-04424404-7330-4b98-877a-ec80ab3a562f tempest-ProjectReaderTests-48876304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d1fb842c-439a-4132-b505-4263d46de309 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:17:02 devstack sudo[100741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d1fb842c-439a-4132-b505-4263d46de309 Jul 10 10:17:02 devstack sudo[100741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:17:03 devstack sudo[100738]: pam_unix(sudo:session): session closed for user root Jul 10 10:17:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0c9582d2-6595-4f25-83c3-798155750821 tempest-CinderUnicodeTest-941235044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94ff91cf-7806-4b91-9779-87cad58f9a9d.b02fbabc-bb84-4f96-b5cd-cddb600e3305" returned: 0 in 0.852s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:17:03 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-0c9582d2-6595-4f25-83c3-798155750821 tempest-CinderUnicodeTest-941235044 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94ff91cf-7806-4b91-9779-87cad58f9a9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 10:17:03 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a33dc8-735e-4b70-b11e-9a87055175d9]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:17:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0c9582d2-6595-4f25-83c3-798155750821 tempest-CinderUnicodeTest-941235044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94ff91cf-7806-4b91-9779-87cad58f9a9d {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:17:03 devstack sudo[100741]: pam_unix(sudo:session): session closed for user root Jul 10 10:17:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-04424404-7330-4b98-877a-ec80ab3a562f tempest-ProjectReaderTests-48876304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d1fb842c-439a-4132-b505-4263d46de309" returned: 0 in 0.675s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:17:03 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-04424404-7330-4b98-877a-ec80ab3a562f tempest-ProjectReaderTests-48876304 None] <== create_volume: return (1790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:17:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-04424404-7330-4b98-877a-ec80ab3a562f tempest-ProjectReaderTests-48876304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.793s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:17:03 devstack sudo[100747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94ff91cf-7806-4b91-9779-87cad58f9a9d Jul 10 10:17:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-46bfb9fe-0397-47f1-a362-2474360c1a0a req-64ad86ef-a254-49e8-987b-95273a247781 tempest-VolumesGetTestJSON-1053387314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.060s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:17:03 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [req-46bfb9fe-0397-47f1-a362-2474360c1a0a req-64ad86ef-a254-49e8-987b-95273a247781 tempest-VolumesGetTestJSON-1053387314 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:16:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-436703561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33275cf6-62e4-43cb-bab7-3419ea918a59,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6721d004ba1d4e2389abaa16cf8845d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:16:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:16:59Z,use_quota=True,user_id='3d7bc42edc184d52a6cab9b4ff40a184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:17:03 devstack sudo[100747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:17:03 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [req-46bfb9fe-0397-47f1-a362-2474360c1a0a req-64ad86ef-a254-49e8-987b-95273a247781 tempest-VolumesGetTestJSON-1053387314 None] Creating volume 33275cf6-62e4-43cb-bab7-3419ea918a59 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:17:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-46bfb9fe-0397-47f1-a362-2474360c1a0a req-64ad86ef-a254-49e8-987b-95273a247781 tempest-VolumesGetTestJSON-1053387314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:17:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-46bfb9fe-0397-47f1-a362-2474360c1a0a req-64ad86ef-a254-49e8-987b-95273a247781 tempest-VolumesGetTestJSON-1053387314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:17:03 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [req-46bfb9fe-0397-47f1-a362-2474360c1a0a req-64ad86ef-a254-49e8-987b-95273a247781 tempest-VolumesGetTestJSON-1053387314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:17:03 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [req-46bfb9fe-0397-47f1-a362-2474360c1a0a req-64ad86ef-a254-49e8-987b-95273a247781 tempest-VolumesGetTestJSON-1053387314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:17:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-46bfb9fe-0397-47f1-a362-2474360c1a0a req-64ad86ef-a254-49e8-987b-95273a247781 tempest-VolumesGetTestJSON-1053387314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:17:03 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [req-46bfb9fe-0397-47f1-a362-2474360c1a0a req-64ad86ef-a254-49e8-987b-95273a247781 tempest-VolumesGetTestJSON-1053387314 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:17:03 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [req-46bfb9fe-0397-47f1-a362-2474360c1a0a req-64ad86ef-a254-49e8-987b-95273a247781 tempest-VolumesGetTestJSON-1053387314 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:17:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-46bfb9fe-0397-47f1-a362-2474360c1a0a req-64ad86ef-a254-49e8-987b-95273a247781 tempest-VolumesGetTestJSON-1053387314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-33275cf6-62e4-43cb-bab7-3419ea918a59 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:17:03 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-04424404-7330-4b98-877a-ec80ab3a562f tempest-ProjectReaderTests-48876304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a23fde24-a016-4d14-b4d7-5657485fecec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1fb842c-439a-4132-b505-4263d46de309', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:17:03 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-04424404-7330-4b98-877a-ec80ab3a562f tempest-ProjectReaderTests-48876304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60e522b9-858c-4eed-8b16-9052113bd796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:17:03 devstack sudo[100750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-33275cf6-62e4-43cb-bab7-3419ea918a59 1073741824 Jul 10 10:17:03 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-04424404-7330-4b98-877a-ec80ab3a562f tempest-ProjectReaderTests-48876304 None] Volume volume-d1fb842c-439a-4132-b505-4263d46de309 (d1fb842c-439a-4132-b505-4263d46de309): created successfully Jul 10 10:17:03 devstack sudo[100750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:17:03 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-04424404-7330-4b98-877a-ec80ab3a562f tempest-ProjectReaderTests-48876304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60e522b9-858c-4eed-8b16-9052113bd796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:17:03 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-04424404-7330-4b98-877a-ec80ab3a562f tempest-ProjectReaderTests-48876304 None] Flow 'volume_create_manager' (c3f9c69d-b08e-465d-8c9d-b0880f0cbb9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:17:03 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-04424404-7330-4b98-877a-ec80ab3a562f tempest-ProjectReaderTests-48876304 None] Created volume successfully. Jul 10 10:17:04 devstack sudo[100747]: pam_unix(sudo:session): session closed for user root Jul 10 10:17:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0c9582d2-6595-4f25-83c3-798155750821 tempest-CinderUnicodeTest-941235044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94ff91cf-7806-4b91-9779-87cad58f9a9d" returned: 0 in 0.887s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:17:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0c9582d2-6595-4f25-83c3-798155750821 tempest-CinderUnicodeTest-941235044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94ff91cf-7806-4b91-9779-87cad58f9a9d.b02fbabc-bb84-4f96-b5cd-cddb600e3305 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:17:04 devstack sudo[100759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94ff91cf-7806-4b91-9779-87cad58f9a9d.b02fbabc-bb84-4f96-b5cd-cddb600e3305 Jul 10 10:17:04 devstack sudo[100759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:17:04 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-c3a6cea2-e328-431e-a66d-94499c078305 tempest-ProjectReaderTests-48876304 None] Acquiring lock "cinder-d1fb842c-439a-4132-b505-4263d46de309-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:17:04 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-c3a6cea2-e328-431e-a66d-94499c078305 tempest-ProjectReaderTests-48876304 None] Lock "cinder-d1fb842c-439a-4132-b505-4263d46de309-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:17:04 devstack sudo[100750]: pam_unix(sudo:session): session closed for user root Jul 10 10:17:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-46bfb9fe-0397-47f1-a362-2474360c1a0a req-64ad86ef-a254-49e8-987b-95273a247781 tempest-VolumesGetTestJSON-1053387314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-33275cf6-62e4-43cb-bab7-3419ea918a59 1073741824" returned: 0 in 0.992s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:17:04 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-c3a6cea2-e328-431e-a66d-94499c078305 tempest-ProjectReaderTests-48876304 None] Acquiring lock "cinder-quobyte-d1fb842c-439a-4132-b505-4263d46de309" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:17:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-46bfb9fe-0397-47f1-a362-2474360c1a0a req-64ad86ef-a254-49e8-987b-95273a247781 tempest-VolumesGetTestJSON-1053387314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-33275cf6-62e4-43cb-bab7-3419ea918a59 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:17:04 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-c3a6cea2-e328-431e-a66d-94499c078305 tempest-ProjectReaderTests-48876304 None] Lock "cinder-quobyte-d1fb842c-439a-4132-b505-4263d46de309" acquired by "delete_volume" :: waited 0.039s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:17:04 devstack sudo[100762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-33275cf6-62e4-43cb-bab7-3419ea918a59 Jul 10 10:17:04 devstack sudo[100762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:17:04 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[530472e2-c9a9-41f8-81b8-0b3f69d2003f]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:17:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c3a6cea2-e328-431e-a66d-94499c078305 tempest-ProjectReaderTests-48876304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d1fb842c-439a-4132-b505-4263d46de309 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:17:04 devstack sudo[100764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d1fb842c-439a-4132-b505-4263d46de309 Jul 10 10:17:04 devstack sudo[100764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:17:05 devstack sudo[100759]: pam_unix(sudo:session): session closed for user root Jul 10 10:17:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0c9582d2-6595-4f25-83c3-798155750821 tempest-CinderUnicodeTest-941235044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94ff91cf-7806-4b91-9779-87cad58f9a9d.b02fbabc-bb84-4f96-b5cd-cddb600e3305" returned: 0 in 1.029s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:17:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0c9582d2-6595-4f25-83c3-798155750821 tempest-CinderUnicodeTest-941235044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94ff91cf-7806-4b91-9779-87cad58f9a9d.b02fbabc-bb84-4f96-b5cd-cddb600e3305 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:17:05 devstack sudo[100771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94ff91cf-7806-4b91-9779-87cad58f9a9d.b02fbabc-bb84-4f96-b5cd-cddb600e3305 Jul 10 10:17:05 devstack sudo[100771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:17:05 devstack sudo[100762]: pam_unix(sudo:session): session closed for user root Jul 10 10:17:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-46bfb9fe-0397-47f1-a362-2474360c1a0a req-64ad86ef-a254-49e8-987b-95273a247781 tempest-VolumesGetTestJSON-1053387314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-33275cf6-62e4-43cb-bab7-3419ea918a59" returned: 0 in 0.806s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:17:05 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [req-46bfb9fe-0397-47f1-a362-2474360c1a0a req-64ad86ef-a254-49e8-987b-95273a247781 tempest-VolumesGetTestJSON-1053387314 None] <== create_volume: return (1867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:17:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-46bfb9fe-0397-47f1-a362-2474360c1a0a req-64ad86ef-a254-49e8-987b-95273a247781 tempest-VolumesGetTestJSON-1053387314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.871s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:17:05 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [req-46bfb9fe-0397-47f1-a362-2474360c1a0a req-64ad86ef-a254-49e8-987b-95273a247781 tempest-VolumesGetTestJSON-1053387314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf9f2c4e-6353-45d9-8b22-4c541145a519) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33275cf6-62e4-43cb-bab7-3419ea918a59', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:17:05 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [req-46bfb9fe-0397-47f1-a362-2474360c1a0a req-64ad86ef-a254-49e8-987b-95273a247781 tempest-VolumesGetTestJSON-1053387314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45be9177-439b-4fde-a20b-102612e2d239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:17:05 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [req-46bfb9fe-0397-47f1-a362-2474360c1a0a req-64ad86ef-a254-49e8-987b-95273a247781 tempest-VolumesGetTestJSON-1053387314 None] Volume volume-33275cf6-62e4-43cb-bab7-3419ea918a59 (33275cf6-62e4-43cb-bab7-3419ea918a59): created successfully Jul 10 10:17:05 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [req-46bfb9fe-0397-47f1-a362-2474360c1a0a req-64ad86ef-a254-49e8-987b-95273a247781 tempest-VolumesGetTestJSON-1053387314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45be9177-439b-4fde-a20b-102612e2d239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:17:05 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [req-46bfb9fe-0397-47f1-a362-2474360c1a0a req-64ad86ef-a254-49e8-987b-95273a247781 tempest-VolumesGetTestJSON-1053387314 None] Flow 'volume_create_manager' (2c56f549-7979-4914-af2f-49e30d4df94f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:17:05 devstack cinder-volume[87234]: INFO cinder.volume.manager [req-46bfb9fe-0397-47f1-a362-2474360c1a0a req-64ad86ef-a254-49e8-987b-95273a247781 tempest-VolumesGetTestJSON-1053387314 None] Created volume successfully. Jul 10 10:17:05 devstack sudo[100764]: pam_unix(sudo:session): session closed for user root Jul 10 10:17:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c3a6cea2-e328-431e-a66d-94499c078305 tempest-ProjectReaderTests-48876304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d1fb842c-439a-4132-b505-4263d46de309" returned: 0 in 0.979s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:17:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c3a6cea2-e328-431e-a66d-94499c078305 tempest-ProjectReaderTests-48876304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d1fb842c-439a-4132-b505-4263d46de309 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:17:05 devstack sudo[100776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d1fb842c-439a-4132-b505-4263d46de309 Jul 10 10:17:05 devstack sudo[100776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:17:05 devstack sudo[100771]: pam_unix(sudo:session): session closed for user root Jul 10 10:17:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0c9582d2-6595-4f25-83c3-798155750821 tempest-CinderUnicodeTest-941235044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94ff91cf-7806-4b91-9779-87cad58f9a9d.b02fbabc-bb84-4f96-b5cd-cddb600e3305" returned: 0 in 0.859s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:17:06 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-0c9582d2-6595-4f25-83c3-798155750821 tempest-CinderUnicodeTest-941235044 None] Lock "cinder-quobyte-b02fbabc-bb84-4f96-b5cd-cddb600e3305" released by "_delete_snapshot" :: held 3.785s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:17:06 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-0c9582d2-6595-4f25-83c3-798155750821 tempest-CinderUnicodeTest-941235044 None] Lock "cinder-quobyte-94ff91cf-7806-4b91-9779-87cad58f9a9d" released by "delete_snapshot" :: held 3.821s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:17:06 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-0c9582d2-6595-4f25-83c3-798155750821 tempest-CinderUnicodeTest-941235044 None] Created reservations ['08f91797-3d24-4578-844b-5c5de45c1e33', '32f84ac4-9e2a-4395-abbb-0f7fa9dee735', 'a016e5bd-4073-4797-859c-373e7db4c359', '9d6257c6-2d55-4401-80d7-c8b37c5b537a'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:17:06 devstack sudo[100776]: pam_unix(sudo:session): session closed for user root Jul 10 10:17:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c3a6cea2-e328-431e-a66d-94499c078305 tempest-ProjectReaderTests-48876304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d1fb842c-439a-4132-b505-4263d46de309" returned: 0 in 0.760s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:17:06 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-c3a6cea2-e328-431e-a66d-94499c078305 tempest-ProjectReaderTests-48876304 None] Lock "cinder-quobyte-d1fb842c-439a-4132-b505-4263d46de309" released by "delete_volume" :: held 1.805s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:17:06 devstack cinder-volume[87234]: DEBUG cinder.coordination [req-024953bf-7429-4c09-b17e-19ef3ef43cc6 req-e70bf90d-4d1d-434d-afc6-55a22519c687 tempest-VolumesGetTestJSON-1053387314 None] Acquiring lock "cinder-33275cf6-62e4-43cb-bab7-3419ea918a59-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:17:06 devstack cinder-volume[87234]: DEBUG cinder.coordination [req-024953bf-7429-4c09-b17e-19ef3ef43cc6 req-e70bf90d-4d1d-434d-afc6-55a22519c687 tempest-VolumesGetTestJSON-1053387314 None] Lock "cinder-33275cf6-62e4-43cb-bab7-3419ea918a59-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:17:06 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-0c9582d2-6595-4f25-83c3-798155750821 tempest-CinderUnicodeTest-941235044 None] Delete snapshot completed successfully. Jul 10 10:17:06 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-0c9582d2-6595-4f25-83c3-798155750821 tempest-CinderUnicodeTest-941235044 None] Lock "cinder-b02fbabc-bb84-4f96-b5cd-cddb600e3305-delete_snapshot" released by "delete_snapshot" :: held 4.183s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:17:06 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-c3a6cea2-e328-431e-a66d-94499c078305 tempest-ProjectReaderTests-48876304 None] Created reservations ['f7cb29e2-3a29-4ffb-ba16-fddc82764081', '3a3973c4-6fd9-4003-81e0-991e0e2a60af', '644f75e0-8cdb-4c55-8907-df75a67a7725', '68536139-0225-4766-b18d-3f0467074120'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:17:06 devstack cinder-volume[87234]: DEBUG cinder.coordination [req-024953bf-7429-4c09-b17e-19ef3ef43cc6 req-e70bf90d-4d1d-434d-afc6-55a22519c687 tempest-VolumesGetTestJSON-1053387314 None] Acquiring lock "cinder-quobyte-33275cf6-62e4-43cb-bab7-3419ea918a59" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:17:06 devstack cinder-volume[87234]: DEBUG cinder.coordination [req-024953bf-7429-4c09-b17e-19ef3ef43cc6 req-e70bf90d-4d1d-434d-afc6-55a22519c687 tempest-VolumesGetTestJSON-1053387314 None] Lock "cinder-quobyte-33275cf6-62e4-43cb-bab7-3419ea918a59" acquired by "delete_volume" :: waited 0.032s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:17:06 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa12871-24a2-41e3-903e-4e307e946887]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:17:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-024953bf-7429-4c09-b17e-19ef3ef43cc6 req-e70bf90d-4d1d-434d-afc6-55a22519c687 tempest-VolumesGetTestJSON-1053387314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-33275cf6-62e4-43cb-bab7-3419ea918a59 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:17:06 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f4a87db8-9eda-4674-b99e-b3cbba532bff tempest-CinderUnicodeTest-941235044 None] Acquiring lock "cinder-94ff91cf-7806-4b91-9779-87cad58f9a9d-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:17:06 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f4a87db8-9eda-4674-b99e-b3cbba532bff tempest-CinderUnicodeTest-941235044 None] Lock "cinder-94ff91cf-7806-4b91-9779-87cad58f9a9d-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:17:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-c3a6cea2-e328-431e-a66d-94499c078305 tempest-ProjectReaderTests-48876304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:17:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-c3a6cea2-e328-431e-a66d-94499c078305 tempest-ProjectReaderTests-48876304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:17:06 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-c3a6cea2-e328-431e-a66d-94499c078305 tempest-ProjectReaderTests-48876304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:17:06 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-c3a6cea2-e328-431e-a66d-94499c078305 tempest-ProjectReaderTests-48876304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:17:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-c3a6cea2-e328-431e-a66d-94499c078305 tempest-ProjectReaderTests-48876304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:17:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c3a6cea2-e328-431e-a66d-94499c078305 tempest-ProjectReaderTests-48876304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:17:06 devstack sudo[100781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:17:06 devstack sudo[100781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:17:06 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f4a87db8-9eda-4674-b99e-b3cbba532bff tempest-CinderUnicodeTest-941235044 None] Acquiring lock "cinder-quobyte-94ff91cf-7806-4b91-9779-87cad58f9a9d" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:17:06 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f4a87db8-9eda-4674-b99e-b3cbba532bff tempest-CinderUnicodeTest-941235044 None] Lock "cinder-quobyte-94ff91cf-7806-4b91-9779-87cad58f9a9d" acquired by "delete_volume" :: waited 0.041s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:17:06 devstack sudo[100780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-33275cf6-62e4-43cb-bab7-3419ea918a59 Jul 10 10:17:06 devstack sudo[100780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:17:06 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[62cdbb8d-0e67-4bc0-9ea4-d122b3df34fc]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:17:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f4a87db8-9eda-4674-b99e-b3cbba532bff tempest-CinderUnicodeTest-941235044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94ff91cf-7806-4b91-9779-87cad58f9a9d {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:17:07 devstack sudo[100784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94ff91cf-7806-4b91-9779-87cad58f9a9d Jul 10 10:17:07 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e52fb5a-a7de-42de-8f05-5e32ee85fd81 tempest-ProjectReaderTests-48876304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:17:07 devstack sudo[100784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:17:07 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9e52fb5a-a7de-42de-8f05-5e32ee85fd81 tempest-ProjectReaderTests-48876304 None] Flow 'volume_create_manager' (c6959c83-64d2-435a-a402-06029f0f0995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:17:07 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9e52fb5a-a7de-42de-8f05-5e32ee85fd81 tempest-ProjectReaderTests-48876304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a658e524-98f7-4aa1-b835-5dacefc31923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:17:07 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9e52fb5a-a7de-42de-8f05-5e32ee85fd81 tempest-ProjectReaderTests-48876304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a658e524-98f7-4aa1-b835-5dacefc31923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:17:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2082315957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbb2dbc8-0960-4fe6-be29-b99648da85db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6ff6e84af264a95a932ebd6de99fb8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:17:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:17:07Z,use_quota=True,user_id='667e1409e48a405fbebe1954788fbb15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:17:07 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9e52fb5a-a7de-42de-8f05-5e32ee85fd81 tempest-ProjectReaderTests-48876304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee092cac-c0e7-4be2-8521-509a6f5c1885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:17:07 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9e52fb5a-a7de-42de-8f05-5e32ee85fd81 tempest-ProjectReaderTests-48876304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee092cac-c0e7-4be2-8521-509a6f5c1885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:17:07 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9e52fb5a-a7de-42de-8f05-5e32ee85fd81 tempest-ProjectReaderTests-48876304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ba907af-8c3e-403f-8b83-7ff5f3209c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:17:07 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9e52fb5a-a7de-42de-8f05-5e32ee85fd81 tempest-ProjectReaderTests-48876304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ba907af-8c3e-403f-8b83-7ff5f3209c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbb2dbc8-0960-4fe6-be29-b99648da85db', 'volume_name': 'volume-cbb2dbc8-0960-4fe6-be29-b99648da85db', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:17:07 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9e52fb5a-a7de-42de-8f05-5e32ee85fd81 tempest-ProjectReaderTests-48876304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80e2820c-6d65-4dd0-ba41-949c2de95926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:17:07 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9e52fb5a-a7de-42de-8f05-5e32ee85fd81 tempest-ProjectReaderTests-48876304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80e2820c-6d65-4dd0-ba41-949c2de95926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:17:07 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9e52fb5a-a7de-42de-8f05-5e32ee85fd81 tempest-ProjectReaderTests-48876304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfa1ab0d-1cd5-49a8-bb5f-69dd68b87274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:17:07 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-9e52fb5a-a7de-42de-8f05-5e32ee85fd81 tempest-ProjectReaderTests-48876304 None] Volume cbb2dbc8-0960-4fe6-be29-b99648da85db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbb2dbc8-0960-4fe6-be29-b99648da85db', 'volume_size': 1} Jul 10 10:17:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-9e52fb5a-a7de-42de-8f05-5e32ee85fd81 tempest-ProjectReaderTests-48876304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:17:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-9e52fb5a-a7de-42de-8f05-5e32ee85fd81 tempest-ProjectReaderTests-48876304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:17:07 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-9e52fb5a-a7de-42de-8f05-5e32ee85fd81 tempest-ProjectReaderTests-48876304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:17:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2082315957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbb2dbc8-0960-4fe6-be29-b99648da85db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6ff6e84af264a95a932ebd6de99fb8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:17:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:17:07Z,use_quota=True,user_id='667e1409e48a405fbebe1954788fbb15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:17:07 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-9e52fb5a-a7de-42de-8f05-5e32ee85fd81 tempest-ProjectReaderTests-48876304 None] Creating volume cbb2dbc8-0960-4fe6-be29-b99648da85db {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:17:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-9e52fb5a-a7de-42de-8f05-5e32ee85fd81 tempest-ProjectReaderTests-48876304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:17:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-9e52fb5a-a7de-42de-8f05-5e32ee85fd81 tempest-ProjectReaderTests-48876304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:17:07 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-9e52fb5a-a7de-42de-8f05-5e32ee85fd81 tempest-ProjectReaderTests-48876304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:17:07 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-9e52fb5a-a7de-42de-8f05-5e32ee85fd81 tempest-ProjectReaderTests-48876304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:17:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-9e52fb5a-a7de-42de-8f05-5e32ee85fd81 tempest-ProjectReaderTests-48876304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:17:07 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-9e52fb5a-a7de-42de-8f05-5e32ee85fd81 tempest-ProjectReaderTests-48876304 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:17:07 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-9e52fb5a-a7de-42de-8f05-5e32ee85fd81 tempest-ProjectReaderTests-48876304 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:17:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9e52fb5a-a7de-42de-8f05-5e32ee85fd81 tempest-ProjectReaderTests-48876304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-cbb2dbc8-0960-4fe6-be29-b99648da85db 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:17:07 devstack sudo[100787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-cbb2dbc8-0960-4fe6-be29-b99648da85db 1073741824 Jul 10 10:17:07 devstack sudo[100787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:17:07 devstack sudo[100780]: pam_unix(sudo:session): session closed for user root Jul 10 10:17:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-024953bf-7429-4c09-b17e-19ef3ef43cc6 req-e70bf90d-4d1d-434d-afc6-55a22519c687 tempest-VolumesGetTestJSON-1053387314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-33275cf6-62e4-43cb-bab7-3419ea918a59" returned: 0 in 1.226s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:17:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-024953bf-7429-4c09-b17e-19ef3ef43cc6 req-e70bf90d-4d1d-434d-afc6-55a22519c687 tempest-VolumesGetTestJSON-1053387314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-33275cf6-62e4-43cb-bab7-3419ea918a59 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:17:07 devstack sudo[100792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-33275cf6-62e4-43cb-bab7-3419ea918a59 Jul 10 10:17:07 devstack sudo[100792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:17:07 devstack sudo[100781]: pam_unix(sudo:session): session closed for user root Jul 10 10:17:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c3a6cea2-e328-431e-a66d-94499c078305 tempest-ProjectReaderTests-48876304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 1.293s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:17:07 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-c3a6cea2-e328-431e-a66d-94499c078305 tempest-ProjectReaderTests-48876304 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:17:07 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-c3a6cea2-e328-431e-a66d-94499c078305 tempest-ProjectReaderTests-48876304 None] Deleted volume successfully. Jul 10 10:17:08 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-c3a6cea2-e328-431e-a66d-94499c078305 tempest-ProjectReaderTests-48876304 None] Lock "cinder-d1fb842c-439a-4132-b505-4263d46de309-delete_volume" released by "delete_volume" :: held 3.686s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:17:08 devstack sudo[100784]: pam_unix(sudo:session): session closed for user root Jul 10 10:17:08 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f4a87db8-9eda-4674-b99e-b3cbba532bff tempest-CinderUnicodeTest-941235044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94ff91cf-7806-4b91-9779-87cad58f9a9d" returned: 0 in 1.471s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:17:08 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f4a87db8-9eda-4674-b99e-b3cbba532bff tempest-CinderUnicodeTest-941235044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94ff91cf-7806-4b91-9779-87cad58f9a9d {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:17:08 devstack sudo[100800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94ff91cf-7806-4b91-9779-87cad58f9a9d Jul 10 10:17:08 devstack sudo[100800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:17:08 devstack sudo[100787]: pam_unix(sudo:session): session closed for user root Jul 10 10:17:08 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9e52fb5a-a7de-42de-8f05-5e32ee85fd81 tempest-ProjectReaderTests-48876304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-cbb2dbc8-0960-4fe6-be29-b99648da85db 1073741824" returned: 0 in 1.321s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:17:08 devstack sudo[100792]: pam_unix(sudo:session): session closed for user root Jul 10 10:17:08 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9e52fb5a-a7de-42de-8f05-5e32ee85fd81 tempest-ProjectReaderTests-48876304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-cbb2dbc8-0960-4fe6-be29-b99648da85db {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:17:08 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-024953bf-7429-4c09-b17e-19ef3ef43cc6 req-e70bf90d-4d1d-434d-afc6-55a22519c687 tempest-VolumesGetTestJSON-1053387314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-33275cf6-62e4-43cb-bab7-3419ea918a59" returned: 0 in 0.993s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:17:08 devstack cinder-volume[87234]: DEBUG cinder.coordination [req-024953bf-7429-4c09-b17e-19ef3ef43cc6 req-e70bf90d-4d1d-434d-afc6-55a22519c687 tempest-VolumesGetTestJSON-1053387314 None] Lock "cinder-quobyte-33275cf6-62e4-43cb-bab7-3419ea918a59" released by "delete_volume" :: held 2.280s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:17:08 devstack sudo[100806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-cbb2dbc8-0960-4fe6-be29-b99648da85db Jul 10 10:17:08 devstack sudo[100806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:17:08 devstack cinder-volume[87234]: DEBUG cinder.quota [req-024953bf-7429-4c09-b17e-19ef3ef43cc6 req-e70bf90d-4d1d-434d-afc6-55a22519c687 tempest-VolumesGetTestJSON-1053387314 None] Created reservations ['431d03e1-16eb-494c-8aa9-73eb825aa515', '7644d1cb-581c-40a1-abf4-f0c773612ec7', '2d200796-3815-4671-8ebe-3d165be66d32', 'dfb3728b-2bc0-418a-ab37-2d1b61c6200c'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:17:08 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-024953bf-7429-4c09-b17e-19ef3ef43cc6 req-e70bf90d-4d1d-434d-afc6-55a22519c687 tempest-VolumesGetTestJSON-1053387314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:17:08 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-024953bf-7429-4c09-b17e-19ef3ef43cc6 req-e70bf90d-4d1d-434d-afc6-55a22519c687 tempest-VolumesGetTestJSON-1053387314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:17:08 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [req-024953bf-7429-4c09-b17e-19ef3ef43cc6 req-e70bf90d-4d1d-434d-afc6-55a22519c687 tempest-VolumesGetTestJSON-1053387314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:17:08 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [req-024953bf-7429-4c09-b17e-19ef3ef43cc6 req-e70bf90d-4d1d-434d-afc6-55a22519c687 tempest-VolumesGetTestJSON-1053387314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:17:08 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-024953bf-7429-4c09-b17e-19ef3ef43cc6 req-e70bf90d-4d1d-434d-afc6-55a22519c687 tempest-VolumesGetTestJSON-1053387314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:17:08 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-024953bf-7429-4c09-b17e-19ef3ef43cc6 req-e70bf90d-4d1d-434d-afc6-55a22519c687 tempest-VolumesGetTestJSON-1053387314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:17:08 devstack sudo[100808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:17:08 devstack sudo[100808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:17:09 devstack sudo[100800]: pam_unix(sudo:session): session closed for user root Jul 10 10:17:09 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f4a87db8-9eda-4674-b99e-b3cbba532bff tempest-CinderUnicodeTest-941235044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94ff91cf-7806-4b91-9779-87cad58f9a9d" returned: 0 in 0.798s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:17:09 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f4a87db8-9eda-4674-b99e-b3cbba532bff tempest-CinderUnicodeTest-941235044 None] Lock "cinder-quobyte-94ff91cf-7806-4b91-9779-87cad58f9a9d" released by "delete_volume" :: held 2.360s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:17:09 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-f4a87db8-9eda-4674-b99e-b3cbba532bff tempest-CinderUnicodeTest-941235044 None] Created reservations ['c439c6df-0bf6-4928-ac09-f109df58a31a', '096c02ea-f15b-4937-b9aa-24c9e86c0707', '6ad1e05e-83b1-4f17-9e35-867e62bff1a4', 'd48a31ef-8049-4980-b642-814061d80b89'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:17:09 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f4a87db8-9eda-4674-b99e-b3cbba532bff tempest-CinderUnicodeTest-941235044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:17:09 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f4a87db8-9eda-4674-b99e-b3cbba532bff tempest-CinderUnicodeTest-941235044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:17:09 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f4a87db8-9eda-4674-b99e-b3cbba532bff tempest-CinderUnicodeTest-941235044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:17:09 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f4a87db8-9eda-4674-b99e-b3cbba532bff tempest-CinderUnicodeTest-941235044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:17:09 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f4a87db8-9eda-4674-b99e-b3cbba532bff tempest-CinderUnicodeTest-941235044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:17:09 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f4a87db8-9eda-4674-b99e-b3cbba532bff tempest-CinderUnicodeTest-941235044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:17:09 devstack sudo[100811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:17:09 devstack sudo[100811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:17:09 devstack sudo[100806]: pam_unix(sudo:session): session closed for user root Jul 10 10:17:09 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9e52fb5a-a7de-42de-8f05-5e32ee85fd81 tempest-ProjectReaderTests-48876304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-cbb2dbc8-0960-4fe6-be29-b99648da85db" returned: 0 in 0.830s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:17:09 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-9e52fb5a-a7de-42de-8f05-5e32ee85fd81 tempest-ProjectReaderTests-48876304 None] <== create_volume: return (2209ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:17:09 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-9e52fb5a-a7de-42de-8f05-5e32ee85fd81 tempest-ProjectReaderTests-48876304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.212s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:17:09 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9e52fb5a-a7de-42de-8f05-5e32ee85fd81 tempest-ProjectReaderTests-48876304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfa1ab0d-1cd5-49a8-bb5f-69dd68b87274) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbb2dbc8-0960-4fe6-be29-b99648da85db', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:17:09 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9e52fb5a-a7de-42de-8f05-5e32ee85fd81 tempest-ProjectReaderTests-48876304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b26d77b-3076-4e62-b7b2-30c5e382cd43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:17:09 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-9e52fb5a-a7de-42de-8f05-5e32ee85fd81 tempest-ProjectReaderTests-48876304 None] Volume volume-cbb2dbc8-0960-4fe6-be29-b99648da85db (cbb2dbc8-0960-4fe6-be29-b99648da85db): created successfully Jul 10 10:17:09 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9e52fb5a-a7de-42de-8f05-5e32ee85fd81 tempest-ProjectReaderTests-48876304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b26d77b-3076-4e62-b7b2-30c5e382cd43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:17:09 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9e52fb5a-a7de-42de-8f05-5e32ee85fd81 tempest-ProjectReaderTests-48876304 None] Flow 'volume_create_manager' (c6959c83-64d2-435a-a402-06029f0f0995) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:17:09 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-9e52fb5a-a7de-42de-8f05-5e32ee85fd81 tempest-ProjectReaderTests-48876304 None] Created volume successfully. Jul 10 10:17:09 devstack sudo[100808]: pam_unix(sudo:session): session closed for user root Jul 10 10:17:09 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-024953bf-7429-4c09-b17e-19ef3ef43cc6 req-e70bf90d-4d1d-434d-afc6-55a22519c687 tempest-VolumesGetTestJSON-1053387314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.886s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:17:09 devstack cinder-volume[87234]: DEBUG cinder.manager [req-024953bf-7429-4c09-b17e-19ef3ef43cc6 req-e70bf90d-4d1d-434d-afc6-55a22519c687 tempest-VolumesGetTestJSON-1053387314 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:17:09 devstack cinder-volume[87234]: INFO cinder.volume.manager [req-024953bf-7429-4c09-b17e-19ef3ef43cc6 req-e70bf90d-4d1d-434d-afc6-55a22519c687 tempest-VolumesGetTestJSON-1053387314 None] Deleted volume successfully. Jul 10 10:17:09 devstack cinder-volume[87234]: DEBUG cinder.coordination [req-024953bf-7429-4c09-b17e-19ef3ef43cc6 req-e70bf90d-4d1d-434d-afc6-55a22519c687 tempest-VolumesGetTestJSON-1053387314 None] Lock "cinder-33275cf6-62e4-43cb-bab7-3419ea918a59-delete_volume" released by "delete_volume" :: held 3.533s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:17:10 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-22f3ac5a-78e4-48d6-9cbb-bf77e81b1d48 tempest-CinderUnicodeTest-941235044 None] Acquiring lock "cinder-73ba8d3f-9119-4dbc-87fe-d79e3c857634-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:17:10 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-22f3ac5a-78e4-48d6-9cbb-bf77e81b1d48 tempest-CinderUnicodeTest-941235044 None] Lock "cinder-73ba8d3f-9119-4dbc-87fe-d79e3c857634-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:17:10 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-22f3ac5a-78e4-48d6-9cbb-bf77e81b1d48 tempest-CinderUnicodeTest-941235044 None] Acquiring lock "cinder-quobyte-73ba8d3f-9119-4dbc-87fe-d79e3c857634" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:17:10 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-22f3ac5a-78e4-48d6-9cbb-bf77e81b1d48 tempest-CinderUnicodeTest-941235044 None] Lock "cinder-quobyte-73ba8d3f-9119-4dbc-87fe-d79e3c857634" acquired by "delete_volume" :: waited 0.027s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:17:10 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[7288c572-56f0-4c0e-9323-b30e54260420]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:17:10 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-22f3ac5a-78e4-48d6-9cbb-bf77e81b1d48 tempest-CinderUnicodeTest-941235044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-73ba8d3f-9119-4dbc-87fe-d79e3c857634 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:17:10 devstack sudo[100811]: pam_unix(sudo:session): session closed for user root Jul 10 10:17:10 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f4a87db8-9eda-4674-b99e-b3cbba532bff tempest-CinderUnicodeTest-941235044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.940s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:17:10 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-f4a87db8-9eda-4674-b99e-b3cbba532bff tempest-CinderUnicodeTest-941235044 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:17:10 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-f4a87db8-9eda-4674-b99e-b3cbba532bff tempest-CinderUnicodeTest-941235044 None] Deleted volume successfully. Jul 10 10:17:10 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f4a87db8-9eda-4674-b99e-b3cbba532bff tempest-CinderUnicodeTest-941235044 None] Lock "cinder-94ff91cf-7806-4b91-9779-87cad58f9a9d-delete_volume" released by "delete_volume" :: held 3.707s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:17:10 devstack sudo[100826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-73ba8d3f-9119-4dbc-87fe-d79e3c857634 Jul 10 10:17:10 devstack sudo[100826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:17:10 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-6b0a81b5-6468-4b45-ab5f-79f8f5b8fcff tempest-ProjectReaderTests-48876304 None] Acquiring lock "cinder-cbb2dbc8-0960-4fe6-be29-b99648da85db-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:17:10 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-6b0a81b5-6468-4b45-ab5f-79f8f5b8fcff tempest-ProjectReaderTests-48876304 None] Lock "cinder-cbb2dbc8-0960-4fe6-be29-b99648da85db-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:17:11 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-6b0a81b5-6468-4b45-ab5f-79f8f5b8fcff tempest-ProjectReaderTests-48876304 None] Acquiring lock "cinder-quobyte-cbb2dbc8-0960-4fe6-be29-b99648da85db" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:17:11 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-6b0a81b5-6468-4b45-ab5f-79f8f5b8fcff tempest-ProjectReaderTests-48876304 None] Lock "cinder-quobyte-cbb2dbc8-0960-4fe6-be29-b99648da85db" acquired by "delete_volume" :: waited 0.016s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:17:11 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b4d288-be2c-4b2e-97e3-2cd54f826805]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:17:11 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-6b0a81b5-6468-4b45-ab5f-79f8f5b8fcff tempest-ProjectReaderTests-48876304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-cbb2dbc8-0960-4fe6-be29-b99648da85db {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:17:11 devstack sudo[100826]: pam_unix(sudo:session): session closed for user root Jul 10 10:17:11 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-22f3ac5a-78e4-48d6-9cbb-bf77e81b1d48 tempest-CinderUnicodeTest-941235044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-73ba8d3f-9119-4dbc-87fe-d79e3c857634" returned: 0 in 0.964s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:17:11 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-22f3ac5a-78e4-48d6-9cbb-bf77e81b1d48 tempest-CinderUnicodeTest-941235044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-73ba8d3f-9119-4dbc-87fe-d79e3c857634 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:17:11 devstack sudo[100845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-cbb2dbc8-0960-4fe6-be29-b99648da85db Jul 10 10:17:11 devstack sudo[100845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:17:11 devstack sudo[100846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-73ba8d3f-9119-4dbc-87fe-d79e3c857634 Jul 10 10:17:11 devstack sudo[100846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:17:11 devstack sudo[100845]: pam_unix(sudo:session): session closed for user root Jul 10 10:17:11 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-6b0a81b5-6468-4b45-ab5f-79f8f5b8fcff tempest-ProjectReaderTests-48876304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-cbb2dbc8-0960-4fe6-be29-b99648da85db" returned: 0 in 0.809s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:17:11 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-6b0a81b5-6468-4b45-ab5f-79f8f5b8fcff tempest-ProjectReaderTests-48876304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-cbb2dbc8-0960-4fe6-be29-b99648da85db {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:17:11 devstack sudo[100846]: pam_unix(sudo:session): session closed for user root Jul 10 10:17:11 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-22f3ac5a-78e4-48d6-9cbb-bf77e81b1d48 tempest-CinderUnicodeTest-941235044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-73ba8d3f-9119-4dbc-87fe-d79e3c857634" returned: 0 in 0.710s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:17:11 devstack sudo[100854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-cbb2dbc8-0960-4fe6-be29-b99648da85db Jul 10 10:17:11 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-22f3ac5a-78e4-48d6-9cbb-bf77e81b1d48 tempest-CinderUnicodeTest-941235044 None] Lock "cinder-quobyte-73ba8d3f-9119-4dbc-87fe-d79e3c857634" released by "delete_volume" :: held 1.733s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:17:11 devstack sudo[100854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:17:12 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-22f3ac5a-78e4-48d6-9cbb-bf77e81b1d48 tempest-CinderUnicodeTest-941235044 None] Created reservations ['39ee43ec-092a-42b8-b718-4f247fcd4682', 'b87f0a33-a14d-498f-9718-203c66e31959', 'b1408ecf-24ed-484e-a451-44d796ce4511', '508d9b72-90ce-4b7f-95f9-ac91e2d50940'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:17:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-22f3ac5a-78e4-48d6-9cbb-bf77e81b1d48 tempest-CinderUnicodeTest-941235044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:17:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-22f3ac5a-78e4-48d6-9cbb-bf77e81b1d48 tempest-CinderUnicodeTest-941235044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:17:12 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-22f3ac5a-78e4-48d6-9cbb-bf77e81b1d48 tempest-CinderUnicodeTest-941235044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:17:12 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-22f3ac5a-78e4-48d6-9cbb-bf77e81b1d48 tempest-CinderUnicodeTest-941235044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:17:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-22f3ac5a-78e4-48d6-9cbb-bf77e81b1d48 tempest-CinderUnicodeTest-941235044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:17:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-22f3ac5a-78e4-48d6-9cbb-bf77e81b1d48 tempest-CinderUnicodeTest-941235044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:17:12 devstack sudo[100854]: pam_unix(sudo:session): session closed for user root Jul 10 10:17:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-6b0a81b5-6468-4b45-ab5f-79f8f5b8fcff tempest-ProjectReaderTests-48876304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-cbb2dbc8-0960-4fe6-be29-b99648da85db" returned: 0 in 0.649s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:17:12 devstack sudo[100857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:17:12 devstack sudo[100857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:17:12 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-6b0a81b5-6468-4b45-ab5f-79f8f5b8fcff tempest-ProjectReaderTests-48876304 None] Lock "cinder-quobyte-cbb2dbc8-0960-4fe6-be29-b99648da85db" released by "delete_volume" :: held 1.501s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:17:12 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-6b0a81b5-6468-4b45-ab5f-79f8f5b8fcff tempest-ProjectReaderTests-48876304 None] Created reservations ['089c5bcb-28f9-443a-ba7e-02aaf91bfd55', 'e6d450a0-cf83-4225-b06d-e3d3d4e3fad4', 'a656ad0f-8964-4a22-bb7e-2dfd02a662f5', 'bb8c7686-1df1-498a-aa54-cbdb101c0ed3'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:17:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-6b0a81b5-6468-4b45-ab5f-79f8f5b8fcff tempest-ProjectReaderTests-48876304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:17:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-6b0a81b5-6468-4b45-ab5f-79f8f5b8fcff tempest-ProjectReaderTests-48876304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:17:12 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-6b0a81b5-6468-4b45-ab5f-79f8f5b8fcff tempest-ProjectReaderTests-48876304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:17:13 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-6b0a81b5-6468-4b45-ab5f-79f8f5b8fcff tempest-ProjectReaderTests-48876304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:17:13 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-6b0a81b5-6468-4b45-ab5f-79f8f5b8fcff tempest-ProjectReaderTests-48876304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:17:13 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-6b0a81b5-6468-4b45-ab5f-79f8f5b8fcff tempest-ProjectReaderTests-48876304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:17:13 devstack sudo[100859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:17:13 devstack sudo[100859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:17:13 devstack sudo[100857]: pam_unix(sudo:session): session closed for user root Jul 10 10:17:13 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-22f3ac5a-78e4-48d6-9cbb-bf77e81b1d48 tempest-CinderUnicodeTest-941235044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.765s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:17:13 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-22f3ac5a-78e4-48d6-9cbb-bf77e81b1d48 tempest-CinderUnicodeTest-941235044 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:17:13 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-22f3ac5a-78e4-48d6-9cbb-bf77e81b1d48 tempest-CinderUnicodeTest-941235044 None] Deleted volume successfully. Jul 10 10:17:13 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-22f3ac5a-78e4-48d6-9cbb-bf77e81b1d48 tempest-CinderUnicodeTest-941235044 None] Lock "cinder-73ba8d3f-9119-4dbc-87fe-d79e3c857634-delete_volume" released by "delete_volume" :: held 3.300s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:17:13 devstack sudo[100859]: pam_unix(sudo:session): session closed for user root Jul 10 10:17:13 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-6b0a81b5-6468-4b45-ab5f-79f8f5b8fcff tempest-ProjectReaderTests-48876304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.695s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:17:13 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-6b0a81b5-6468-4b45-ab5f-79f8f5b8fcff tempest-ProjectReaderTests-48876304 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:17:13 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-6b0a81b5-6468-4b45-ab5f-79f8f5b8fcff tempest-ProjectReaderTests-48876304 None] Deleted volume successfully. Jul 10 10:17:13 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-6b0a81b5-6468-4b45-ab5f-79f8f5b8fcff tempest-ProjectReaderTests-48876304 None] Lock "cinder-cbb2dbc8-0960-4fe6-be29-b99648da85db-delete_volume" released by "delete_volume" :: held 3.141s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:17:19 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-c6b937ca-2bb2-489a-abe0-29f752f2d203 tempest-GroupSnapshotsTest-1289579137 None] Group tempest-GroupSnapshotsTest-Group-1783290540: creating Jul 10 10:17:19 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-c6b937ca-2bb2-489a-abe0-29f752f2d203 tempest-GroupSnapshotsTest-1289579137 None] Group tempest-GroupSnapshotsTest-Group-1783290540: created successfully Jul 10 10:17:19 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-c6b937ca-2bb2-489a-abe0-29f752f2d203 tempest-GroupSnapshotsTest-1289579137 None] Create group completed successfully. Jul 10 10:17:20 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f264200-8e74-4dcb-8a28-e19eec8809c8 tempest-ProjectReaderTests-2023074414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:17:20 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3f264200-8e74-4dcb-8a28-e19eec8809c8 tempest-ProjectReaderTests-2023074414 None] Flow 'volume_create_manager' (32d6bfe6-ab52-4ac8-9f52-8a7c68864c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:17:20 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3f264200-8e74-4dcb-8a28-e19eec8809c8 tempest-ProjectReaderTests-2023074414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05b4e789-18bd-4517-9c1e-a86a3711df52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:17:20 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3f264200-8e74-4dcb-8a28-e19eec8809c8 tempest-ProjectReaderTests-2023074414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05b4e789-18bd-4517-9c1e-a86a3711df52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:17:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1269969535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30999ddc-9846-4d2b-8725-a4ee73a8eff8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3fd2e5ed917444bbfc8266034f1677e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:17:20Z,use_quota=True,user_id='96e3c41b24a64c42b841b4dde10061e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:17:20 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3f264200-8e74-4dcb-8a28-e19eec8809c8 tempest-ProjectReaderTests-2023074414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b31a2487-727e-4123-b3d7-624cd163ecf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:17:20 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3f264200-8e74-4dcb-8a28-e19eec8809c8 tempest-ProjectReaderTests-2023074414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b31a2487-727e-4123-b3d7-624cd163ecf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:17:20 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3f264200-8e74-4dcb-8a28-e19eec8809c8 tempest-ProjectReaderTests-2023074414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f246f06-e2cd-4d93-a71e-baabc9fe9674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:17:20 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3f264200-8e74-4dcb-8a28-e19eec8809c8 tempest-ProjectReaderTests-2023074414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f246f06-e2cd-4d93-a71e-baabc9fe9674) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30999ddc-9846-4d2b-8725-a4ee73a8eff8', 'volume_name': 'volume-30999ddc-9846-4d2b-8725-a4ee73a8eff8', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:17:20 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3f264200-8e74-4dcb-8a28-e19eec8809c8 tempest-ProjectReaderTests-2023074414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cefa6dba-fb46-4e4b-a440-c59e63b0e475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:17:20 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3f264200-8e74-4dcb-8a28-e19eec8809c8 tempest-ProjectReaderTests-2023074414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cefa6dba-fb46-4e4b-a440-c59e63b0e475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:17:20 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3f264200-8e74-4dcb-8a28-e19eec8809c8 tempest-ProjectReaderTests-2023074414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0173cb3-a0fa-4356-a78d-5b594ad95da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:17:20 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-3f264200-8e74-4dcb-8a28-e19eec8809c8 tempest-ProjectReaderTests-2023074414 None] Volume 30999ddc-9846-4d2b-8725-a4ee73a8eff8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30999ddc-9846-4d2b-8725-a4ee73a8eff8', 'volume_size': 1} Jul 10 10:17:20 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-3f264200-8e74-4dcb-8a28-e19eec8809c8 tempest-ProjectReaderTests-2023074414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:17:20 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-3f264200-8e74-4dcb-8a28-e19eec8809c8 tempest-ProjectReaderTests-2023074414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:17:20 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-3f264200-8e74-4dcb-8a28-e19eec8809c8 tempest-ProjectReaderTests-2023074414 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:17:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1269969535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30999ddc-9846-4d2b-8725-a4ee73a8eff8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3fd2e5ed917444bbfc8266034f1677e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:17:20Z,use_quota=True,user_id='96e3c41b24a64c42b841b4dde10061e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:17:20 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-3f264200-8e74-4dcb-8a28-e19eec8809c8 tempest-ProjectReaderTests-2023074414 None] Creating volume 30999ddc-9846-4d2b-8725-a4ee73a8eff8 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:17:20 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-3f264200-8e74-4dcb-8a28-e19eec8809c8 tempest-ProjectReaderTests-2023074414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:17:20 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-3f264200-8e74-4dcb-8a28-e19eec8809c8 tempest-ProjectReaderTests-2023074414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:17:20 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-3f264200-8e74-4dcb-8a28-e19eec8809c8 tempest-ProjectReaderTests-2023074414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:17:20 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-3f264200-8e74-4dcb-8a28-e19eec8809c8 tempest-ProjectReaderTests-2023074414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:17:20 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-3f264200-8e74-4dcb-8a28-e19eec8809c8 tempest-ProjectReaderTests-2023074414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:17:20 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-3f264200-8e74-4dcb-8a28-e19eec8809c8 tempest-ProjectReaderTests-2023074414 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:17:20 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-3f264200-8e74-4dcb-8a28-e19eec8809c8 tempest-ProjectReaderTests-2023074414 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:17:20 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3f264200-8e74-4dcb-8a28-e19eec8809c8 tempest-ProjectReaderTests-2023074414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-30999ddc-9846-4d2b-8725-a4ee73a8eff8 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:17:20 devstack sudo[100901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-30999ddc-9846-4d2b-8725-a4ee73a8eff8 1073741824 Jul 10 10:17:20 devstack sudo[100901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:17:21 devstack cinder-volume[87234]: DEBUG dbcounter [-] [87234] Writing DB stats cinder:UPDATE=143,cinder:DELETE=12,cinder:SELECT=114,cinder:INSERT=35 {{(pid=87234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 10:17:21 devstack cinder-volume[87234]: DEBUG dbcounter [-] [87234] Writing DB stats cinder:UPDATE=164,cinder:SELECT=104,cinder:INSERT=38,cinder:DELETE=15 {{(pid=87234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 10:17:21 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcba464f-1f9b-40f7-9b11-bed9e86d3cfc tempest-GroupSnapshotsTest-1289579137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:17:21 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-bcba464f-1f9b-40f7-9b11-bed9e86d3cfc tempest-GroupSnapshotsTest-1289579137 None] Flow 'volume_create_manager' (7eed7bb5-55d6-442e-bb4e-aa22b68b128d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:17:21 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-bcba464f-1f9b-40f7-9b11-bed9e86d3cfc tempest-GroupSnapshotsTest-1289579137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (987b063d-5e74-43a1-8da3-8860f3b65a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:17:21 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-bcba464f-1f9b-40f7-9b11-bed9e86d3cfc tempest-GroupSnapshotsTest-1289579137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (987b063d-5e74-43a1-8da3-8860f3b65a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:17:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1864122041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=734e708b-a169-4ad3-8a10-b89b1e506c4a,host='devstack@QuobyteHD#QuobyteHD',id=747605d2-80ea-4b31-9326-9fa2697881bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='097deae9d776484f839e860f9201642c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:17:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:17:21Z,use_quota=True,user_id='b6dd8f50a48f4f01a6a6fab14fe85583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(12a93c1a-9a55-42e9-80bd-27f477bdcc38),volume_type_id=12a93c1a-9a55-42e9-80bd-27f477bdcc38)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:17:21 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-bcba464f-1f9b-40f7-9b11-bed9e86d3cfc tempest-GroupSnapshotsTest-1289579137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8404f8a6-cca6-441f-9a3a-ea623e5d8474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:17:21 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-bcba464f-1f9b-40f7-9b11-bed9e86d3cfc tempest-GroupSnapshotsTest-1289579137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8404f8a6-cca6-441f-9a3a-ea623e5d8474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:17:21 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-bcba464f-1f9b-40f7-9b11-bed9e86d3cfc tempest-GroupSnapshotsTest-1289579137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2886f26-121d-4623-aa5c-3ec2fd42ce40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:17:21 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-bcba464f-1f9b-40f7-9b11-bed9e86d3cfc tempest-GroupSnapshotsTest-1289579137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2886f26-121d-4623-aa5c-3ec2fd42ce40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '747605d2-80ea-4b31-9326-9fa2697881bd', 'volume_name': 'volume-747605d2-80ea-4b31-9326-9fa2697881bd', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:17:21 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-bcba464f-1f9b-40f7-9b11-bed9e86d3cfc tempest-GroupSnapshotsTest-1289579137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (206d99a2-c22c-4705-947d-9a334da6489b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:17:21 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-bcba464f-1f9b-40f7-9b11-bed9e86d3cfc tempest-GroupSnapshotsTest-1289579137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (206d99a2-c22c-4705-947d-9a334da6489b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:17:21 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-bcba464f-1f9b-40f7-9b11-bed9e86d3cfc tempest-GroupSnapshotsTest-1289579137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b3c87f5-57a4-4eb7-8985-4721e8c6a679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:17:21 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-bcba464f-1f9b-40f7-9b11-bed9e86d3cfc tempest-GroupSnapshotsTest-1289579137 None] Volume 747605d2-80ea-4b31-9326-9fa2697881bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-747605d2-80ea-4b31-9326-9fa2697881bd', 'volume_size': 1} Jul 10 10:17:21 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-bcba464f-1f9b-40f7-9b11-bed9e86d3cfc tempest-GroupSnapshotsTest-1289579137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:17:21 devstack sudo[100901]: pam_unix(sudo:session): session closed for user root Jul 10 10:17:21 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3f264200-8e74-4dcb-8a28-e19eec8809c8 tempest-ProjectReaderTests-2023074414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-30999ddc-9846-4d2b-8725-a4ee73a8eff8 1073741824" returned: 0 in 1.354s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:17:21 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3f264200-8e74-4dcb-8a28-e19eec8809c8 tempest-ProjectReaderTests-2023074414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-30999ddc-9846-4d2b-8725-a4ee73a8eff8 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:17:21 devstack sudo[100909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-30999ddc-9846-4d2b-8725-a4ee73a8eff8 Jul 10 10:17:21 devstack sudo[100909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:17:22 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-9002a728-d1eb-4577-a8b8-d6a22d606970 tempest-TestServerVolumeAttachScenarioOldVersion-1739580940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:17:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9002a728-d1eb-4577-a8b8-d6a22d606970 tempest-TestServerVolumeAttachScenarioOldVersion-1739580940 None] Flow 'volume_create_manager' (07d77f64-d0f1-466d-8042-e78a8102f0da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:17:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9002a728-d1eb-4577-a8b8-d6a22d606970 tempest-TestServerVolumeAttachScenarioOldVersion-1739580940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b40322f-9290-494f-8035-a3e736adc6a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:17:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9002a728-d1eb-4577-a8b8-d6a22d606970 tempest-TestServerVolumeAttachScenarioOldVersion-1739580940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b40322f-9290-494f-8035-a3e736adc6a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:17:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-791956456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94a93db5-566a-43fd-8501-7a4d254adc38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c41fe0de2984244a8b2581ccb7887f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:17:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:17:22Z,use_quota=True,user_id='fae7931d51814b3c878ff1d38519f2fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:17:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9002a728-d1eb-4577-a8b8-d6a22d606970 tempest-TestServerVolumeAttachScenarioOldVersion-1739580940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d37bb167-4ada-43e4-91c0-047ef12bd95b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:17:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9002a728-d1eb-4577-a8b8-d6a22d606970 tempest-TestServerVolumeAttachScenarioOldVersion-1739580940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d37bb167-4ada-43e4-91c0-047ef12bd95b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:17:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9002a728-d1eb-4577-a8b8-d6a22d606970 tempest-TestServerVolumeAttachScenarioOldVersion-1739580940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cae4d25-edca-4823-904b-d2525d6b26a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:17:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9002a728-d1eb-4577-a8b8-d6a22d606970 tempest-TestServerVolumeAttachScenarioOldVersion-1739580940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cae4d25-edca-4823-904b-d2525d6b26a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94a93db5-566a-43fd-8501-7a4d254adc38', 'volume_name': 'volume-94a93db5-566a-43fd-8501-7a4d254adc38', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:17:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9002a728-d1eb-4577-a8b8-d6a22d606970 tempest-TestServerVolumeAttachScenarioOldVersion-1739580940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55dcb241-1a77-40c6-b99f-690011fe11ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:17:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9002a728-d1eb-4577-a8b8-d6a22d606970 tempest-TestServerVolumeAttachScenarioOldVersion-1739580940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55dcb241-1a77-40c6-b99f-690011fe11ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:17:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9002a728-d1eb-4577-a8b8-d6a22d606970 tempest-TestServerVolumeAttachScenarioOldVersion-1739580940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6eee32a0-15f9-4b95-b7b7-6453bff0f9ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:17:22 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-9002a728-d1eb-4577-a8b8-d6a22d606970 tempest-TestServerVolumeAttachScenarioOldVersion-1739580940 None] Volume 94a93db5-566a-43fd-8501-7a4d254adc38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94a93db5-566a-43fd-8501-7a4d254adc38', 'volume_size': 1} Jul 10 10:17:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-9002a728-d1eb-4577-a8b8-d6a22d606970 tempest-TestServerVolumeAttachScenarioOldVersion-1739580940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:17:22 devstack sudo[100909]: pam_unix(sudo:session): session closed for user root Jul 10 10:17:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3f264200-8e74-4dcb-8a28-e19eec8809c8 tempest-ProjectReaderTests-2023074414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-30999ddc-9846-4d2b-8725-a4ee73a8eff8" returned: 0 in 0.791s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:17:22 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-3f264200-8e74-4dcb-8a28-e19eec8809c8 tempest-ProjectReaderTests-2023074414 None] <== create_volume: return (2188ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:17:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-3f264200-8e74-4dcb-8a28-e19eec8809c8 tempest-ProjectReaderTests-2023074414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.191s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:17:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-bcba464f-1f9b-40f7-9b11-bed9e86d3cfc tempest-GroupSnapshotsTest-1289579137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.090s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:17:22 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-bcba464f-1f9b-40f7-9b11-bed9e86d3cfc tempest-GroupSnapshotsTest-1289579137 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=734e708b-a169-4ad3-8a10-b89b1e506c4a,created_at=2026-07-10T08:17:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1864122041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=734e708b-a169-4ad3-8a10-b89b1e506c4a,host='devstack@QuobyteHD#QuobyteHD',id=747605d2-80ea-4b31-9326-9fa2697881bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='097deae9d776484f839e860f9201642c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:17:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:17:21Z,use_quota=True,user_id='b6dd8f50a48f4f01a6a6fab14fe85583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(12a93c1a-9a55-42e9-80bd-27f477bdcc38),volume_type_id=12a93c1a-9a55-42e9-80bd-27f477bdcc38)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:17:22 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-bcba464f-1f9b-40f7-9b11-bed9e86d3cfc tempest-GroupSnapshotsTest-1289579137 None] Creating volume 747605d2-80ea-4b31-9326-9fa2697881bd {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:17:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-bcba464f-1f9b-40f7-9b11-bed9e86d3cfc tempest-GroupSnapshotsTest-1289579137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:17:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-bcba464f-1f9b-40f7-9b11-bed9e86d3cfc tempest-GroupSnapshotsTest-1289579137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:17:22 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-bcba464f-1f9b-40f7-9b11-bed9e86d3cfc tempest-GroupSnapshotsTest-1289579137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:17:22 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-bcba464f-1f9b-40f7-9b11-bed9e86d3cfc tempest-GroupSnapshotsTest-1289579137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:17:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-bcba464f-1f9b-40f7-9b11-bed9e86d3cfc tempest-GroupSnapshotsTest-1289579137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:17:22 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-bcba464f-1f9b-40f7-9b11-bed9e86d3cfc tempest-GroupSnapshotsTest-1289579137 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:17:22 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-bcba464f-1f9b-40f7-9b11-bed9e86d3cfc tempest-GroupSnapshotsTest-1289579137 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:17:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-bcba464f-1f9b-40f7-9b11-bed9e86d3cfc tempest-GroupSnapshotsTest-1289579137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-747605d2-80ea-4b31-9326-9fa2697881bd 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:17:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3f264200-8e74-4dcb-8a28-e19eec8809c8 tempest-ProjectReaderTests-2023074414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0173cb3-a0fa-4356-a78d-5b594ad95da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30999ddc-9846-4d2b-8725-a4ee73a8eff8', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:17:22 devstack sudo[100914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-747605d2-80ea-4b31-9326-9fa2697881bd 1073741824 Jul 10 10:17:22 devstack sudo[100914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:17:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3f264200-8e74-4dcb-8a28-e19eec8809c8 tempest-ProjectReaderTests-2023074414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (408cc13d-8767-4b07-8716-f5676813425d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:17:22 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-3f264200-8e74-4dcb-8a28-e19eec8809c8 tempest-ProjectReaderTests-2023074414 None] Volume volume-30999ddc-9846-4d2b-8725-a4ee73a8eff8 (30999ddc-9846-4d2b-8725-a4ee73a8eff8): created successfully Jul 10 10:17:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3f264200-8e74-4dcb-8a28-e19eec8809c8 tempest-ProjectReaderTests-2023074414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (408cc13d-8767-4b07-8716-f5676813425d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:17:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3f264200-8e74-4dcb-8a28-e19eec8809c8 tempest-ProjectReaderTests-2023074414 None] Flow 'volume_create_manager' (32d6bfe6-ab52-4ac8-9f52-8a7c68864c96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:17:22 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-3f264200-8e74-4dcb-8a28-e19eec8809c8 tempest-ProjectReaderTests-2023074414 None] Created volume successfully. Jul 10 10:17:23 devstack sudo[100914]: pam_unix(sudo:session): session closed for user root Jul 10 10:17:23 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-bcba464f-1f9b-40f7-9b11-bed9e86d3cfc tempest-GroupSnapshotsTest-1289579137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-747605d2-80ea-4b31-9326-9fa2697881bd 1073741824" returned: 0 in 0.937s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:17:23 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-bcba464f-1f9b-40f7-9b11-bed9e86d3cfc tempest-GroupSnapshotsTest-1289579137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-747605d2-80ea-4b31-9326-9fa2697881bd {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:17:23 devstack sudo[100920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-747605d2-80ea-4b31-9326-9fa2697881bd Jul 10 10:17:23 devstack sudo[100920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:17:23 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-56723cc1-54a0-47d7-b60a-d7df3d9050c3 tempest-ProjectReaderTests-2023074414 None] Acquiring lock "cinder-30999ddc-9846-4d2b-8725-a4ee73a8eff8-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:17:24 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-56723cc1-54a0-47d7-b60a-d7df3d9050c3 tempest-ProjectReaderTests-2023074414 None] Lock "cinder-30999ddc-9846-4d2b-8725-a4ee73a8eff8-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:17:24 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-56723cc1-54a0-47d7-b60a-d7df3d9050c3 tempest-ProjectReaderTests-2023074414 None] Acquiring lock "cinder-quobyte-30999ddc-9846-4d2b-8725-a4ee73a8eff8" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:17:24 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-56723cc1-54a0-47d7-b60a-d7df3d9050c3 tempest-ProjectReaderTests-2023074414 None] Lock "cinder-quobyte-30999ddc-9846-4d2b-8725-a4ee73a8eff8" acquired by "delete_volume" :: waited 0.020s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:17:24 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1787aaa-c8bb-4124-920e-f3a16db2d771]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:17:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-56723cc1-54a0-47d7-b60a-d7df3d9050c3 tempest-ProjectReaderTests-2023074414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-30999ddc-9846-4d2b-8725-a4ee73a8eff8 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:17:24 devstack sudo[100922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-30999ddc-9846-4d2b-8725-a4ee73a8eff8 Jul 10 10:17:24 devstack sudo[100922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:17:24 devstack sudo[100920]: pam_unix(sudo:session): session closed for user root Jul 10 10:17:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-bcba464f-1f9b-40f7-9b11-bed9e86d3cfc tempest-GroupSnapshotsTest-1289579137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-747605d2-80ea-4b31-9326-9fa2697881bd" returned: 0 in 0.832s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:17:24 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-bcba464f-1f9b-40f7-9b11-bed9e86d3cfc tempest-GroupSnapshotsTest-1289579137 None] <== create_volume: return (1825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:17:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-bcba464f-1f9b-40f7-9b11-bed9e86d3cfc tempest-GroupSnapshotsTest-1289579137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.829s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:17:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-9002a728-d1eb-4577-a8b8-d6a22d606970 tempest-TestServerVolumeAttachScenarioOldVersion-1739580940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.925s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:17:24 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-9002a728-d1eb-4577-a8b8-d6a22d606970 tempest-TestServerVolumeAttachScenarioOldVersion-1739580940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:17:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-791956456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94a93db5-566a-43fd-8501-7a4d254adc38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c41fe0de2984244a8b2581ccb7887f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:17:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:17:22Z,use_quota=True,user_id='fae7931d51814b3c878ff1d38519f2fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:17:24 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-9002a728-d1eb-4577-a8b8-d6a22d606970 tempest-TestServerVolumeAttachScenarioOldVersion-1739580940 None] Creating volume 94a93db5-566a-43fd-8501-7a4d254adc38 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:17:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-9002a728-d1eb-4577-a8b8-d6a22d606970 tempest-TestServerVolumeAttachScenarioOldVersion-1739580940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:17:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-9002a728-d1eb-4577-a8b8-d6a22d606970 tempest-TestServerVolumeAttachScenarioOldVersion-1739580940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:17:24 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-9002a728-d1eb-4577-a8b8-d6a22d606970 tempest-TestServerVolumeAttachScenarioOldVersion-1739580940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:17:24 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-9002a728-d1eb-4577-a8b8-d6a22d606970 tempest-TestServerVolumeAttachScenarioOldVersion-1739580940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:17:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-9002a728-d1eb-4577-a8b8-d6a22d606970 tempest-TestServerVolumeAttachScenarioOldVersion-1739580940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:17:24 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-9002a728-d1eb-4577-a8b8-d6a22d606970 tempest-TestServerVolumeAttachScenarioOldVersion-1739580940 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:17:24 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-9002a728-d1eb-4577-a8b8-d6a22d606970 tempest-TestServerVolumeAttachScenarioOldVersion-1739580940 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:17:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9002a728-d1eb-4577-a8b8-d6a22d606970 tempest-TestServerVolumeAttachScenarioOldVersion-1739580940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94a93db5-566a-43fd-8501-7a4d254adc38 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:17:24 devstack sudo[100925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94a93db5-566a-43fd-8501-7a4d254adc38 1073741824 Jul 10 10:17:24 devstack sudo[100925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:17:24 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-bcba464f-1f9b-40f7-9b11-bed9e86d3cfc tempest-GroupSnapshotsTest-1289579137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b3c87f5-57a4-4eb7-8985-4721e8c6a679) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-747605d2-80ea-4b31-9326-9fa2697881bd', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:17:24 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-bcba464f-1f9b-40f7-9b11-bed9e86d3cfc tempest-GroupSnapshotsTest-1289579137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ce73242-e7ae-4d9a-bb40-5660b124acbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:17:24 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-bcba464f-1f9b-40f7-9b11-bed9e86d3cfc tempest-GroupSnapshotsTest-1289579137 None] Volume volume-747605d2-80ea-4b31-9326-9fa2697881bd (747605d2-80ea-4b31-9326-9fa2697881bd): created successfully Jul 10 10:17:24 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-bcba464f-1f9b-40f7-9b11-bed9e86d3cfc tempest-GroupSnapshotsTest-1289579137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ce73242-e7ae-4d9a-bb40-5660b124acbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:17:24 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-bcba464f-1f9b-40f7-9b11-bed9e86d3cfc tempest-GroupSnapshotsTest-1289579137 None] Flow 'volume_create_manager' (7eed7bb5-55d6-442e-bb4e-aa22b68b128d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:17:24 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-bcba464f-1f9b-40f7-9b11-bed9e86d3cfc tempest-GroupSnapshotsTest-1289579137 None] Created volume successfully. Jul 10 10:17:24 devstack sudo[100922]: pam_unix(sudo:session): session closed for user root Jul 10 10:17:25 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-56723cc1-54a0-47d7-b60a-d7df3d9050c3 tempest-ProjectReaderTests-2023074414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-30999ddc-9846-4d2b-8725-a4ee73a8eff8" returned: 0 in 0.874s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:17:25 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-56723cc1-54a0-47d7-b60a-d7df3d9050c3 tempest-ProjectReaderTests-2023074414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-30999ddc-9846-4d2b-8725-a4ee73a8eff8 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:17:25 devstack sudo[100930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-30999ddc-9846-4d2b-8725-a4ee73a8eff8 Jul 10 10:17:25 devstack sudo[100930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:17:25 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-25c597a8-e880-4fd3-87b4-5593d7f1ecaa tempest-GroupSnapshotsTest-1289579137 None] GroupSnapshot 088ae505-c80b-4e47-b721-f58e70eda72e: creating. Jul 10 10:17:25 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-25c597a8-e880-4fd3-87b4-5593d7f1ecaa tempest-GroupSnapshotsTest-1289579137 None] Group snapshot 088ae505-c80b-4e47-b721-f58e70eda72e: creating. {{(pid=87234) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 10 10:17:25 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-25c597a8-e880-4fd3-87b4-5593d7f1ecaa tempest-GroupSnapshotsTest-1289579137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:17:25 devstack sudo[100925]: pam_unix(sudo:session): session closed for user root Jul 10 10:17:25 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9002a728-d1eb-4577-a8b8-d6a22d606970 tempest-TestServerVolumeAttachScenarioOldVersion-1739580940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94a93db5-566a-43fd-8501-7a4d254adc38 1073741824" returned: 0 in 1.020s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:17:25 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9002a728-d1eb-4577-a8b8-d6a22d606970 tempest-TestServerVolumeAttachScenarioOldVersion-1739580940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94a93db5-566a-43fd-8501-7a4d254adc38 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:17:25 devstack sudo[100936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94a93db5-566a-43fd-8501-7a4d254adc38 Jul 10 10:17:25 devstack sudo[100936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:17:25 devstack sudo[100930]: pam_unix(sudo:session): session closed for user root Jul 10 10:17:25 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-56723cc1-54a0-47d7-b60a-d7df3d9050c3 tempest-ProjectReaderTests-2023074414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-30999ddc-9846-4d2b-8725-a4ee73a8eff8" returned: 0 in 0.831s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:17:25 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-56723cc1-54a0-47d7-b60a-d7df3d9050c3 tempest-ProjectReaderTests-2023074414 None] Lock "cinder-quobyte-30999ddc-9846-4d2b-8725-a4ee73a8eff8" released by "delete_volume" :: held 1.767s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:17:25 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-56723cc1-54a0-47d7-b60a-d7df3d9050c3 tempest-ProjectReaderTests-2023074414 None] Created reservations ['4e7ec3b7-4b04-42f9-94a0-b44d329e3c8d', '3380ce05-c595-40b3-935e-c15835dd8b0a', '62ae6367-19d0-4211-92c4-31666d5760c7', 'bdbce64f-06b0-4ae0-8b29-8cd8696242ae'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:17:25 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-56723cc1-54a0-47d7-b60a-d7df3d9050c3 tempest-ProjectReaderTests-2023074414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:17:25 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-56723cc1-54a0-47d7-b60a-d7df3d9050c3 tempest-ProjectReaderTests-2023074414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:17:25 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-56723cc1-54a0-47d7-b60a-d7df3d9050c3 tempest-ProjectReaderTests-2023074414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:17:25 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-56723cc1-54a0-47d7-b60a-d7df3d9050c3 tempest-ProjectReaderTests-2023074414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:17:25 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-56723cc1-54a0-47d7-b60a-d7df3d9050c3 tempest-ProjectReaderTests-2023074414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:17:25 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-56723cc1-54a0-47d7-b60a-d7df3d9050c3 tempest-ProjectReaderTests-2023074414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:17:26 devstack sudo[100939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:17:26 devstack sudo[100939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:17:26 devstack sudo[100936]: pam_unix(sudo:session): session closed for user root Jul 10 10:17:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9002a728-d1eb-4577-a8b8-d6a22d606970 tempest-TestServerVolumeAttachScenarioOldVersion-1739580940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94a93db5-566a-43fd-8501-7a4d254adc38" returned: 0 in 0.774s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:17:26 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-9002a728-d1eb-4577-a8b8-d6a22d606970 tempest-TestServerVolumeAttachScenarioOldVersion-1739580940 None] <== create_volume: return (1841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:17:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-9002a728-d1eb-4577-a8b8-d6a22d606970 tempest-TestServerVolumeAttachScenarioOldVersion-1739580940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.844s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:17:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-25c597a8-e880-4fd3-87b4-5593d7f1ecaa tempest-GroupSnapshotsTest-1289579137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.023s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:17:26 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9002a728-d1eb-4577-a8b8-d6a22d606970 tempest-TestServerVolumeAttachScenarioOldVersion-1739580940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6eee32a0-15f9-4b95-b7b7-6453bff0f9ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94a93db5-566a-43fd-8501-7a4d254adc38', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:17:26 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9002a728-d1eb-4577-a8b8-d6a22d606970 tempest-TestServerVolumeAttachScenarioOldVersion-1739580940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a6cc2ff-69db-4275-9bf4-13aca876d0d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:17:26 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-25c597a8-e880-4fd3-87b4-5593d7f1ecaa tempest-GroupSnapshotsTest-1289579137 None] Creating offline snapshot 03d3ffe9-70df-47fe-abf3-35ba3da04ac6 of volume 747605d2-80ea-4b31-9326-9fa2697881bd {{(pid=87234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 10:17:26 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-9002a728-d1eb-4577-a8b8-d6a22d606970 tempest-TestServerVolumeAttachScenarioOldVersion-1739580940 None] Volume volume-94a93db5-566a-43fd-8501-7a4d254adc38 (94a93db5-566a-43fd-8501-7a4d254adc38): created successfully Jul 10 10:17:26 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9002a728-d1eb-4577-a8b8-d6a22d606970 tempest-TestServerVolumeAttachScenarioOldVersion-1739580940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a6cc2ff-69db-4275-9bf4-13aca876d0d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:17:26 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9002a728-d1eb-4577-a8b8-d6a22d606970 tempest-TestServerVolumeAttachScenarioOldVersion-1739580940 None] Flow 'volume_create_manager' (07d77f64-d0f1-466d-8042-e78a8102f0da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:17:26 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13fcd33-fbd1-4cd3-9176-533d5a325e24]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:17:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-25c597a8-e880-4fd3-87b4-5593d7f1ecaa tempest-GroupSnapshotsTest-1289579137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-747605d2-80ea-4b31-9326-9fa2697881bd {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:17:26 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-9002a728-d1eb-4577-a8b8-d6a22d606970 tempest-TestServerVolumeAttachScenarioOldVersion-1739580940 None] Created volume successfully. Jul 10 10:17:26 devstack sudo[100942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-747605d2-80ea-4b31-9326-9fa2697881bd Jul 10 10:17:26 devstack sudo[100942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:17:26 devstack sudo[100939]: pam_unix(sudo:session): session closed for user root Jul 10 10:17:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-56723cc1-54a0-47d7-b60a-d7df3d9050c3 tempest-ProjectReaderTests-2023074414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.842s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:17:26 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-56723cc1-54a0-47d7-b60a-d7df3d9050c3 tempest-ProjectReaderTests-2023074414 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:17:26 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-56723cc1-54a0-47d7-b60a-d7df3d9050c3 tempest-ProjectReaderTests-2023074414 None] Deleted volume successfully. Jul 10 10:17:26 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-56723cc1-54a0-47d7-b60a-d7df3d9050c3 tempest-ProjectReaderTests-2023074414 None] Lock "cinder-30999ddc-9846-4d2b-8725-a4ee73a8eff8-delete_volume" released by "delete_volume" :: held 2.867s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:17:27 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b6e86ad-483e-4680-b78c-d44788b689c4 tempest-ProjectReaderTests-2023074414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:17:27 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3b6e86ad-483e-4680-b78c-d44788b689c4 tempest-ProjectReaderTests-2023074414 None] Flow 'volume_create_manager' (0a226ecb-d6c9-4359-a37a-d75d33c22062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:17:27 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3b6e86ad-483e-4680-b78c-d44788b689c4 tempest-ProjectReaderTests-2023074414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77299ead-34a2-400b-b1c5-778f2df3fc52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:17:27 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3b6e86ad-483e-4680-b78c-d44788b689c4 tempest-ProjectReaderTests-2023074414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77299ead-34a2-400b-b1c5-778f2df3fc52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:17:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-235583622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af916920-8023-4de6-85e4-2bb442de5480,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3fd2e5ed917444bbfc8266034f1677e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:17:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:17:27Z,use_quota=True,user_id='96e3c41b24a64c42b841b4dde10061e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:17:27 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3b6e86ad-483e-4680-b78c-d44788b689c4 tempest-ProjectReaderTests-2023074414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae9228be-39aa-4e87-8644-63af364b7abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:17:27 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3b6e86ad-483e-4680-b78c-d44788b689c4 tempest-ProjectReaderTests-2023074414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae9228be-39aa-4e87-8644-63af364b7abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:17:27 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3b6e86ad-483e-4680-b78c-d44788b689c4 tempest-ProjectReaderTests-2023074414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (059fe595-705c-4ea2-bc0f-610766e8f0b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:17:27 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3b6e86ad-483e-4680-b78c-d44788b689c4 tempest-ProjectReaderTests-2023074414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (059fe595-705c-4ea2-bc0f-610766e8f0b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af916920-8023-4de6-85e4-2bb442de5480', 'volume_name': 'volume-af916920-8023-4de6-85e4-2bb442de5480', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:17:27 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3b6e86ad-483e-4680-b78c-d44788b689c4 tempest-ProjectReaderTests-2023074414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32684f5f-5721-4660-806b-02d900b9187c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:17:27 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3b6e86ad-483e-4680-b78c-d44788b689c4 tempest-ProjectReaderTests-2023074414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32684f5f-5721-4660-806b-02d900b9187c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:17:27 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3b6e86ad-483e-4680-b78c-d44788b689c4 tempest-ProjectReaderTests-2023074414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b85ab8da-a874-4af0-977f-c91fc2a87b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:17:27 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-3b6e86ad-483e-4680-b78c-d44788b689c4 tempest-ProjectReaderTests-2023074414 None] Volume af916920-8023-4de6-85e4-2bb442de5480: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af916920-8023-4de6-85e4-2bb442de5480', 'volume_size': 1} Jul 10 10:17:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-3b6e86ad-483e-4680-b78c-d44788b689c4 tempest-ProjectReaderTests-2023074414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:17:27 devstack sudo[100942]: pam_unix(sudo:session): session closed for user root Jul 10 10:17:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-25c597a8-e880-4fd3-87b4-5593d7f1ecaa tempest-GroupSnapshotsTest-1289579137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-747605d2-80ea-4b31-9326-9fa2697881bd" returned: 0 in 0.963s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:17:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-25c597a8-e880-4fd3-87b4-5593d7f1ecaa tempest-GroupSnapshotsTest-1289579137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-747605d2-80ea-4b31-9326-9fa2697881bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-747605d2-80ea-4b31-9326-9fa2697881bd.03d3ffe9-70df-47fe-abf3-35ba3da04ac6 1G {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:17:27 devstack sudo[100952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-747605d2-80ea-4b31-9326-9fa2697881bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-747605d2-80ea-4b31-9326-9fa2697881bd.03d3ffe9-70df-47fe-abf3-35ba3da04ac6 1G Jul 10 10:17:27 devstack sudo[100952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:17:28 devstack sudo[100952]: pam_unix(sudo:session): session closed for user root Jul 10 10:17:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-25c597a8-e880-4fd3-87b4-5593d7f1ecaa tempest-GroupSnapshotsTest-1289579137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-747605d2-80ea-4b31-9326-9fa2697881bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-747605d2-80ea-4b31-9326-9fa2697881bd.03d3ffe9-70df-47fe-abf3-35ba3da04ac6 1G" returned: 0 in 0.897s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:17:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-25c597a8-e880-4fd3-87b4-5593d7f1ecaa tempest-GroupSnapshotsTest-1289579137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-747605d2-80ea-4b31-9326-9fa2697881bd -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-747605d2-80ea-4b31-9326-9fa2697881bd.03d3ffe9-70df-47fe-abf3-35ba3da04ac6 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:17:28 devstack sudo[100957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-747605d2-80ea-4b31-9326-9fa2697881bd -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-747605d2-80ea-4b31-9326-9fa2697881bd.03d3ffe9-70df-47fe-abf3-35ba3da04ac6 Jul 10 10:17:28 devstack sudo[100957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:17:29 devstack sudo[100957]: pam_unix(sudo:session): session closed for user root Jul 10 10:17:29 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-25c597a8-e880-4fd3-87b4-5593d7f1ecaa tempest-GroupSnapshotsTest-1289579137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-747605d2-80ea-4b31-9326-9fa2697881bd -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-747605d2-80ea-4b31-9326-9fa2697881bd.03d3ffe9-70df-47fe-abf3-35ba3da04ac6" returned: 0 in 0.764s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:17:29 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-25c597a8-e880-4fd3-87b4-5593d7f1ecaa tempest-GroupSnapshotsTest-1289579137 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-747605d2-80ea-4b31-9326-9fa2697881bd.03d3ffe9-70df-47fe-abf3-35ba3da04ac6 is being set with open permissions: ugo+rw: NotImplementedError Jul 10 10:17:29 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-25c597a8-e880-4fd3-87b4-5593d7f1ecaa tempest-GroupSnapshotsTest-1289579137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-747605d2-80ea-4b31-9326-9fa2697881bd.03d3ffe9-70df-47fe-abf3-35ba3da04ac6 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:17:29 devstack sudo[100962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-747605d2-80ea-4b31-9326-9fa2697881bd.03d3ffe9-70df-47fe-abf3-35ba3da04ac6 Jul 10 10:17:29 devstack sudo[100962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:17:29 devstack sudo[100962]: pam_unix(sudo:session): session closed for user root Jul 10 10:17:29 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-25c597a8-e880-4fd3-87b4-5593d7f1ecaa tempest-GroupSnapshotsTest-1289579137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-747605d2-80ea-4b31-9326-9fa2697881bd.03d3ffe9-70df-47fe-abf3-35ba3da04ac6" returned: 0 in 0.702s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:17:29 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-25c597a8-e880-4fd3-87b4-5593d7f1ecaa tempest-GroupSnapshotsTest-1289579137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-747605d2-80ea-4b31-9326-9fa2697881bd.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:17:29 devstack sudo[100972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-747605d2-80ea-4b31-9326-9fa2697881bd.info Jul 10 10:17:29 devstack sudo[100972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:17:29 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-e2bdc6f8-9a51-4e3f-94ae-8d5d09fe80d1 req-f0d7ad74-4f5b-46dc-9575-ff4cde2a9dd1 tempest-TestServerVolumeAttachScenarioOldVersion-1739580940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:17:30 devstack sudo[100972]: pam_unix(sudo:session): session closed for user root Jul 10 10:17:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-25c597a8-e880-4fd3-87b4-5593d7f1ecaa tempest-GroupSnapshotsTest-1289579137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-747605d2-80ea-4b31-9326-9fa2697881bd.info" returned: 0 in 0.667s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:17:30 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-25c597a8-e880-4fd3-87b4-5593d7f1ecaa tempest-GroupSnapshotsTest-1289579137 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-747605d2-80ea-4b31-9326-9fa2697881bd.info is being set with open permissions: ugo+rw: NotImplementedError Jul 10 10:17:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-25c597a8-e880-4fd3-87b4-5593d7f1ecaa tempest-GroupSnapshotsTest-1289579137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-747605d2-80ea-4b31-9326-9fa2697881bd.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:17:30 devstack sudo[100982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-747605d2-80ea-4b31-9326-9fa2697881bd.info Jul 10 10:17:30 devstack sudo[100982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:17:31 devstack sudo[100982]: pam_unix(sudo:session): session closed for user root Jul 10 10:17:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-25c597a8-e880-4fd3-87b4-5593d7f1ecaa tempest-GroupSnapshotsTest-1289579137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-747605d2-80ea-4b31-9326-9fa2697881bd.info" returned: 0 in 0.650s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:17:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-25c597a8-e880-4fd3-87b4-5593d7f1ecaa tempest-GroupSnapshotsTest-1289579137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.780s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:17:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-3b6e86ad-483e-4680-b78c-d44788b689c4 tempest-ProjectReaderTests-2023074414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.049s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:17:31 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-3b6e86ad-483e-4680-b78c-d44788b689c4 tempest-ProjectReaderTests-2023074414 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:17:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-235583622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af916920-8023-4de6-85e4-2bb442de5480,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3fd2e5ed917444bbfc8266034f1677e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:17:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:17:27Z,use_quota=True,user_id='96e3c41b24a64c42b841b4dde10061e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:17:31 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-3b6e86ad-483e-4680-b78c-d44788b689c4 tempest-ProjectReaderTests-2023074414 None] Creating volume af916920-8023-4de6-85e4-2bb442de5480 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:17:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-3b6e86ad-483e-4680-b78c-d44788b689c4 tempest-ProjectReaderTests-2023074414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:17:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-3b6e86ad-483e-4680-b78c-d44788b689c4 tempest-ProjectReaderTests-2023074414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:17:31 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-3b6e86ad-483e-4680-b78c-d44788b689c4 tempest-ProjectReaderTests-2023074414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:17:31 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-3b6e86ad-483e-4680-b78c-d44788b689c4 tempest-ProjectReaderTests-2023074414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:17:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-3b6e86ad-483e-4680-b78c-d44788b689c4 tempest-ProjectReaderTests-2023074414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:17:31 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-3b6e86ad-483e-4680-b78c-d44788b689c4 tempest-ProjectReaderTests-2023074414 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:17:31 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-3b6e86ad-483e-4680-b78c-d44788b689c4 tempest-ProjectReaderTests-2023074414 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:17:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3b6e86ad-483e-4680-b78c-d44788b689c4 tempest-ProjectReaderTests-2023074414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-af916920-8023-4de6-85e4-2bb442de5480 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:17:31 devstack sudo[100985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-af916920-8023-4de6-85e4-2bb442de5480 1073741824 Jul 10 10:17:31 devstack sudo[100985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:17:31 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-25c597a8-e880-4fd3-87b4-5593d7f1ecaa tempest-GroupSnapshotsTest-1289579137 None] group_snapshot 088ae505-c80b-4e47-b721-f58e70eda72e: created successfully Jul 10 10:17:32 devstack sudo[100985]: pam_unix(sudo:session): session closed for user root Jul 10 10:17:32 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3b6e86ad-483e-4680-b78c-d44788b689c4 tempest-ProjectReaderTests-2023074414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-af916920-8023-4de6-85e4-2bb442de5480 1073741824" returned: 0 in 0.854s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:17:32 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3b6e86ad-483e-4680-b78c-d44788b689c4 tempest-ProjectReaderTests-2023074414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-af916920-8023-4de6-85e4-2bb442de5480 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:17:32 devstack sudo[100990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-af916920-8023-4de6-85e4-2bb442de5480 Jul 10 10:17:32 devstack sudo[100990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:17:32 devstack sudo[100990]: pam_unix(sudo:session): session closed for user root Jul 10 10:17:32 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3b6e86ad-483e-4680-b78c-d44788b689c4 tempest-ProjectReaderTests-2023074414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-af916920-8023-4de6-85e4-2bb442de5480" returned: 0 in 0.649s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:17:32 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-3b6e86ad-483e-4680-b78c-d44788b689c4 tempest-ProjectReaderTests-2023074414 None] <== create_volume: return (1538ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:17:32 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-3b6e86ad-483e-4680-b78c-d44788b689c4 tempest-ProjectReaderTests-2023074414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.543s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:17:32 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-e2bdc6f8-9a51-4e3f-94ae-8d5d09fe80d1 req-f0d7ad74-4f5b-46dc-9575-ff4cde2a9dd1 tempest-TestServerVolumeAttachScenarioOldVersion-1739580940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.751s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:17:32 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3b6e86ad-483e-4680-b78c-d44788b689c4 tempest-ProjectReaderTests-2023074414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b85ab8da-a874-4af0-977f-c91fc2a87b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af916920-8023-4de6-85e4-2bb442de5480', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:17:32 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3b6e86ad-483e-4680-b78c-d44788b689c4 tempest-ProjectReaderTests-2023074414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (034aa909-e892-4c60-be91-0be9d7250c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:17:32 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac32e53-fa63-4adf-8d3c-44e416fdafa7]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:17:32 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-e2bdc6f8-9a51-4e3f-94ae-8d5d09fe80d1 req-f0d7ad74-4f5b-46dc-9575-ff4cde2a9dd1 tempest-TestServerVolumeAttachScenarioOldVersion-1739580940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94a93db5-566a-43fd-8501-7a4d254adc38 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:17:32 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-3b6e86ad-483e-4680-b78c-d44788b689c4 tempest-ProjectReaderTests-2023074414 None] Volume volume-af916920-8023-4de6-85e4-2bb442de5480 (af916920-8023-4de6-85e4-2bb442de5480): created successfully Jul 10 10:17:32 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3b6e86ad-483e-4680-b78c-d44788b689c4 tempest-ProjectReaderTests-2023074414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (034aa909-e892-4c60-be91-0be9d7250c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:17:32 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3b6e86ad-483e-4680-b78c-d44788b689c4 tempest-ProjectReaderTests-2023074414 None] Flow 'volume_create_manager' (0a226ecb-d6c9-4359-a37a-d75d33c22062) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:17:32 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-3b6e86ad-483e-4680-b78c-d44788b689c4 tempest-ProjectReaderTests-2023074414 None] Created volume successfully. Jul 10 10:17:32 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-90757aef-2112-46e9-b722-fcc995a20121 tempest-GroupSnapshotsTest-1289579137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:17:32 devstack sudo[100993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94a93db5-566a-43fd-8501-7a4d254adc38 Jul 10 10:17:32 devstack sudo[100993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:17:33 devstack sudo[100993]: pam_unix(sudo:session): session closed for user root Jul 10 10:17:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-e2bdc6f8-9a51-4e3f-94ae-8d5d09fe80d1 req-f0d7ad74-4f5b-46dc-9575-ff4cde2a9dd1 tempest-TestServerVolumeAttachScenarioOldVersion-1739580940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94a93db5-566a-43fd-8501-7a4d254adc38" returned: 0 in 0.808s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:17:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-e2bdc6f8-9a51-4e3f-94ae-8d5d09fe80d1 req-f0d7ad74-4f5b-46dc-9575-ff4cde2a9dd1 tempest-TestServerVolumeAttachScenarioOldVersion-1739580940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.849s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:17:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-90757aef-2112-46e9-b722-fcc995a20121 tempest-GroupSnapshotsTest-1289579137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.689s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:17:33 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-90757aef-2112-46e9-b722-fcc995a20121 tempest-GroupSnapshotsTest-1289579137 None] Acquiring lock "cinder-quobyte-03d3ffe9-70df-47fe-abf3-35ba3da04ac6-901277e2-6493-436f-96a0-0c3314fe2d6f" by "_create_volume_from_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:17:33 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-90757aef-2112-46e9-b722-fcc995a20121 tempest-GroupSnapshotsTest-1289579137 None] Lock "cinder-quobyte-03d3ffe9-70df-47fe-abf3-35ba3da04ac6-901277e2-6493-436f-96a0-0c3314fe2d6f" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:17:33 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-90757aef-2112-46e9-b722-fcc995a20121 tempest-GroupSnapshotsTest-1289579137 None] Creating volume 901277e2-6493-436f-96a0-0c3314fe2d6f from snapshot 03d3ffe9-70df-47fe-abf3-35ba3da04ac6 {{(pid=87234) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 10:17:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-90757aef-2112-46e9-b722-fcc995a20121 tempest-GroupSnapshotsTest-1289579137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:17:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-90757aef-2112-46e9-b722-fcc995a20121 tempest-GroupSnapshotsTest-1289579137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:17:33 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-90757aef-2112-46e9-b722-fcc995a20121 tempest-GroupSnapshotsTest-1289579137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:17:33 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-90757aef-2112-46e9-b722-fcc995a20121 tempest-GroupSnapshotsTest-1289579137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:17:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-90757aef-2112-46e9-b722-fcc995a20121 tempest-GroupSnapshotsTest-1289579137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:17:33 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-90757aef-2112-46e9-b722-fcc995a20121 tempest-GroupSnapshotsTest-1289579137 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:17:33 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-90757aef-2112-46e9-b722-fcc995a20121 tempest-GroupSnapshotsTest-1289579137 None] Acquiring lock "cinder-quobyte-901277e2-6493-436f-96a0-0c3314fe2d6f" by "_copy_volume_from_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:17:33 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-90757aef-2112-46e9-b722-fcc995a20121 tempest-GroupSnapshotsTest-1289579137 None] Lock "cinder-quobyte-901277e2-6493-436f-96a0-0c3314fe2d6f" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:17:33 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-90757aef-2112-46e9-b722-fcc995a20121 tempest-GroupSnapshotsTest-1289579137 None] snapshot: 03d3ffe9-70df-47fe-abf3-35ba3da04ac6, volume: 901277e2-6493-436f-96a0-0c3314fe2d6f, {{(pid=87234) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 10:17:33 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [req-e2bdc6f8-9a51-4e3f-94ae-8d5d09fe80d1 req-f0d7ad74-4f5b-46dc-9575-ff4cde2a9dd1 tempest-TestServerVolumeAttachScenarioOldVersion-1739580940 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091', 'name': 'volume-94a93db5-566a-43fd-8501-7a4d254adc38', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '62530732-e22d-48f1-9cfe-f89e13f3c3df', 'enforce_multipath': True} {{(pid=87234) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 10:17:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-90757aef-2112-46e9-b722-fcc995a20121 tempest-GroupSnapshotsTest-1289579137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:17:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-90757aef-2112-46e9-b722-fcc995a20121 tempest-GroupSnapshotsTest-1289579137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:17:33 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-90757aef-2112-46e9-b722-fcc995a20121 tempest-GroupSnapshotsTest-1289579137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:17:33 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-90757aef-2112-46e9-b722-fcc995a20121 tempest-GroupSnapshotsTest-1289579137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:17:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-90757aef-2112-46e9-b722-fcc995a20121 tempest-GroupSnapshotsTest-1289579137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:17:33 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4c8b76-ed25-4f22-a4cc-4dfbd18641f4]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:17:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-90757aef-2112-46e9-b722-fcc995a20121 tempest-GroupSnapshotsTest-1289579137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-747605d2-80ea-4b31-9326-9fa2697881bd.03d3ffe9-70df-47fe-abf3-35ba3da04ac6 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:17:33 devstack cinder-volume[87234]: INFO cinder.volume.manager [req-e2bdc6f8-9a51-4e3f-94ae-8d5d09fe80d1 req-f0d7ad74-4f5b-46dc-9575-ff4cde2a9dd1 tempest-TestServerVolumeAttachScenarioOldVersion-1739580940 None] attachment_update completed successfully. Jul 10 10:17:33 devstack sudo[100998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-747605d2-80ea-4b31-9326-9fa2697881bd.03d3ffe9-70df-47fe-abf3-35ba3da04ac6 Jul 10 10:17:33 devstack sudo[100998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:17:34 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-70899ef5-a762-4394-ad9d-83afb17eb392 tempest-ProjectReaderTests-2023074414 None] Acquiring lock "cinder-af916920-8023-4de6-85e4-2bb442de5480-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:17:34 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-70899ef5-a762-4394-ad9d-83afb17eb392 tempest-ProjectReaderTests-2023074414 None] Lock "cinder-af916920-8023-4de6-85e4-2bb442de5480-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:17:34 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-70899ef5-a762-4394-ad9d-83afb17eb392 tempest-ProjectReaderTests-2023074414 None] Acquiring lock "cinder-quobyte-af916920-8023-4de6-85e4-2bb442de5480" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:17:34 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-70899ef5-a762-4394-ad9d-83afb17eb392 tempest-ProjectReaderTests-2023074414 None] Lock "cinder-quobyte-af916920-8023-4de6-85e4-2bb442de5480" acquired by "delete_volume" :: waited 0.022s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:17:34 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[0729ff04-2bca-4d68-ba33-9da56910fd88]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:17:34 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-70899ef5-a762-4394-ad9d-83afb17eb392 tempest-ProjectReaderTests-2023074414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-af916920-8023-4de6-85e4-2bb442de5480 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:17:34 devstack sudo[101064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-af916920-8023-4de6-85e4-2bb442de5480 Jul 10 10:17:34 devstack sudo[101064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:17:34 devstack sudo[100998]: pam_unix(sudo:session): session closed for user root Jul 10 10:17:34 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-90757aef-2112-46e9-b722-fcc995a20121 tempest-GroupSnapshotsTest-1289579137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-747605d2-80ea-4b31-9326-9fa2697881bd.03d3ffe9-70df-47fe-abf3-35ba3da04ac6" returned: 0 in 0.826s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:17:34 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-90757aef-2112-46e9-b722-fcc995a20121 tempest-GroupSnapshotsTest-1289579137 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-747605d2-80ea-4b31-9326-9fa2697881bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 10:17:34 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-90757aef-2112-46e9-b722-fcc995a20121 tempest-GroupSnapshotsTest-1289579137 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-747605d2-80ea-4b31-9326-9fa2697881bd {{(pid=87234) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 10:17:34 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-90757aef-2112-46e9-b722-fcc995a20121 tempest-GroupSnapshotsTest-1289579137 None] Creating direct copy from snapshot {{(pid=87234) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 10:17:34 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b844692-7f2e-4f6b-8f34-12cfedc81486]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:17:34 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-90757aef-2112-46e9-b722-fcc995a20121 tempest-GroupSnapshotsTest-1289579137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-747605d2-80ea-4b31-9326-9fa2697881bd {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:17:34 devstack sudo[101072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-747605d2-80ea-4b31-9326-9fa2697881bd Jul 10 10:17:34 devstack sudo[101072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:17:34 devstack sudo[101064]: pam_unix(sudo:session): session closed for user root Jul 10 10:17:34 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-70899ef5-a762-4394-ad9d-83afb17eb392 tempest-ProjectReaderTests-2023074414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-af916920-8023-4de6-85e4-2bb442de5480" returned: 0 in 0.829s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:17:34 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-70899ef5-a762-4394-ad9d-83afb17eb392 tempest-ProjectReaderTests-2023074414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-af916920-8023-4de6-85e4-2bb442de5480 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:17:35 devstack sudo[101394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-af916920-8023-4de6-85e4-2bb442de5480 Jul 10 10:17:35 devstack sudo[101394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:17:35 devstack sudo[101072]: pam_unix(sudo:session): session closed for user root Jul 10 10:17:35 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-90757aef-2112-46e9-b722-fcc995a20121 tempest-GroupSnapshotsTest-1289579137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-747605d2-80ea-4b31-9326-9fa2697881bd" returned: 0 in 0.836s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:17:35 devstack cinder-volume[87234]: DEBUG cinder.utils [None req-90757aef-2112-46e9-b722-fcc995a20121 tempest-GroupSnapshotsTest-1289579137 None] Path /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-901277e2-6493-436f-96a0-0c3314fe2d6f not found in is_blk_device check {{(pid=87234) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 10:17:35 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-90757aef-2112-46e9-b722-fcc995a20121 tempest-GroupSnapshotsTest-1289579137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-747605d2-80ea-4b31-9326-9fa2697881bd /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-901277e2-6493-436f-96a0-0c3314fe2d6f {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:17:35 devstack sudo[101399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-747605d2-80ea-4b31-9326-9fa2697881bd /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-901277e2-6493-436f-96a0-0c3314fe2d6f Jul 10 10:17:35 devstack sudo[101399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:17:35 devstack sudo[101394]: pam_unix(sudo:session): session closed for user root Jul 10 10:17:35 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-70899ef5-a762-4394-ad9d-83afb17eb392 tempest-ProjectReaderTests-2023074414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-af916920-8023-4de6-85e4-2bb442de5480" returned: 0 in 0.668s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:17:35 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-70899ef5-a762-4394-ad9d-83afb17eb392 tempest-ProjectReaderTests-2023074414 None] Lock "cinder-quobyte-af916920-8023-4de6-85e4-2bb442de5480" released by "delete_volume" :: held 1.555s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:17:35 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-70899ef5-a762-4394-ad9d-83afb17eb392 tempest-ProjectReaderTests-2023074414 None] Created reservations ['da5ea287-4b5f-4a75-beda-d4c98320e533', 'fc9b049c-accf-452c-8add-b95c6baa3990', '7a21909c-a971-4f5c-80d8-e673b5469110', '36c97246-e786-4762-a514-9ddcfd0d83f4'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:17:35 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-70899ef5-a762-4394-ad9d-83afb17eb392 tempest-ProjectReaderTests-2023074414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:17:35 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-70899ef5-a762-4394-ad9d-83afb17eb392 tempest-ProjectReaderTests-2023074414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:17:35 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-70899ef5-a762-4394-ad9d-83afb17eb392 tempest-ProjectReaderTests-2023074414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:17:35 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-70899ef5-a762-4394-ad9d-83afb17eb392 tempest-ProjectReaderTests-2023074414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:17:35 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-70899ef5-a762-4394-ad9d-83afb17eb392 tempest-ProjectReaderTests-2023074414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:17:35 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-70899ef5-a762-4394-ad9d-83afb17eb392 tempest-ProjectReaderTests-2023074414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:17:35 devstack sudo[101402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:17:35 devstack sudo[101402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:17:36 devstack sudo[101402]: pam_unix(sudo:session): session closed for user root Jul 10 10:17:36 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-70899ef5-a762-4394-ad9d-83afb17eb392 tempest-ProjectReaderTests-2023074414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 1.056s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:17:36 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-70899ef5-a762-4394-ad9d-83afb17eb392 tempest-ProjectReaderTests-2023074414 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:17:36 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-70899ef5-a762-4394-ad9d-83afb17eb392 tempest-ProjectReaderTests-2023074414 None] Deleted volume successfully. Jul 10 10:17:36 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-70899ef5-a762-4394-ad9d-83afb17eb392 tempest-ProjectReaderTests-2023074414 None] Lock "cinder-af916920-8023-4de6-85e4-2bb442de5480-delete_volume" released by "delete_volume" :: held 2.884s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:17:37 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff87d84a-84bd-4b1a-b8a3-691f13bd0c1d tempest-ProjectReaderTests-2023074414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:17:37 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ff87d84a-84bd-4b1a-b8a3-691f13bd0c1d tempest-ProjectReaderTests-2023074414 None] Flow 'volume_create_manager' (557f3c07-c04c-449e-9324-b486bad214b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:17:37 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ff87d84a-84bd-4b1a-b8a3-691f13bd0c1d tempest-ProjectReaderTests-2023074414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6436704-d4be-4aad-a967-180c14780837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:17:37 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ff87d84a-84bd-4b1a-b8a3-691f13bd0c1d tempest-ProjectReaderTests-2023074414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6436704-d4be-4aad-a967-180c14780837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:17:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2040288595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acac0f02-ad84-435d-8535-4b95cf3896ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3fd2e5ed917444bbfc8266034f1677e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:17:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:17:37Z,use_quota=True,user_id='96e3c41b24a64c42b841b4dde10061e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:17:37 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ff87d84a-84bd-4b1a-b8a3-691f13bd0c1d tempest-ProjectReaderTests-2023074414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee34f130-cebe-4dfd-8e46-09eebc144a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:17:37 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ff87d84a-84bd-4b1a-b8a3-691f13bd0c1d tempest-ProjectReaderTests-2023074414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee34f130-cebe-4dfd-8e46-09eebc144a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:17:37 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ff87d84a-84bd-4b1a-b8a3-691f13bd0c1d tempest-ProjectReaderTests-2023074414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34866f34-150d-4989-b14d-3ef8f007008e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:17:37 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ff87d84a-84bd-4b1a-b8a3-691f13bd0c1d tempest-ProjectReaderTests-2023074414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34866f34-150d-4989-b14d-3ef8f007008e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acac0f02-ad84-435d-8535-4b95cf3896ee', 'volume_name': 'volume-acac0f02-ad84-435d-8535-4b95cf3896ee', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:17:37 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ff87d84a-84bd-4b1a-b8a3-691f13bd0c1d tempest-ProjectReaderTests-2023074414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8c567b5-57f8-4356-9faa-8b4280665a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:17:37 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ff87d84a-84bd-4b1a-b8a3-691f13bd0c1d tempest-ProjectReaderTests-2023074414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8c567b5-57f8-4356-9faa-8b4280665a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:17:37 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ff87d84a-84bd-4b1a-b8a3-691f13bd0c1d tempest-ProjectReaderTests-2023074414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71cc8372-a90d-4b3b-98e9-ca7ca72852af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:17:37 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-ff87d84a-84bd-4b1a-b8a3-691f13bd0c1d tempest-ProjectReaderTests-2023074414 None] Volume acac0f02-ad84-435d-8535-4b95cf3896ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acac0f02-ad84-435d-8535-4b95cf3896ee', 'volume_size': 1} Jul 10 10:17:37 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-ff87d84a-84bd-4b1a-b8a3-691f13bd0c1d tempest-ProjectReaderTests-2023074414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:17:40 devstack sudo[101399]: pam_unix(sudo:session): session closed for user root Jul 10 10:17:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-90757aef-2112-46e9-b722-fcc995a20121 tempest-GroupSnapshotsTest-1289579137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-747605d2-80ea-4b31-9326-9fa2697881bd /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-901277e2-6493-436f-96a0-0c3314fe2d6f" returned: 0 in 5.537s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:17:40 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d6de2ec-d29a-4172-9aa2-f8212738b14e]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:17:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-90757aef-2112-46e9-b722-fcc995a20121 tempest-GroupSnapshotsTest-1289579137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-747605d2-80ea-4b31-9326-9fa2697881bd {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:17:40 devstack sudo[101417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-747605d2-80ea-4b31-9326-9fa2697881bd Jul 10 10:17:40 devstack sudo[101417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:17:41 devstack sudo[101417]: pam_unix(sudo:session): session closed for user root Jul 10 10:17:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-90757aef-2112-46e9-b722-fcc995a20121 tempest-GroupSnapshotsTest-1289579137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-747605d2-80ea-4b31-9326-9fa2697881bd" returned: 0 in 0.939s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:17:41 devstack cinder-volume[87234]: DEBUG cinder.image.image_utils [None req-90757aef-2112-46e9-b722-fcc995a20121 tempest-GroupSnapshotsTest-1289579137 None] Image conversion details: src /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-747605d2-80ea-4b31-9326-9fa2697881bd, size 1024.00 MB, duration 5.54 sec, destination /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-901277e2-6493-436f-96a0-0c3314fe2d6f {{(pid=87234) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 10:17:41 devstack cinder-volume[87234]: INFO cinder.image.image_utils [None req-90757aef-2112-46e9-b722-fcc995a20121 tempest-GroupSnapshotsTest-1289579137 None] Converted 1024.00 MB image at 184.89 MB/s Jul 10 10:17:41 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-90757aef-2112-46e9-b722-fcc995a20121 tempest-GroupSnapshotsTest-1289579137 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-901277e2-6493-436f-96a0-0c3314fe2d6f is being set with open permissions: ugo+rw: NotImplementedError Jul 10 10:17:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-90757aef-2112-46e9-b722-fcc995a20121 tempest-GroupSnapshotsTest-1289579137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-901277e2-6493-436f-96a0-0c3314fe2d6f {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:17:41 devstack sudo[101422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-901277e2-6493-436f-96a0-0c3314fe2d6f Jul 10 10:17:41 devstack sudo[101422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:17:42 devstack cinder-volume[87234]: DEBUG oslo_service.periodic_task [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 10:17:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:17:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:17:42 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:17:42 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:17:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:17:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:17:42 devstack sudo[101426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:17:42 devstack sudo[101426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:17:42 devstack cinder-volume[87234]: INFO cinder.volume.manager [req-7b9c6fab-bd10-4e88-985e-6134189a8d70 req-375812d6-c751-4167-aed3-9a6dd9a240db tempest-TestServerVolumeAttachScenarioOldVersion-1739580940 None] Terminate volume connection completed successfully. Jul 10 10:17:42 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [req-7b9c6fab-bd10-4e88-985e-6134189a8d70 req-375812d6-c751-4167-aed3-9a6dd9a240db tempest-TestServerVolumeAttachScenarioOldVersion-1739580940 None] Deleting attachment 62530732-e22d-48f1-9cfe-f89e13f3c3df. {{(pid=87234) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 10:17:42 devstack sudo[101422]: pam_unix(sudo:session): session closed for user root Jul 10 10:17:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-90757aef-2112-46e9-b722-fcc995a20121 tempest-GroupSnapshotsTest-1289579137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-901277e2-6493-436f-96a0-0c3314fe2d6f" returned: 0 in 0.702s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:17:42 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-90757aef-2112-46e9-b722-fcc995a20121 tempest-GroupSnapshotsTest-1289579137 None] Lock "cinder-quobyte-901277e2-6493-436f-96a0-0c3314fe2d6f" released by "_copy_volume_from_snapshot" :: held 8.946s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:17:42 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-90757aef-2112-46e9-b722-fcc995a20121 tempest-GroupSnapshotsTest-1289579137 None] Lock "cinder-quobyte-03d3ffe9-70df-47fe-abf3-35ba3da04ac6-901277e2-6493-436f-96a0-0c3314fe2d6f" released by "_create_volume_from_snapshot" :: held 8.980s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:17:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-90757aef-2112-46e9-b722-fcc995a20121 tempest-GroupSnapshotsTest-1289579137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.003s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:17:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-ff87d84a-84bd-4b1a-b8a3-691f13bd0c1d tempest-ProjectReaderTests-2023074414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.022s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:17:42 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-ff87d84a-84bd-4b1a-b8a3-691f13bd0c1d tempest-ProjectReaderTests-2023074414 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:17:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2040288595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acac0f02-ad84-435d-8535-4b95cf3896ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3fd2e5ed917444bbfc8266034f1677e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:17:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:17:37Z,use_quota=True,user_id='96e3c41b24a64c42b841b4dde10061e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:17:42 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-ff87d84a-84bd-4b1a-b8a3-691f13bd0c1d tempest-ProjectReaderTests-2023074414 None] Creating volume acac0f02-ad84-435d-8535-4b95cf3896ee {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:17:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-ff87d84a-84bd-4b1a-b8a3-691f13bd0c1d tempest-ProjectReaderTests-2023074414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:17:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-ff87d84a-84bd-4b1a-b8a3-691f13bd0c1d tempest-ProjectReaderTests-2023074414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:17:42 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-ff87d84a-84bd-4b1a-b8a3-691f13bd0c1d tempest-ProjectReaderTests-2023074414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:17:42 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-ff87d84a-84bd-4b1a-b8a3-691f13bd0c1d tempest-ProjectReaderTests-2023074414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:17:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-ff87d84a-84bd-4b1a-b8a3-691f13bd0c1d tempest-ProjectReaderTests-2023074414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:17:42 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-ff87d84a-84bd-4b1a-b8a3-691f13bd0c1d tempest-ProjectReaderTests-2023074414 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:17:42 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-ff87d84a-84bd-4b1a-b8a3-691f13bd0c1d tempest-ProjectReaderTests-2023074414 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:17:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ff87d84a-84bd-4b1a-b8a3-691f13bd0c1d tempest-ProjectReaderTests-2023074414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-acac0f02-ad84-435d-8535-4b95cf3896ee 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:17:42 devstack sudo[101455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-acac0f02-ad84-435d-8535-4b95cf3896ee 1073741824 Jul 10 10:17:42 devstack sudo[101455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:17:42 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-90757aef-2112-46e9-b722-fcc995a20121 tempest-GroupSnapshotsTest-1289579137 None] Create group from source-snapshot-088ae505-c80b-4e47-b721-f58e70eda72e completed successfully. Jul 10 10:17:42 devstack sudo[101426]: pam_unix(sudo:session): session closed for user root Jul 10 10:17:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.738s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:17:42 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:17:42 devstack cinder-volume[87234]: DEBUG oslo_service.periodic_task [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Running periodic task VolumeManager._thread_info {{(pid=87234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 10:17:42 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] thread count: 28 {{(pid=87234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 10:17:42 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] thread info: [<_MainThread(MainThread, started 131600773742720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 10:17:43 devstack sudo[101455]: pam_unix(sudo:session): session closed for user root Jul 10 10:17:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ff87d84a-84bd-4b1a-b8a3-691f13bd0c1d tempest-ProjectReaderTests-2023074414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-acac0f02-ad84-435d-8535-4b95cf3896ee 1073741824" returned: 0 in 0.849s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:17:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ff87d84a-84bd-4b1a-b8a3-691f13bd0c1d tempest-ProjectReaderTests-2023074414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-acac0f02-ad84-435d-8535-4b95cf3896ee {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:17:43 devstack sudo[101462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-acac0f02-ad84-435d-8535-4b95cf3896ee Jul 10 10:17:43 devstack sudo[101462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:17:43 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-3b3574eb-666c-41e8-acb1-35534deec59d tempest-GroupSnapshotsTest-1289579137 None] Acquiring lock "cinder-quobyte-901277e2-6493-436f-96a0-0c3314fe2d6f" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:17:43 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-3b3574eb-666c-41e8-acb1-35534deec59d tempest-GroupSnapshotsTest-1289579137 None] Lock "cinder-quobyte-901277e2-6493-436f-96a0-0c3314fe2d6f" acquired by "delete_volume" :: waited 0.023s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:17:43 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[afef8ea7-5495-4b91-9ee5-769a7249486c]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:17:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3b3574eb-666c-41e8-acb1-35534deec59d tempest-GroupSnapshotsTest-1289579137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-901277e2-6493-436f-96a0-0c3314fe2d6f {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:17:44 devstack sudo[101464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-901277e2-6493-436f-96a0-0c3314fe2d6f Jul 10 10:17:44 devstack sudo[101464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:17:44 devstack sudo[101462]: pam_unix(sudo:session): session closed for user root Jul 10 10:17:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ff87d84a-84bd-4b1a-b8a3-691f13bd0c1d tempest-ProjectReaderTests-2023074414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-acac0f02-ad84-435d-8535-4b95cf3896ee" returned: 0 in 0.675s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:17:44 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-ff87d84a-84bd-4b1a-b8a3-691f13bd0c1d tempest-ProjectReaderTests-2023074414 None] <== create_volume: return (1565ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:17:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-ff87d84a-84bd-4b1a-b8a3-691f13bd0c1d tempest-ProjectReaderTests-2023074414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.569s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:17:44 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ff87d84a-84bd-4b1a-b8a3-691f13bd0c1d tempest-ProjectReaderTests-2023074414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71cc8372-a90d-4b3b-98e9-ca7ca72852af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acac0f02-ad84-435d-8535-4b95cf3896ee', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:17:44 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ff87d84a-84bd-4b1a-b8a3-691f13bd0c1d tempest-ProjectReaderTests-2023074414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3426b282-5f5b-4f20-adc1-4957a72b39b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:17:44 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-ff87d84a-84bd-4b1a-b8a3-691f13bd0c1d tempest-ProjectReaderTests-2023074414 None] Volume volume-acac0f02-ad84-435d-8535-4b95cf3896ee (acac0f02-ad84-435d-8535-4b95cf3896ee): created successfully Jul 10 10:17:44 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ff87d84a-84bd-4b1a-b8a3-691f13bd0c1d tempest-ProjectReaderTests-2023074414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3426b282-5f5b-4f20-adc1-4957a72b39b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:17:44 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ff87d84a-84bd-4b1a-b8a3-691f13bd0c1d tempest-ProjectReaderTests-2023074414 None] Flow 'volume_create_manager' (557f3c07-c04c-449e-9324-b486bad214b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:17:44 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-ff87d84a-84bd-4b1a-b8a3-691f13bd0c1d tempest-ProjectReaderTests-2023074414 None] Created volume successfully. Jul 10 10:17:44 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-0a61781c-e780-417c-83a3-bf482b0d5f43 tempest-TestServerVolumeAttachScenarioOldVersion-1739580940 None] Acquiring lock "cinder-94a93db5-566a-43fd-8501-7a4d254adc38-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:17:44 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-0a61781c-e780-417c-83a3-bf482b0d5f43 tempest-TestServerVolumeAttachScenarioOldVersion-1739580940 None] Lock "cinder-94a93db5-566a-43fd-8501-7a4d254adc38-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:17:44 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-0a61781c-e780-417c-83a3-bf482b0d5f43 tempest-TestServerVolumeAttachScenarioOldVersion-1739580940 None] Acquiring lock "cinder-quobyte-94a93db5-566a-43fd-8501-7a4d254adc38" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:17:44 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-0a61781c-e780-417c-83a3-bf482b0d5f43 tempest-TestServerVolumeAttachScenarioOldVersion-1739580940 None] Lock "cinder-quobyte-94a93db5-566a-43fd-8501-7a4d254adc38" acquired by "delete_volume" :: waited 0.020s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:17:44 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[9522fb0d-969e-44a1-b291-6b640a45c32c]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:17:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0a61781c-e780-417c-83a3-bf482b0d5f43 tempest-TestServerVolumeAttachScenarioOldVersion-1739580940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94a93db5-566a-43fd-8501-7a4d254adc38 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:17:44 devstack sudo[101467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94a93db5-566a-43fd-8501-7a4d254adc38 Jul 10 10:17:44 devstack sudo[101467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:17:44 devstack sudo[101464]: pam_unix(sudo:session): session closed for user root Jul 10 10:17:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3b3574eb-666c-41e8-acb1-35534deec59d tempest-GroupSnapshotsTest-1289579137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-901277e2-6493-436f-96a0-0c3314fe2d6f" returned: 0 in 0.812s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:17:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3b3574eb-666c-41e8-acb1-35534deec59d tempest-GroupSnapshotsTest-1289579137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-901277e2-6493-436f-96a0-0c3314fe2d6f {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:17:44 devstack sudo[101472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-901277e2-6493-436f-96a0-0c3314fe2d6f Jul 10 10:17:44 devstack sudo[101472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:17:45 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f15448e6-422a-4d08-afe1-4a5b71c18537 tempest-ProjectReaderTests-2023074414 None] Acquiring lock "cinder-acac0f02-ad84-435d-8535-4b95cf3896ee-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:17:45 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f15448e6-422a-4d08-afe1-4a5b71c18537 tempest-ProjectReaderTests-2023074414 None] Lock "cinder-acac0f02-ad84-435d-8535-4b95cf3896ee-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:17:45 devstack sudo[101467]: pam_unix(sudo:session): session closed for user root Jul 10 10:17:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0a61781c-e780-417c-83a3-bf482b0d5f43 tempest-TestServerVolumeAttachScenarioOldVersion-1739580940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94a93db5-566a-43fd-8501-7a4d254adc38" returned: 0 in 0.820s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:17:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0a61781c-e780-417c-83a3-bf482b0d5f43 tempest-TestServerVolumeAttachScenarioOldVersion-1739580940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94a93db5-566a-43fd-8501-7a4d254adc38 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:17:45 devstack sudo[101477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94a93db5-566a-43fd-8501-7a4d254adc38 Jul 10 10:17:45 devstack sudo[101477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:17:45 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f15448e6-422a-4d08-afe1-4a5b71c18537 tempest-ProjectReaderTests-2023074414 None] Acquiring lock "cinder-quobyte-acac0f02-ad84-435d-8535-4b95cf3896ee" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:17:45 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f15448e6-422a-4d08-afe1-4a5b71c18537 tempest-ProjectReaderTests-2023074414 None] Lock "cinder-quobyte-acac0f02-ad84-435d-8535-4b95cf3896ee" acquired by "delete_volume" :: waited 0.019s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:17:45 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab40c336-739d-4fa7-bb1f-fe62d03a574f]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:17:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f15448e6-422a-4d08-afe1-4a5b71c18537 tempest-ProjectReaderTests-2023074414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-acac0f02-ad84-435d-8535-4b95cf3896ee {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:17:45 devstack sudo[101479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-acac0f02-ad84-435d-8535-4b95cf3896ee Jul 10 10:17:45 devstack sudo[101479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:17:45 devstack sudo[101472]: pam_unix(sudo:session): session closed for user root Jul 10 10:17:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3b3574eb-666c-41e8-acb1-35534deec59d tempest-GroupSnapshotsTest-1289579137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-901277e2-6493-436f-96a0-0c3314fe2d6f" returned: 0 in 0.711s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:17:45 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-3b3574eb-666c-41e8-acb1-35534deec59d tempest-GroupSnapshotsTest-1289579137 None] Lock "cinder-quobyte-901277e2-6493-436f-96a0-0c3314fe2d6f" released by "delete_volume" :: held 1.576s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:17:45 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-3b3574eb-666c-41e8-acb1-35534deec59d tempest-GroupSnapshotsTest-1289579137 None] Created reservations ['357c828b-2cbb-463e-9394-22a58b653a29'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:17:45 devstack cinder-volume[87234]: WARNING cinder.quota [None req-3b3574eb-666c-41e8-acb1-35534deec59d tempest-GroupSnapshotsTest-1289579137 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1673574678 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1673574678, it is now deprecated. Please use the default quota class for default quota. Jul 10 10:17:45 devstack cinder-volume[87234]: WARNING cinder.quota [None req-3b3574eb-666c-41e8-acb1-35534deec59d tempest-GroupSnapshotsTest-1289579137 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1673574678 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1673574678, it is now deprecated. Please use the default quota class for default quota. Jul 10 10:17:45 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-3b3574eb-666c-41e8-acb1-35534deec59d tempest-GroupSnapshotsTest-1289579137 None] Created reservations ['d2621201-bf39-4f06-9a7d-8a81c252e64c', '2ec16a0c-b2f0-4378-902b-f748433edbc7', 'ea21ab70-f2f6-4c07-966f-3925bb988c65', 'd5bbbf08-dc80-4956-a10f-7d3ab6e6f2f1'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:17:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-3b3574eb-666c-41e8-acb1-35534deec59d tempest-GroupSnapshotsTest-1289579137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:17:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-3b3574eb-666c-41e8-acb1-35534deec59d tempest-GroupSnapshotsTest-1289579137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:17:45 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-3b3574eb-666c-41e8-acb1-35534deec59d tempest-GroupSnapshotsTest-1289579137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:17:45 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-3b3574eb-666c-41e8-acb1-35534deec59d tempest-GroupSnapshotsTest-1289579137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:17:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-3b3574eb-666c-41e8-acb1-35534deec59d tempest-GroupSnapshotsTest-1289579137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:17:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3b3574eb-666c-41e8-acb1-35534deec59d tempest-GroupSnapshotsTest-1289579137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:17:45 devstack sudo[101482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:17:45 devstack sudo[101482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:17:45 devstack sudo[101477]: pam_unix(sudo:session): session closed for user root Jul 10 10:17:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0a61781c-e780-417c-83a3-bf482b0d5f43 tempest-TestServerVolumeAttachScenarioOldVersion-1739580940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94a93db5-566a-43fd-8501-7a4d254adc38" returned: 0 in 0.692s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:17:45 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-0a61781c-e780-417c-83a3-bf482b0d5f43 tempest-TestServerVolumeAttachScenarioOldVersion-1739580940 None] Lock "cinder-quobyte-94a93db5-566a-43fd-8501-7a4d254adc38" released by "delete_volume" :: held 1.557s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:17:46 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-0a61781c-e780-417c-83a3-bf482b0d5f43 tempest-TestServerVolumeAttachScenarioOldVersion-1739580940 None] Created reservations ['261c11a5-1ead-47da-9b70-7853db40c0c8', '61468ddc-4b45-48e2-954e-f11f0e49a586', '8a315614-88eb-4793-9d06-bda96121595e', 'baaf28c1-a7ee-42e3-8b0b-d74db707b143'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:17:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-0a61781c-e780-417c-83a3-bf482b0d5f43 tempest-TestServerVolumeAttachScenarioOldVersion-1739580940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:17:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-0a61781c-e780-417c-83a3-bf482b0d5f43 tempest-TestServerVolumeAttachScenarioOldVersion-1739580940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:17:46 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-0a61781c-e780-417c-83a3-bf482b0d5f43 tempest-TestServerVolumeAttachScenarioOldVersion-1739580940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:17:46 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-0a61781c-e780-417c-83a3-bf482b0d5f43 tempest-TestServerVolumeAttachScenarioOldVersion-1739580940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:17:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-0a61781c-e780-417c-83a3-bf482b0d5f43 tempest-TestServerVolumeAttachScenarioOldVersion-1739580940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:17:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0a61781c-e780-417c-83a3-bf482b0d5f43 tempest-TestServerVolumeAttachScenarioOldVersion-1739580940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:17:46 devstack sudo[101488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:17:46 devstack sudo[101488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:17:46 devstack sudo[101479]: pam_unix(sudo:session): session closed for user root Jul 10 10:17:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f15448e6-422a-4d08-afe1-4a5b71c18537 tempest-ProjectReaderTests-2023074414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-acac0f02-ad84-435d-8535-4b95cf3896ee" returned: 0 in 0.826s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:17:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f15448e6-422a-4d08-afe1-4a5b71c18537 tempest-ProjectReaderTests-2023074414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-acac0f02-ad84-435d-8535-4b95cf3896ee {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:17:46 devstack sudo[101490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-acac0f02-ad84-435d-8535-4b95cf3896ee Jul 10 10:17:46 devstack sudo[101490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:17:46 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-37fbbcfc-bd4a-4618-8eb7-cab187dac3c2 tempest-GroupSnapshotsTest-1289579137 None] group_snapshot 088ae505-c80b-4e47-b721-f58e70eda72e: deleting Jul 10 10:17:46 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-37fbbcfc-bd4a-4618-8eb7-cab187dac3c2 tempest-GroupSnapshotsTest-1289579137 None] group_snapshot 088ae505-c80b-4e47-b721-f58e70eda72e: deleting {{(pid=87234) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 10 10:17:46 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-37fbbcfc-bd4a-4618-8eb7-cab187dac3c2 tempest-GroupSnapshotsTest-1289579137 None] Acquiring lock "cinder-quobyte-747605d2-80ea-4b31-9326-9fa2697881bd" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:17:46 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-37fbbcfc-bd4a-4618-8eb7-cab187dac3c2 tempest-GroupSnapshotsTest-1289579137 None] Lock "cinder-quobyte-747605d2-80ea-4b31-9326-9fa2697881bd" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:17:46 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-37fbbcfc-bd4a-4618-8eb7-cab187dac3c2 tempest-GroupSnapshotsTest-1289579137 None] Acquiring lock "cinder-quobyte-03d3ffe9-70df-47fe-abf3-35ba3da04ac6" by "_delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:17:46 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-37fbbcfc-bd4a-4618-8eb7-cab187dac3c2 tempest-GroupSnapshotsTest-1289579137 None] Lock "cinder-quobyte-03d3ffe9-70df-47fe-abf3-35ba3da04ac6" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:17:46 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-37fbbcfc-bd4a-4618-8eb7-cab187dac3c2 tempest-GroupSnapshotsTest-1289579137 None] Deleting offline snapshot 03d3ffe9-70df-47fe-abf3-35ba3da04ac6 of volume 747605d2-80ea-4b31-9326-9fa2697881bd {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 10:17:46 devstack sudo[101482]: pam_unix(sudo:session): session closed for user root Jul 10 10:17:46 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-37fbbcfc-bd4a-4618-8eb7-cab187dac3c2 tempest-GroupSnapshotsTest-1289579137 None] snapshot_file for this snap is: volume-747605d2-80ea-4b31-9326-9fa2697881bd.03d3ffe9-70df-47fe-abf3-35ba3da04ac6 {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 10:17:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3b3574eb-666c-41e8-acb1-35534deec59d tempest-GroupSnapshotsTest-1289579137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.806s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:17:46 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-3b3574eb-666c-41e8-acb1-35534deec59d tempest-GroupSnapshotsTest-1289579137 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:17:46 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-3b3574eb-666c-41e8-acb1-35534deec59d tempest-GroupSnapshotsTest-1289579137 None] Delete group completed successfully. Jul 10 10:17:46 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79a3d74-ad16-4b66-a797-08d6e52d2774]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:17:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-37fbbcfc-bd4a-4618-8eb7-cab187dac3c2 tempest-GroupSnapshotsTest-1289579137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-747605d2-80ea-4b31-9326-9fa2697881bd.03d3ffe9-70df-47fe-abf3-35ba3da04ac6 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:17:46 devstack sudo[101493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-747605d2-80ea-4b31-9326-9fa2697881bd.03d3ffe9-70df-47fe-abf3-35ba3da04ac6 Jul 10 10:17:46 devstack sudo[101493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:17:46 devstack sudo[101488]: pam_unix(sudo:session): session closed for user root Jul 10 10:17:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0a61781c-e780-417c-83a3-bf482b0d5f43 tempest-TestServerVolumeAttachScenarioOldVersion-1739580940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.897s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:17:46 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-0a61781c-e780-417c-83a3-bf482b0d5f43 tempest-TestServerVolumeAttachScenarioOldVersion-1739580940 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:17:46 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-0a61781c-e780-417c-83a3-bf482b0d5f43 tempest-TestServerVolumeAttachScenarioOldVersion-1739580940 None] Deleted volume successfully. Jul 10 10:17:47 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-0a61781c-e780-417c-83a3-bf482b0d5f43 tempest-TestServerVolumeAttachScenarioOldVersion-1739580940 None] Lock "cinder-94a93db5-566a-43fd-8501-7a4d254adc38-delete_volume" released by "delete_volume" :: held 2.683s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:17:47 devstack sudo[101490]: pam_unix(sudo:session): session closed for user root Jul 10 10:17:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f15448e6-422a-4d08-afe1-4a5b71c18537 tempest-ProjectReaderTests-2023074414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-acac0f02-ad84-435d-8535-4b95cf3896ee" returned: 0 in 0.911s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:17:47 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f15448e6-422a-4d08-afe1-4a5b71c18537 tempest-ProjectReaderTests-2023074414 None] Lock "cinder-quobyte-acac0f02-ad84-435d-8535-4b95cf3896ee" released by "delete_volume" :: held 1.778s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:17:47 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-f15448e6-422a-4d08-afe1-4a5b71c18537 tempest-ProjectReaderTests-2023074414 None] Created reservations ['87730a9e-754e-4563-9704-8279b637a104', '8e47889e-90d2-4736-b6f5-72aa41e7e385', '6e973c09-96f3-48c2-ba75-5bada992c1b7', '7e8d5640-2062-4a6f-8f7b-afabaf607785'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:17:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f15448e6-422a-4d08-afe1-4a5b71c18537 tempest-ProjectReaderTests-2023074414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:17:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f15448e6-422a-4d08-afe1-4a5b71c18537 tempest-ProjectReaderTests-2023074414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:17:47 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f15448e6-422a-4d08-afe1-4a5b71c18537 tempest-ProjectReaderTests-2023074414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:17:47 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f15448e6-422a-4d08-afe1-4a5b71c18537 tempest-ProjectReaderTests-2023074414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:17:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f15448e6-422a-4d08-afe1-4a5b71c18537 tempest-ProjectReaderTests-2023074414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:17:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f15448e6-422a-4d08-afe1-4a5b71c18537 tempest-ProjectReaderTests-2023074414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:17:47 devstack sudo[101498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:17:47 devstack sudo[101498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:17:47 devstack sudo[101493]: pam_unix(sudo:session): session closed for user root Jul 10 10:17:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-37fbbcfc-bd4a-4618-8eb7-cab187dac3c2 tempest-GroupSnapshotsTest-1289579137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-747605d2-80ea-4b31-9326-9fa2697881bd.03d3ffe9-70df-47fe-abf3-35ba3da04ac6" returned: 0 in 0.875s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:17:47 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-37fbbcfc-bd4a-4618-8eb7-cab187dac3c2 tempest-GroupSnapshotsTest-1289579137 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-747605d2-80ea-4b31-9326-9fa2697881bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 10:17:47 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce66ab86-ea98-4074-ab76-d8268dd02be6]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:17:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-37fbbcfc-bd4a-4618-8eb7-cab187dac3c2 tempest-GroupSnapshotsTest-1289579137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-747605d2-80ea-4b31-9326-9fa2697881bd {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:17:47 devstack sudo[101503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-747605d2-80ea-4b31-9326-9fa2697881bd Jul 10 10:17:47 devstack sudo[101503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:17:47 devstack sudo[101498]: pam_unix(sudo:session): session closed for user root Jul 10 10:17:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f15448e6-422a-4d08-afe1-4a5b71c18537 tempest-ProjectReaderTests-2023074414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.802s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:17:47 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-f15448e6-422a-4d08-afe1-4a5b71c18537 tempest-ProjectReaderTests-2023074414 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:17:48 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0d4102c-3ba4-4028-8bd7-607de3dd4df1 tempest-ProjectReaderTests-2023074414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:17:48 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-d0d4102c-3ba4-4028-8bd7-607de3dd4df1 tempest-ProjectReaderTests-2023074414 None] Flow 'volume_create_manager' (dffb95ca-4ede-4f4d-aead-f0988b780159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:17:48 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-d0d4102c-3ba4-4028-8bd7-607de3dd4df1 tempest-ProjectReaderTests-2023074414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4887b19-31ee-49e4-8742-c8655f10c750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:17:48 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-f15448e6-422a-4d08-afe1-4a5b71c18537 tempest-ProjectReaderTests-2023074414 None] Deleted volume successfully. Jul 10 10:17:48 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-d0d4102c-3ba4-4028-8bd7-607de3dd4df1 tempest-ProjectReaderTests-2023074414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4887b19-31ee-49e4-8742-c8655f10c750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:17:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-634589665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee903223-3610-46d2-bcad-9486dadd9de7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3fd2e5ed917444bbfc8266034f1677e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:17:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:17:48Z,use_quota=True,user_id='96e3c41b24a64c42b841b4dde10061e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:17:48 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-d0d4102c-3ba4-4028-8bd7-607de3dd4df1 tempest-ProjectReaderTests-2023074414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2372937-7a67-409b-87bc-0dbcffbcab14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:17:48 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-d0d4102c-3ba4-4028-8bd7-607de3dd4df1 tempest-ProjectReaderTests-2023074414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2372937-7a67-409b-87bc-0dbcffbcab14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:17:48 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-d0d4102c-3ba4-4028-8bd7-607de3dd4df1 tempest-ProjectReaderTests-2023074414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a136dc9-a41a-405f-99bc-2a4ef0bc2b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:17:48 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-d0d4102c-3ba4-4028-8bd7-607de3dd4df1 tempest-ProjectReaderTests-2023074414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a136dc9-a41a-405f-99bc-2a4ef0bc2b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee903223-3610-46d2-bcad-9486dadd9de7', 'volume_name': 'volume-ee903223-3610-46d2-bcad-9486dadd9de7', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:17:48 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-d0d4102c-3ba4-4028-8bd7-607de3dd4df1 tempest-ProjectReaderTests-2023074414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8641eebd-53c4-47d4-88a0-5273c6ae78e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:17:48 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-d0d4102c-3ba4-4028-8bd7-607de3dd4df1 tempest-ProjectReaderTests-2023074414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8641eebd-53c4-47d4-88a0-5273c6ae78e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:17:48 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-d0d4102c-3ba4-4028-8bd7-607de3dd4df1 tempest-ProjectReaderTests-2023074414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b5df0fd-bd83-4368-8c17-5b4e3037145c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:17:48 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-d0d4102c-3ba4-4028-8bd7-607de3dd4df1 tempest-ProjectReaderTests-2023074414 None] Volume ee903223-3610-46d2-bcad-9486dadd9de7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee903223-3610-46d2-bcad-9486dadd9de7', 'volume_size': 1} Jul 10 10:17:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-d0d4102c-3ba4-4028-8bd7-607de3dd4df1 tempest-ProjectReaderTests-2023074414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:17:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-d0d4102c-3ba4-4028-8bd7-607de3dd4df1 tempest-ProjectReaderTests-2023074414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:17:48 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-d0d4102c-3ba4-4028-8bd7-607de3dd4df1 tempest-ProjectReaderTests-2023074414 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:17:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-634589665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee903223-3610-46d2-bcad-9486dadd9de7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3fd2e5ed917444bbfc8266034f1677e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:17:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:17:48Z,use_quota=True,user_id='96e3c41b24a64c42b841b4dde10061e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:17:48 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-d0d4102c-3ba4-4028-8bd7-607de3dd4df1 tempest-ProjectReaderTests-2023074414 None] Creating volume ee903223-3610-46d2-bcad-9486dadd9de7 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:17:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-d0d4102c-3ba4-4028-8bd7-607de3dd4df1 tempest-ProjectReaderTests-2023074414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:17:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-d0d4102c-3ba4-4028-8bd7-607de3dd4df1 tempest-ProjectReaderTests-2023074414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:17:48 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-d0d4102c-3ba4-4028-8bd7-607de3dd4df1 tempest-ProjectReaderTests-2023074414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:17:48 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-d0d4102c-3ba4-4028-8bd7-607de3dd4df1 tempest-ProjectReaderTests-2023074414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:17:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-d0d4102c-3ba4-4028-8bd7-607de3dd4df1 tempest-ProjectReaderTests-2023074414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:17:48 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-d0d4102c-3ba4-4028-8bd7-607de3dd4df1 tempest-ProjectReaderTests-2023074414 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:17:48 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-d0d4102c-3ba4-4028-8bd7-607de3dd4df1 tempest-ProjectReaderTests-2023074414 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:17:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-d0d4102c-3ba4-4028-8bd7-607de3dd4df1 tempest-ProjectReaderTests-2023074414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ee903223-3610-46d2-bcad-9486dadd9de7 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:17:48 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f15448e6-422a-4d08-afe1-4a5b71c18537 tempest-ProjectReaderTests-2023074414 None] Lock "cinder-acac0f02-ad84-435d-8535-4b95cf3896ee-delete_volume" released by "delete_volume" :: held 2.936s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:17:48 devstack sudo[101511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ee903223-3610-46d2-bcad-9486dadd9de7 1073741824 Jul 10 10:17:48 devstack sudo[101511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:17:48 devstack sudo[101503]: pam_unix(sudo:session): session closed for user root Jul 10 10:17:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-37fbbcfc-bd4a-4618-8eb7-cab187dac3c2 tempest-GroupSnapshotsTest-1289579137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-747605d2-80ea-4b31-9326-9fa2697881bd" returned: 0 in 0.835s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:17:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-37fbbcfc-bd4a-4618-8eb7-cab187dac3c2 tempest-GroupSnapshotsTest-1289579137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-747605d2-80ea-4b31-9326-9fa2697881bd.03d3ffe9-70df-47fe-abf3-35ba3da04ac6 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:17:48 devstack sudo[101516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-747605d2-80ea-4b31-9326-9fa2697881bd.03d3ffe9-70df-47fe-abf3-35ba3da04ac6 Jul 10 10:17:48 devstack sudo[101516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:17:49 devstack sudo[101511]: pam_unix(sudo:session): session closed for user root Jul 10 10:17:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-d0d4102c-3ba4-4028-8bd7-607de3dd4df1 tempest-ProjectReaderTests-2023074414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ee903223-3610-46d2-bcad-9486dadd9de7 1073741824" returned: 0 in 1.066s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:17:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-d0d4102c-3ba4-4028-8bd7-607de3dd4df1 tempest-ProjectReaderTests-2023074414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ee903223-3610-46d2-bcad-9486dadd9de7 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:17:49 devstack sudo[101543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ee903223-3610-46d2-bcad-9486dadd9de7 Jul 10 10:17:49 devstack sudo[101543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:17:49 devstack sudo[101516]: pam_unix(sudo:session): session closed for user root Jul 10 10:17:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-37fbbcfc-bd4a-4618-8eb7-cab187dac3c2 tempest-GroupSnapshotsTest-1289579137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-747605d2-80ea-4b31-9326-9fa2697881bd.03d3ffe9-70df-47fe-abf3-35ba3da04ac6" returned: 0 in 0.989s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:17:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-37fbbcfc-bd4a-4618-8eb7-cab187dac3c2 tempest-GroupSnapshotsTest-1289579137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-747605d2-80ea-4b31-9326-9fa2697881bd.03d3ffe9-70df-47fe-abf3-35ba3da04ac6 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:17:49 devstack sudo[101546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-747605d2-80ea-4b31-9326-9fa2697881bd.03d3ffe9-70df-47fe-abf3-35ba3da04ac6 Jul 10 10:17:49 devstack sudo[101546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:17:49 devstack sudo[101543]: pam_unix(sudo:session): session closed for user root Jul 10 10:17:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-d0d4102c-3ba4-4028-8bd7-607de3dd4df1 tempest-ProjectReaderTests-2023074414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ee903223-3610-46d2-bcad-9486dadd9de7" returned: 0 in 0.729s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:17:49 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-d0d4102c-3ba4-4028-8bd7-607de3dd4df1 tempest-ProjectReaderTests-2023074414 None] <== create_volume: return (1860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:17:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-d0d4102c-3ba4-4028-8bd7-607de3dd4df1 tempest-ProjectReaderTests-2023074414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.862s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:17:49 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-d0d4102c-3ba4-4028-8bd7-607de3dd4df1 tempest-ProjectReaderTests-2023074414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b5df0fd-bd83-4368-8c17-5b4e3037145c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee903223-3610-46d2-bcad-9486dadd9de7', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:17:50 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-d0d4102c-3ba4-4028-8bd7-607de3dd4df1 tempest-ProjectReaderTests-2023074414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5719dea6-3b7b-491f-bca6-746dd408d9ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:17:50 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-d0d4102c-3ba4-4028-8bd7-607de3dd4df1 tempest-ProjectReaderTests-2023074414 None] Volume volume-ee903223-3610-46d2-bcad-9486dadd9de7 (ee903223-3610-46d2-bcad-9486dadd9de7): created successfully Jul 10 10:17:50 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-d0d4102c-3ba4-4028-8bd7-607de3dd4df1 tempest-ProjectReaderTests-2023074414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5719dea6-3b7b-491f-bca6-746dd408d9ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:17:50 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-d0d4102c-3ba4-4028-8bd7-607de3dd4df1 tempest-ProjectReaderTests-2023074414 None] Flow 'volume_create_manager' (dffb95ca-4ede-4f4d-aead-f0988b780159) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:17:50 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-d0d4102c-3ba4-4028-8bd7-607de3dd4df1 tempest-ProjectReaderTests-2023074414 None] Created volume successfully. Jul 10 10:17:50 devstack sudo[101546]: pam_unix(sudo:session): session closed for user root Jul 10 10:17:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-37fbbcfc-bd4a-4618-8eb7-cab187dac3c2 tempest-GroupSnapshotsTest-1289579137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-747605d2-80ea-4b31-9326-9fa2697881bd.03d3ffe9-70df-47fe-abf3-35ba3da04ac6" returned: 0 in 0.832s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:17:50 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-37fbbcfc-bd4a-4618-8eb7-cab187dac3c2 tempest-GroupSnapshotsTest-1289579137 None] Lock "cinder-quobyte-03d3ffe9-70df-47fe-abf3-35ba3da04ac6" released by "_delete_snapshot" :: held 3.668s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:17:50 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-37fbbcfc-bd4a-4618-8eb7-cab187dac3c2 tempest-GroupSnapshotsTest-1289579137 None] Lock "cinder-quobyte-747605d2-80ea-4b31-9326-9fa2697881bd" released by "delete_snapshot" :: held 3.697s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:17:50 devstack cinder-volume[87234]: WARNING cinder.quota [None req-37fbbcfc-bd4a-4618-8eb7-cab187dac3c2 tempest-GroupSnapshotsTest-1289579137 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1673574678 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1673574678, it is now deprecated. Please use the default quota class for default quota. Jul 10 10:17:50 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-37fbbcfc-bd4a-4618-8eb7-cab187dac3c2 tempest-GroupSnapshotsTest-1289579137 None] Created reservations ['abaf63af-017a-4c35-a2d2-36dce8677a06', 'c6dde690-5bd0-4f0a-869b-350a2f21a2e3', '3e91cbe0-6d37-4eeb-90df-ce7bb6dbc37e', '8cdc75a3-18c5-49df-a757-fecfe5ce73da'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:17:50 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-37fbbcfc-bd4a-4618-8eb7-cab187dac3c2 tempest-GroupSnapshotsTest-1289579137 None] group_snapshot 088ae505-c80b-4e47-b721-f58e70eda72e: deleted successfully Jul 10 10:17:51 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-fde16021-6f54-4999-a7e6-e33c4fbe8219 tempest-GroupSnapshotsTest-1289579137 None] Acquiring lock "cinder-quobyte-747605d2-80ea-4b31-9326-9fa2697881bd" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:17:51 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-fde16021-6f54-4999-a7e6-e33c4fbe8219 tempest-GroupSnapshotsTest-1289579137 None] Lock "cinder-quobyte-747605d2-80ea-4b31-9326-9fa2697881bd" acquired by "delete_volume" :: waited 0.018s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:17:51 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-b7f8c416-5ca5-44cb-a033-2613ebe552e1 tempest-ProjectReaderTests-2023074414 None] Acquiring lock "cinder-ee903223-3610-46d2-bcad-9486dadd9de7-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:17:51 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-b7f8c416-5ca5-44cb-a033-2613ebe552e1 tempest-ProjectReaderTests-2023074414 None] Lock "cinder-ee903223-3610-46d2-bcad-9486dadd9de7-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:17:51 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e11c3f-5268-4ba9-bcaa-ee6a560ebc1f]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:17:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fde16021-6f54-4999-a7e6-e33c4fbe8219 tempest-GroupSnapshotsTest-1289579137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-747605d2-80ea-4b31-9326-9fa2697881bd {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:17:51 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-b7f8c416-5ca5-44cb-a033-2613ebe552e1 tempest-ProjectReaderTests-2023074414 None] Acquiring lock "cinder-quobyte-ee903223-3610-46d2-bcad-9486dadd9de7" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:17:51 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-b7f8c416-5ca5-44cb-a033-2613ebe552e1 tempest-ProjectReaderTests-2023074414 None] Lock "cinder-quobyte-ee903223-3610-46d2-bcad-9486dadd9de7" acquired by "delete_volume" :: waited 0.017s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:17:51 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ecc7f9d-fa5a-4aa7-af72-c3eb978dd7f2]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:17:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-b7f8c416-5ca5-44cb-a033-2613ebe552e1 tempest-ProjectReaderTests-2023074414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ee903223-3610-46d2-bcad-9486dadd9de7 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:17:51 devstack sudo[101552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-747605d2-80ea-4b31-9326-9fa2697881bd Jul 10 10:17:51 devstack sudo[101552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:17:51 devstack sudo[101553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ee903223-3610-46d2-bcad-9486dadd9de7 Jul 10 10:17:51 devstack sudo[101553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:17:52 devstack sudo[101552]: pam_unix(sudo:session): session closed for user root Jul 10 10:17:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fde16021-6f54-4999-a7e6-e33c4fbe8219 tempest-GroupSnapshotsTest-1289579137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-747605d2-80ea-4b31-9326-9fa2697881bd" returned: 0 in 0.781s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:17:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fde16021-6f54-4999-a7e6-e33c4fbe8219 tempest-GroupSnapshotsTest-1289579137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-747605d2-80ea-4b31-9326-9fa2697881bd {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:17:52 devstack sudo[101562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-747605d2-80ea-4b31-9326-9fa2697881bd Jul 10 10:17:52 devstack sudo[101562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:17:52 devstack sudo[101553]: pam_unix(sudo:session): session closed for user root Jul 10 10:17:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-b7f8c416-5ca5-44cb-a033-2613ebe552e1 tempest-ProjectReaderTests-2023074414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ee903223-3610-46d2-bcad-9486dadd9de7" returned: 0 in 0.766s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:17:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-b7f8c416-5ca5-44cb-a033-2613ebe552e1 tempest-ProjectReaderTests-2023074414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ee903223-3610-46d2-bcad-9486dadd9de7 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:17:52 devstack sudo[101564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ee903223-3610-46d2-bcad-9486dadd9de7 Jul 10 10:17:52 devstack sudo[101564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:17:52 devstack sudo[101562]: pam_unix(sudo:session): session closed for user root Jul 10 10:17:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fde16021-6f54-4999-a7e6-e33c4fbe8219 tempest-GroupSnapshotsTest-1289579137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-747605d2-80ea-4b31-9326-9fa2697881bd" returned: 0 in 0.689s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:17:52 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-fde16021-6f54-4999-a7e6-e33c4fbe8219 tempest-GroupSnapshotsTest-1289579137 None] Lock "cinder-quobyte-747605d2-80ea-4b31-9326-9fa2697881bd" released by "delete_volume" :: held 1.565s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:17:52 devstack sudo[101564]: pam_unix(sudo:session): session closed for user root Jul 10 10:17:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-b7f8c416-5ca5-44cb-a033-2613ebe552e1 tempest-ProjectReaderTests-2023074414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ee903223-3610-46d2-bcad-9486dadd9de7" returned: 0 in 0.674s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:17:52 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-fde16021-6f54-4999-a7e6-e33c4fbe8219 tempest-GroupSnapshotsTest-1289579137 None] Created reservations ['14bb9d32-cce4-4f10-9a3f-f2d82e4eb874'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:17:52 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-b7f8c416-5ca5-44cb-a033-2613ebe552e1 tempest-ProjectReaderTests-2023074414 None] Lock "cinder-quobyte-ee903223-3610-46d2-bcad-9486dadd9de7" released by "delete_volume" :: held 1.483s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:17:52 devstack cinder-volume[87234]: WARNING cinder.db.api [None req-fde16021-6f54-4999-a7e6-e33c4fbe8219 tempest-GroupSnapshotsTest-1289579137 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1673574678'] Jul 10 10:17:52 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-fde16021-6f54-4999-a7e6-e33c4fbe8219 tempest-GroupSnapshotsTest-1289579137 None] Created reservations ['0320c615-fe6a-4fa3-a664-4d9f251ee82b', '4dcb153e-6175-4b62-a496-2544b6e8b206', 'dd601f6c-ea95-43e9-b01d-fded240c39ba', '2d994ad1-dc43-40e0-8838-f185736c2057'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:17:52 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-b7f8c416-5ca5-44cb-a033-2613ebe552e1 tempest-ProjectReaderTests-2023074414 None] Created reservations ['1d92ff88-f54c-48de-a4f0-c47878377cdb', '26d2c18f-ecbf-46b8-88b2-f55cf0c18453', '82d446a1-cbde-4c92-a270-7e45dcee0f14', '50999822-4068-48db-8b60-fbf8acc94434'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:17:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-b7f8c416-5ca5-44cb-a033-2613ebe552e1 tempest-ProjectReaderTests-2023074414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:17:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-b7f8c416-5ca5-44cb-a033-2613ebe552e1 tempest-ProjectReaderTests-2023074414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:17:52 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-b7f8c416-5ca5-44cb-a033-2613ebe552e1 tempest-ProjectReaderTests-2023074414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:17:52 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-b7f8c416-5ca5-44cb-a033-2613ebe552e1 tempest-ProjectReaderTests-2023074414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:17:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-b7f8c416-5ca5-44cb-a033-2613ebe552e1 tempest-ProjectReaderTests-2023074414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:17:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-b7f8c416-5ca5-44cb-a033-2613ebe552e1 tempest-ProjectReaderTests-2023074414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:17:52 devstack sudo[101568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:17:52 devstack sudo[101568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:17:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-fde16021-6f54-4999-a7e6-e33c4fbe8219 tempest-GroupSnapshotsTest-1289579137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:17:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-fde16021-6f54-4999-a7e6-e33c4fbe8219 tempest-GroupSnapshotsTest-1289579137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:17:53 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-fde16021-6f54-4999-a7e6-e33c4fbe8219 tempest-GroupSnapshotsTest-1289579137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:17:53 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-fde16021-6f54-4999-a7e6-e33c4fbe8219 tempest-GroupSnapshotsTest-1289579137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:17:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-fde16021-6f54-4999-a7e6-e33c4fbe8219 tempest-GroupSnapshotsTest-1289579137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:17:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fde16021-6f54-4999-a7e6-e33c4fbe8219 tempest-GroupSnapshotsTest-1289579137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:17:53 devstack sudo[101570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:17:53 devstack sudo[101570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:17:53 devstack sudo[101568]: pam_unix(sudo:session): session closed for user root Jul 10 10:17:53 devstack sudo[101570]: pam_unix(sudo:session): session closed for user root Jul 10 10:17:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-b7f8c416-5ca5-44cb-a033-2613ebe552e1 tempest-ProjectReaderTests-2023074414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.732s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:17:53 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-b7f8c416-5ca5-44cb-a033-2613ebe552e1 tempest-ProjectReaderTests-2023074414 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:17:53 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-b7f8c416-5ca5-44cb-a033-2613ebe552e1 tempest-ProjectReaderTests-2023074414 None] Deleted volume successfully. Jul 10 10:17:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fde16021-6f54-4999-a7e6-e33c4fbe8219 tempest-GroupSnapshotsTest-1289579137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.703s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:17:53 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-fde16021-6f54-4999-a7e6-e33c4fbe8219 tempest-GroupSnapshotsTest-1289579137 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:17:53 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-fde16021-6f54-4999-a7e6-e33c4fbe8219 tempest-GroupSnapshotsTest-1289579137 None] Delete group completed successfully. Jul 10 10:17:53 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-b7f8c416-5ca5-44cb-a033-2613ebe552e1 tempest-ProjectReaderTests-2023074414 None] Lock "cinder-ee903223-3610-46d2-bcad-9486dadd9de7-delete_volume" released by "delete_volume" :: held 2.521s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:17:53 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-ef4b249e-d780-411f-acdf-2b7d090ec4ee tempest-GroupSnapshotsTest-1289579137 None] Group tempest-GroupSnapshotsTest-Group-2037020855: creating Jul 10 10:17:54 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-ef4b249e-d780-411f-acdf-2b7d090ec4ee tempest-GroupSnapshotsTest-1289579137 None] Group tempest-GroupSnapshotsTest-Group-2037020855: created successfully Jul 10 10:17:54 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-ef4b249e-d780-411f-acdf-2b7d090ec4ee tempest-GroupSnapshotsTest-1289579137 None] Create group completed successfully. Jul 10 10:17:55 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-962f1918-f83a-4664-8928-ed9be1234a7e tempest-GroupSnapshotsTest-1289579137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:17:55 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-962f1918-f83a-4664-8928-ed9be1234a7e tempest-GroupSnapshotsTest-1289579137 None] Flow 'volume_create_manager' (a55b34f9-2f35-49ee-9d2e-5b469a685337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:17:55 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-962f1918-f83a-4664-8928-ed9be1234a7e tempest-GroupSnapshotsTest-1289579137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e91f0caa-d7c5-4b31-82fb-9820cafc53a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:17:55 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-962f1918-f83a-4664-8928-ed9be1234a7e tempest-GroupSnapshotsTest-1289579137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e91f0caa-d7c5-4b31-82fb-9820cafc53a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:17:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1719559390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2e98bf07-add8-4218-8a05-2e0bb666ccbd,host='devstack@QuobyteHD#QuobyteHD',id=f4118196-3721-482b-9e48-fbe7b1566331,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='097deae9d776484f839e860f9201642c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:17:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:17:56Z,use_quota=True,user_id='b6dd8f50a48f4f01a6a6fab14fe85583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7a249a8-d11b-4aaa-800b-1ddd503c1688),volume_type_id=f7a249a8-d11b-4aaa-800b-1ddd503c1688)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:17:55 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-962f1918-f83a-4664-8928-ed9be1234a7e tempest-GroupSnapshotsTest-1289579137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ed1669e-44a5-4e2b-8088-fc1d455c15db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:17:55 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-962f1918-f83a-4664-8928-ed9be1234a7e tempest-GroupSnapshotsTest-1289579137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ed1669e-44a5-4e2b-8088-fc1d455c15db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:17:55 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-962f1918-f83a-4664-8928-ed9be1234a7e tempest-GroupSnapshotsTest-1289579137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba3e122b-c4f9-4b88-816d-1bc0cc2bdbd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:17:55 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-962f1918-f83a-4664-8928-ed9be1234a7e tempest-GroupSnapshotsTest-1289579137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba3e122b-c4f9-4b88-816d-1bc0cc2bdbd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4118196-3721-482b-9e48-fbe7b1566331', 'volume_name': 'volume-f4118196-3721-482b-9e48-fbe7b1566331', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:17:55 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-962f1918-f83a-4664-8928-ed9be1234a7e tempest-GroupSnapshotsTest-1289579137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13dc0ca6-8a3e-42af-a83f-7377fdc5ae89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:17:55 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-962f1918-f83a-4664-8928-ed9be1234a7e tempest-GroupSnapshotsTest-1289579137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13dc0ca6-8a3e-42af-a83f-7377fdc5ae89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:17:55 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-962f1918-f83a-4664-8928-ed9be1234a7e tempest-GroupSnapshotsTest-1289579137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (365f6ca2-0c68-46ea-9ac4-563817948665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:17:55 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-962f1918-f83a-4664-8928-ed9be1234a7e tempest-GroupSnapshotsTest-1289579137 None] Volume f4118196-3721-482b-9e48-fbe7b1566331: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4118196-3721-482b-9e48-fbe7b1566331', 'volume_size': 1} Jul 10 10:17:55 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-962f1918-f83a-4664-8928-ed9be1234a7e tempest-GroupSnapshotsTest-1289579137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:17:55 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-962f1918-f83a-4664-8928-ed9be1234a7e tempest-GroupSnapshotsTest-1289579137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:17:55 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-962f1918-f83a-4664-8928-ed9be1234a7e tempest-GroupSnapshotsTest-1289579137 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2e98bf07-add8-4218-8a05-2e0bb666ccbd,created_at=2026-07-10T08:17:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1719559390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2e98bf07-add8-4218-8a05-2e0bb666ccbd,host='devstack@QuobyteHD#QuobyteHD',id=f4118196-3721-482b-9e48-fbe7b1566331,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='097deae9d776484f839e860f9201642c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:17:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:17:56Z,use_quota=True,user_id='b6dd8f50a48f4f01a6a6fab14fe85583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7a249a8-d11b-4aaa-800b-1ddd503c1688),volume_type_id=f7a249a8-d11b-4aaa-800b-1ddd503c1688)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:17:55 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-962f1918-f83a-4664-8928-ed9be1234a7e tempest-GroupSnapshotsTest-1289579137 None] Creating volume f4118196-3721-482b-9e48-fbe7b1566331 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:17:55 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-962f1918-f83a-4664-8928-ed9be1234a7e tempest-GroupSnapshotsTest-1289579137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:17:55 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-962f1918-f83a-4664-8928-ed9be1234a7e tempest-GroupSnapshotsTest-1289579137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:17:55 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-962f1918-f83a-4664-8928-ed9be1234a7e tempest-GroupSnapshotsTest-1289579137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:17:55 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-962f1918-f83a-4664-8928-ed9be1234a7e tempest-GroupSnapshotsTest-1289579137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:17:55 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-962f1918-f83a-4664-8928-ed9be1234a7e tempest-GroupSnapshotsTest-1289579137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:17:55 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-962f1918-f83a-4664-8928-ed9be1234a7e tempest-GroupSnapshotsTest-1289579137 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:17:55 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-962f1918-f83a-4664-8928-ed9be1234a7e tempest-GroupSnapshotsTest-1289579137 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:17:55 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-962f1918-f83a-4664-8928-ed9be1234a7e tempest-GroupSnapshotsTest-1289579137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f4118196-3721-482b-9e48-fbe7b1566331 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:17:55 devstack sudo[101574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f4118196-3721-482b-9e48-fbe7b1566331 1073741824 Jul 10 10:17:55 devstack sudo[101574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:17:56 devstack sudo[101574]: pam_unix(sudo:session): session closed for user root Jul 10 10:17:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-962f1918-f83a-4664-8928-ed9be1234a7e tempest-GroupSnapshotsTest-1289579137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f4118196-3721-482b-9e48-fbe7b1566331 1073741824" returned: 0 in 0.996s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:17:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-962f1918-f83a-4664-8928-ed9be1234a7e tempest-GroupSnapshotsTest-1289579137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f4118196-3721-482b-9e48-fbe7b1566331 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:17:56 devstack sudo[101581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f4118196-3721-482b-9e48-fbe7b1566331 Jul 10 10:17:56 devstack sudo[101581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:17:57 devstack sudo[101581]: pam_unix(sudo:session): session closed for user root Jul 10 10:17:57 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-962f1918-f83a-4664-8928-ed9be1234a7e tempest-GroupSnapshotsTest-1289579137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f4118196-3721-482b-9e48-fbe7b1566331" returned: 0 in 0.766s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:17:57 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-962f1918-f83a-4664-8928-ed9be1234a7e tempest-GroupSnapshotsTest-1289579137 None] <== create_volume: return (1826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:17:57 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-962f1918-f83a-4664-8928-ed9be1234a7e tempest-GroupSnapshotsTest-1289579137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.828s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:17:57 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-962f1918-f83a-4664-8928-ed9be1234a7e tempest-GroupSnapshotsTest-1289579137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (365f6ca2-0c68-46ea-9ac4-563817948665) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4118196-3721-482b-9e48-fbe7b1566331', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:17:57 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-962f1918-f83a-4664-8928-ed9be1234a7e tempest-GroupSnapshotsTest-1289579137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdd8a5f2-fb69-4b0e-bdba-a4aba25c6010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:17:57 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-962f1918-f83a-4664-8928-ed9be1234a7e tempest-GroupSnapshotsTest-1289579137 None] Volume volume-f4118196-3721-482b-9e48-fbe7b1566331 (f4118196-3721-482b-9e48-fbe7b1566331): created successfully Jul 10 10:17:57 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-962f1918-f83a-4664-8928-ed9be1234a7e tempest-GroupSnapshotsTest-1289579137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdd8a5f2-fb69-4b0e-bdba-a4aba25c6010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:17:57 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-962f1918-f83a-4664-8928-ed9be1234a7e tempest-GroupSnapshotsTest-1289579137 None] Flow 'volume_create_manager' (a55b34f9-2f35-49ee-9d2e-5b469a685337) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:17:57 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-962f1918-f83a-4664-8928-ed9be1234a7e tempest-GroupSnapshotsTest-1289579137 None] Created volume successfully. Jul 10 10:17:58 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2e3b279-c8a3-466a-a253-7b3e3968ab8f tempest-GroupSnapshotsTest-1289579137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:17:58 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-d2e3b279-c8a3-466a-a253-7b3e3968ab8f tempest-GroupSnapshotsTest-1289579137 None] Flow 'volume_create_manager' (9923752e-f171-42e3-a72c-1c581fce4059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:17:58 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-d2e3b279-c8a3-466a-a253-7b3e3968ab8f tempest-GroupSnapshotsTest-1289579137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eebf1064-bf96-46b3-8d05-bef8b10436e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:17:58 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-d2e3b279-c8a3-466a-a253-7b3e3968ab8f tempest-GroupSnapshotsTest-1289579137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eebf1064-bf96-46b3-8d05-bef8b10436e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:17:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-195829634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2e98bf07-add8-4218-8a05-2e0bb666ccbd,host='devstack@QuobyteHD#QuobyteHD',id=d308f471-88f9-474b-b936-3a86cfe5e72d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='097deae9d776484f839e860f9201642c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:17:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:17:59Z,use_quota=True,user_id='b6dd8f50a48f4f01a6a6fab14fe85583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7a249a8-d11b-4aaa-800b-1ddd503c1688),volume_type_id=f7a249a8-d11b-4aaa-800b-1ddd503c1688)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:17:58 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-d2e3b279-c8a3-466a-a253-7b3e3968ab8f tempest-GroupSnapshotsTest-1289579137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e45780a-f9bd-4ce7-afce-e7d5ace9d752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:17:58 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-d2e3b279-c8a3-466a-a253-7b3e3968ab8f tempest-GroupSnapshotsTest-1289579137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e45780a-f9bd-4ce7-afce-e7d5ace9d752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:17:58 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-d2e3b279-c8a3-466a-a253-7b3e3968ab8f tempest-GroupSnapshotsTest-1289579137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4772c452-552c-4636-b597-5db671d0132e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:17:58 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-d2e3b279-c8a3-466a-a253-7b3e3968ab8f tempest-GroupSnapshotsTest-1289579137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4772c452-552c-4636-b597-5db671d0132e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd308f471-88f9-474b-b936-3a86cfe5e72d', 'volume_name': 'volume-d308f471-88f9-474b-b936-3a86cfe5e72d', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:17:58 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-d2e3b279-c8a3-466a-a253-7b3e3968ab8f tempest-GroupSnapshotsTest-1289579137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c459439c-9cba-4897-af69-93c90b39917b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:17:58 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-d2e3b279-c8a3-466a-a253-7b3e3968ab8f tempest-GroupSnapshotsTest-1289579137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c459439c-9cba-4897-af69-93c90b39917b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:17:58 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-d2e3b279-c8a3-466a-a253-7b3e3968ab8f tempest-GroupSnapshotsTest-1289579137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e6e964d-650f-4b0c-8c70-e2d06abc78af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:17:58 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-d2e3b279-c8a3-466a-a253-7b3e3968ab8f tempest-GroupSnapshotsTest-1289579137 None] Volume d308f471-88f9-474b-b936-3a86cfe5e72d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d308f471-88f9-474b-b936-3a86cfe5e72d', 'volume_size': 1} Jul 10 10:17:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-d2e3b279-c8a3-466a-a253-7b3e3968ab8f tempest-GroupSnapshotsTest-1289579137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:17:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-d2e3b279-c8a3-466a-a253-7b3e3968ab8f tempest-GroupSnapshotsTest-1289579137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:17:58 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-d2e3b279-c8a3-466a-a253-7b3e3968ab8f tempest-GroupSnapshotsTest-1289579137 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2e98bf07-add8-4218-8a05-2e0bb666ccbd,created_at=2026-07-10T08:17:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-195829634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2e98bf07-add8-4218-8a05-2e0bb666ccbd,host='devstack@QuobyteHD#QuobyteHD',id=d308f471-88f9-474b-b936-3a86cfe5e72d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='097deae9d776484f839e860f9201642c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:17:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:17:59Z,use_quota=True,user_id='b6dd8f50a48f4f01a6a6fab14fe85583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7a249a8-d11b-4aaa-800b-1ddd503c1688),volume_type_id=f7a249a8-d11b-4aaa-800b-1ddd503c1688)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:17:58 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-d2e3b279-c8a3-466a-a253-7b3e3968ab8f tempest-GroupSnapshotsTest-1289579137 None] Creating volume d308f471-88f9-474b-b936-3a86cfe5e72d {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:17:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-d2e3b279-c8a3-466a-a253-7b3e3968ab8f tempest-GroupSnapshotsTest-1289579137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:17:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-d2e3b279-c8a3-466a-a253-7b3e3968ab8f tempest-GroupSnapshotsTest-1289579137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:17:58 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-d2e3b279-c8a3-466a-a253-7b3e3968ab8f tempest-GroupSnapshotsTest-1289579137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:17:58 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-d2e3b279-c8a3-466a-a253-7b3e3968ab8f tempest-GroupSnapshotsTest-1289579137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:17:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-d2e3b279-c8a3-466a-a253-7b3e3968ab8f tempest-GroupSnapshotsTest-1289579137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:17:58 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-d2e3b279-c8a3-466a-a253-7b3e3968ab8f tempest-GroupSnapshotsTest-1289579137 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:17:58 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-d2e3b279-c8a3-466a-a253-7b3e3968ab8f tempest-GroupSnapshotsTest-1289579137 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:17:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-d2e3b279-c8a3-466a-a253-7b3e3968ab8f tempest-GroupSnapshotsTest-1289579137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d308f471-88f9-474b-b936-3a86cfe5e72d 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:17:58 devstack sudo[101585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d308f471-88f9-474b-b936-3a86cfe5e72d 1073741824 Jul 10 10:17:58 devstack sudo[101585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:17:59 devstack sudo[101585]: pam_unix(sudo:session): session closed for user root Jul 10 10:17:59 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-d2e3b279-c8a3-466a-a253-7b3e3968ab8f tempest-GroupSnapshotsTest-1289579137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d308f471-88f9-474b-b936-3a86cfe5e72d 1073741824" returned: 0 in 1.030s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:18:00 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-d2e3b279-c8a3-466a-a253-7b3e3968ab8f tempest-GroupSnapshotsTest-1289579137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d308f471-88f9-474b-b936-3a86cfe5e72d {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:18:00 devstack sudo[101592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d308f471-88f9-474b-b936-3a86cfe5e72d Jul 10 10:18:00 devstack sudo[101592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:18:00 devstack sudo[101592]: pam_unix(sudo:session): session closed for user root Jul 10 10:18:00 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-d2e3b279-c8a3-466a-a253-7b3e3968ab8f tempest-GroupSnapshotsTest-1289579137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d308f471-88f9-474b-b936-3a86cfe5e72d" returned: 0 in 0.733s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:18:00 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-d2e3b279-c8a3-466a-a253-7b3e3968ab8f tempest-GroupSnapshotsTest-1289579137 None] <== create_volume: return (1840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:18:00 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-d2e3b279-c8a3-466a-a253-7b3e3968ab8f tempest-GroupSnapshotsTest-1289579137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.842s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:18:00 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-d2e3b279-c8a3-466a-a253-7b3e3968ab8f tempest-GroupSnapshotsTest-1289579137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e6e964d-650f-4b0c-8c70-e2d06abc78af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d308f471-88f9-474b-b936-3a86cfe5e72d', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:18:00 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-d2e3b279-c8a3-466a-a253-7b3e3968ab8f tempest-GroupSnapshotsTest-1289579137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b31f8c74-3cf8-43bb-9006-01369a014035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:18:00 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-d2e3b279-c8a3-466a-a253-7b3e3968ab8f tempest-GroupSnapshotsTest-1289579137 None] Volume volume-d308f471-88f9-474b-b936-3a86cfe5e72d (d308f471-88f9-474b-b936-3a86cfe5e72d): created successfully Jul 10 10:18:00 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-d2e3b279-c8a3-466a-a253-7b3e3968ab8f tempest-GroupSnapshotsTest-1289579137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b31f8c74-3cf8-43bb-9006-01369a014035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:18:00 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-d2e3b279-c8a3-466a-a253-7b3e3968ab8f tempest-GroupSnapshotsTest-1289579137 None] Flow 'volume_create_manager' (9923752e-f171-42e3-a72c-1c581fce4059) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:18:00 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-d2e3b279-c8a3-466a-a253-7b3e3968ab8f tempest-GroupSnapshotsTest-1289579137 None] Created volume successfully. Jul 10 10:18:01 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-44322feb-b9b9-4dfb-90ea-7e874d67ff83 tempest-GroupSnapshotsTest-1289579137 None] Update group completed successfully. Jul 10 10:18:02 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-7dcb4f74-01df-405e-ba30-d755da8b690f tempest-GroupSnapshotsTest-1289579137 None] Update group completed successfully. Jul 10 10:18:03 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-0eb1fcee-dc84-4ea0-8197-be6db3510c91 tempest-GroupSnapshotsTest-1289579137 None] Update group completed successfully. Jul 10 10:18:05 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-bfd11673-321b-42b8-ae42-83476163fc45 tempest-GroupSnapshotsTest-1289579137 None] Update group completed successfully. Jul 10 10:18:06 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-eea4f4d2-e66e-4ebb-9b41-2bb1500f433b tempest-GroupSnapshotsTest-1289579137 None] GroupSnapshot 6ea3dc9d-d533-483f-a844-90a0334af972: creating. Jul 10 10:18:06 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-eea4f4d2-e66e-4ebb-9b41-2bb1500f433b tempest-GroupSnapshotsTest-1289579137 None] Group snapshot 6ea3dc9d-d533-483f-a844-90a0334af972: creating. {{(pid=87234) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 10 10:18:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-eea4f4d2-e66e-4ebb-9b41-2bb1500f433b tempest-GroupSnapshotsTest-1289579137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:18:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-eea4f4d2-e66e-4ebb-9b41-2bb1500f433b tempest-GroupSnapshotsTest-1289579137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:18:06 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-eea4f4d2-e66e-4ebb-9b41-2bb1500f433b tempest-GroupSnapshotsTest-1289579137 None] Creating offline snapshot 5ff350a7-4332-46dc-af7c-2da9c9359e0d of volume d308f471-88f9-474b-b936-3a86cfe5e72d {{(pid=87234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 10:18:06 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3bf79ae-d251-4beb-8908-6cc88b31f8ba]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:18:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-eea4f4d2-e66e-4ebb-9b41-2bb1500f433b tempest-GroupSnapshotsTest-1289579137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d308f471-88f9-474b-b936-3a86cfe5e72d {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:18:06 devstack sudo[101599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d308f471-88f9-474b-b936-3a86cfe5e72d Jul 10 10:18:06 devstack sudo[101599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:18:07 devstack sudo[101599]: pam_unix(sudo:session): session closed for user root Jul 10 10:18:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-eea4f4d2-e66e-4ebb-9b41-2bb1500f433b tempest-GroupSnapshotsTest-1289579137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d308f471-88f9-474b-b936-3a86cfe5e72d" returned: 0 in 0.990s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:18:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-eea4f4d2-e66e-4ebb-9b41-2bb1500f433b tempest-GroupSnapshotsTest-1289579137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d308f471-88f9-474b-b936-3a86cfe5e72d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d308f471-88f9-474b-b936-3a86cfe5e72d.5ff350a7-4332-46dc-af7c-2da9c9359e0d 1G {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:18:07 devstack sudo[101605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d308f471-88f9-474b-b936-3a86cfe5e72d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d308f471-88f9-474b-b936-3a86cfe5e72d.5ff350a7-4332-46dc-af7c-2da9c9359e0d 1G Jul 10 10:18:07 devstack sudo[101605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:18:08 devstack sudo[101605]: pam_unix(sudo:session): session closed for user root Jul 10 10:18:08 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-eea4f4d2-e66e-4ebb-9b41-2bb1500f433b tempest-GroupSnapshotsTest-1289579137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d308f471-88f9-474b-b936-3a86cfe5e72d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d308f471-88f9-474b-b936-3a86cfe5e72d.5ff350a7-4332-46dc-af7c-2da9c9359e0d 1G" returned: 0 in 1.036s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:18:08 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-eea4f4d2-e66e-4ebb-9b41-2bb1500f433b tempest-GroupSnapshotsTest-1289579137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d308f471-88f9-474b-b936-3a86cfe5e72d -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d308f471-88f9-474b-b936-3a86cfe5e72d.5ff350a7-4332-46dc-af7c-2da9c9359e0d {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:18:08 devstack sudo[101611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d308f471-88f9-474b-b936-3a86cfe5e72d -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d308f471-88f9-474b-b936-3a86cfe5e72d.5ff350a7-4332-46dc-af7c-2da9c9359e0d Jul 10 10:18:08 devstack sudo[101611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:18:09 devstack sudo[101611]: pam_unix(sudo:session): session closed for user root Jul 10 10:18:09 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-eea4f4d2-e66e-4ebb-9b41-2bb1500f433b tempest-GroupSnapshotsTest-1289579137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d308f471-88f9-474b-b936-3a86cfe5e72d -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d308f471-88f9-474b-b936-3a86cfe5e72d.5ff350a7-4332-46dc-af7c-2da9c9359e0d" returned: 0 in 0.814s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:18:09 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-eea4f4d2-e66e-4ebb-9b41-2bb1500f433b tempest-GroupSnapshotsTest-1289579137 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d308f471-88f9-474b-b936-3a86cfe5e72d.5ff350a7-4332-46dc-af7c-2da9c9359e0d is being set with open permissions: ugo+rw: NotImplementedError Jul 10 10:18:09 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-eea4f4d2-e66e-4ebb-9b41-2bb1500f433b tempest-GroupSnapshotsTest-1289579137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d308f471-88f9-474b-b936-3a86cfe5e72d.5ff350a7-4332-46dc-af7c-2da9c9359e0d {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:18:09 devstack sudo[101617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d308f471-88f9-474b-b936-3a86cfe5e72d.5ff350a7-4332-46dc-af7c-2da9c9359e0d Jul 10 10:18:09 devstack sudo[101617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:18:10 devstack sudo[101617]: pam_unix(sudo:session): session closed for user root Jul 10 10:18:10 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-eea4f4d2-e66e-4ebb-9b41-2bb1500f433b tempest-GroupSnapshotsTest-1289579137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d308f471-88f9-474b-b936-3a86cfe5e72d.5ff350a7-4332-46dc-af7c-2da9c9359e0d" returned: 0 in 0.758s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:18:10 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-eea4f4d2-e66e-4ebb-9b41-2bb1500f433b tempest-GroupSnapshotsTest-1289579137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d308f471-88f9-474b-b936-3a86cfe5e72d.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:18:10 devstack sudo[101620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d308f471-88f9-474b-b936-3a86cfe5e72d.info Jul 10 10:18:10 devstack sudo[101620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:18:11 devstack sudo[101620]: pam_unix(sudo:session): session closed for user root Jul 10 10:18:11 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-eea4f4d2-e66e-4ebb-9b41-2bb1500f433b tempest-GroupSnapshotsTest-1289579137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d308f471-88f9-474b-b936-3a86cfe5e72d.info" returned: 0 in 0.727s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:18:11 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-eea4f4d2-e66e-4ebb-9b41-2bb1500f433b tempest-GroupSnapshotsTest-1289579137 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d308f471-88f9-474b-b936-3a86cfe5e72d.info is being set with open permissions: ugo+rw: NotImplementedError Jul 10 10:18:11 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-eea4f4d2-e66e-4ebb-9b41-2bb1500f433b tempest-GroupSnapshotsTest-1289579137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d308f471-88f9-474b-b936-3a86cfe5e72d.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:18:11 devstack sudo[101623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d308f471-88f9-474b-b936-3a86cfe5e72d.info Jul 10 10:18:11 devstack sudo[101623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:18:11 devstack sudo[101623]: pam_unix(sudo:session): session closed for user root Jul 10 10:18:11 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-eea4f4d2-e66e-4ebb-9b41-2bb1500f433b tempest-GroupSnapshotsTest-1289579137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d308f471-88f9-474b-b936-3a86cfe5e72d.info" returned: 0 in 0.693s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:18:11 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-eea4f4d2-e66e-4ebb-9b41-2bb1500f433b tempest-GroupSnapshotsTest-1289579137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.146s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:18:11 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-eea4f4d2-e66e-4ebb-9b41-2bb1500f433b tempest-GroupSnapshotsTest-1289579137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:18:11 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-eea4f4d2-e66e-4ebb-9b41-2bb1500f433b tempest-GroupSnapshotsTest-1289579137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:18:11 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-eea4f4d2-e66e-4ebb-9b41-2bb1500f433b tempest-GroupSnapshotsTest-1289579137 None] Creating offline snapshot ea8f45a6-583c-4c4f-8885-934ebbcafcaf of volume f4118196-3721-482b-9e48-fbe7b1566331 {{(pid=87234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 10:18:11 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[d21ae650-6511-414e-a344-a5818383f1d2]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:18:11 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-eea4f4d2-e66e-4ebb-9b41-2bb1500f433b tempest-GroupSnapshotsTest-1289579137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f4118196-3721-482b-9e48-fbe7b1566331 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:18:12 devstack sudo[101627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f4118196-3721-482b-9e48-fbe7b1566331 Jul 10 10:18:12 devstack sudo[101627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:18:12 devstack sudo[101627]: pam_unix(sudo:session): session closed for user root Jul 10 10:18:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-eea4f4d2-e66e-4ebb-9b41-2bb1500f433b tempest-GroupSnapshotsTest-1289579137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f4118196-3721-482b-9e48-fbe7b1566331" returned: 0 in 0.847s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:18:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-eea4f4d2-e66e-4ebb-9b41-2bb1500f433b tempest-GroupSnapshotsTest-1289579137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f4118196-3721-482b-9e48-fbe7b1566331,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f4118196-3721-482b-9e48-fbe7b1566331.ea8f45a6-583c-4c4f-8885-934ebbcafcaf 1G {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:18:12 devstack sudo[101632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f4118196-3721-482b-9e48-fbe7b1566331,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f4118196-3721-482b-9e48-fbe7b1566331.ea8f45a6-583c-4c4f-8885-934ebbcafcaf 1G Jul 10 10:18:12 devstack sudo[101632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:18:13 devstack sudo[101632]: pam_unix(sudo:session): session closed for user root Jul 10 10:18:13 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-eea4f4d2-e66e-4ebb-9b41-2bb1500f433b tempest-GroupSnapshotsTest-1289579137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f4118196-3721-482b-9e48-fbe7b1566331,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f4118196-3721-482b-9e48-fbe7b1566331.ea8f45a6-583c-4c4f-8885-934ebbcafcaf 1G" returned: 0 in 0.991s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:18:13 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-eea4f4d2-e66e-4ebb-9b41-2bb1500f433b tempest-GroupSnapshotsTest-1289579137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4118196-3721-482b-9e48-fbe7b1566331 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f4118196-3721-482b-9e48-fbe7b1566331.ea8f45a6-583c-4c4f-8885-934ebbcafcaf {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:18:13 devstack sudo[101638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4118196-3721-482b-9e48-fbe7b1566331 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f4118196-3721-482b-9e48-fbe7b1566331.ea8f45a6-583c-4c4f-8885-934ebbcafcaf Jul 10 10:18:13 devstack sudo[101638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:18:14 devstack sudo[101638]: pam_unix(sudo:session): session closed for user root Jul 10 10:18:14 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-eea4f4d2-e66e-4ebb-9b41-2bb1500f433b tempest-GroupSnapshotsTest-1289579137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4118196-3721-482b-9e48-fbe7b1566331 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f4118196-3721-482b-9e48-fbe7b1566331.ea8f45a6-583c-4c4f-8885-934ebbcafcaf" returned: 0 in 0.758s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:18:14 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-eea4f4d2-e66e-4ebb-9b41-2bb1500f433b tempest-GroupSnapshotsTest-1289579137 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f4118196-3721-482b-9e48-fbe7b1566331.ea8f45a6-583c-4c4f-8885-934ebbcafcaf is being set with open permissions: ugo+rw: NotImplementedError Jul 10 10:18:14 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-eea4f4d2-e66e-4ebb-9b41-2bb1500f433b tempest-GroupSnapshotsTest-1289579137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f4118196-3721-482b-9e48-fbe7b1566331.ea8f45a6-583c-4c4f-8885-934ebbcafcaf {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:18:14 devstack sudo[101644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f4118196-3721-482b-9e48-fbe7b1566331.ea8f45a6-583c-4c4f-8885-934ebbcafcaf Jul 10 10:18:14 devstack sudo[101644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:18:15 devstack sudo[101644]: pam_unix(sudo:session): session closed for user root Jul 10 10:18:15 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-eea4f4d2-e66e-4ebb-9b41-2bb1500f433b tempest-GroupSnapshotsTest-1289579137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f4118196-3721-482b-9e48-fbe7b1566331.ea8f45a6-583c-4c4f-8885-934ebbcafcaf" returned: 0 in 0.798s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:18:15 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-eea4f4d2-e66e-4ebb-9b41-2bb1500f433b tempest-GroupSnapshotsTest-1289579137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f4118196-3721-482b-9e48-fbe7b1566331.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:18:15 devstack sudo[101647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f4118196-3721-482b-9e48-fbe7b1566331.info Jul 10 10:18:15 devstack sudo[101647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:18:16 devstack sudo[101647]: pam_unix(sudo:session): session closed for user root Jul 10 10:18:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-eea4f4d2-e66e-4ebb-9b41-2bb1500f433b tempest-GroupSnapshotsTest-1289579137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f4118196-3721-482b-9e48-fbe7b1566331.info" returned: 0 in 0.701s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:18:16 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-eea4f4d2-e66e-4ebb-9b41-2bb1500f433b tempest-GroupSnapshotsTest-1289579137 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f4118196-3721-482b-9e48-fbe7b1566331.info is being set with open permissions: ugo+rw: NotImplementedError Jul 10 10:18:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-eea4f4d2-e66e-4ebb-9b41-2bb1500f433b tempest-GroupSnapshotsTest-1289579137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f4118196-3721-482b-9e48-fbe7b1566331.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:18:16 devstack sudo[101650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f4118196-3721-482b-9e48-fbe7b1566331.info Jul 10 10:18:16 devstack sudo[101650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:18:16 devstack sudo[101650]: pam_unix(sudo:session): session closed for user root Jul 10 10:18:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-eea4f4d2-e66e-4ebb-9b41-2bb1500f433b tempest-GroupSnapshotsTest-1289579137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f4118196-3721-482b-9e48-fbe7b1566331.info" returned: 0 in 0.910s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:18:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-eea4f4d2-e66e-4ebb-9b41-2bb1500f433b tempest-GroupSnapshotsTest-1289579137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.122s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:18:17 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-eea4f4d2-e66e-4ebb-9b41-2bb1500f433b tempest-GroupSnapshotsTest-1289579137 None] group_snapshot 6ea3dc9d-d533-483f-a844-90a0334af972: created successfully Jul 10 10:18:17 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-e1ac4120-39dd-48f6-83a8-af72b770baac tempest-GroupSnapshotsTest-1289579137 None] group_snapshot 6ea3dc9d-d533-483f-a844-90a0334af972: deleting Jul 10 10:18:17 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-e1ac4120-39dd-48f6-83a8-af72b770baac tempest-GroupSnapshotsTest-1289579137 None] group_snapshot 6ea3dc9d-d533-483f-a844-90a0334af972: deleting {{(pid=87234) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 10 10:18:17 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-e1ac4120-39dd-48f6-83a8-af72b770baac tempest-GroupSnapshotsTest-1289579137 None] Acquiring lock "cinder-quobyte-d308f471-88f9-474b-b936-3a86cfe5e72d" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:18:17 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-e1ac4120-39dd-48f6-83a8-af72b770baac tempest-GroupSnapshotsTest-1289579137 None] Lock "cinder-quobyte-d308f471-88f9-474b-b936-3a86cfe5e72d" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:18:17 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-e1ac4120-39dd-48f6-83a8-af72b770baac tempest-GroupSnapshotsTest-1289579137 None] Acquiring lock "cinder-quobyte-5ff350a7-4332-46dc-af7c-2da9c9359e0d" by "_delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:18:17 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-e1ac4120-39dd-48f6-83a8-af72b770baac tempest-GroupSnapshotsTest-1289579137 None] Lock "cinder-quobyte-5ff350a7-4332-46dc-af7c-2da9c9359e0d" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:18:17 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-e1ac4120-39dd-48f6-83a8-af72b770baac tempest-GroupSnapshotsTest-1289579137 None] Deleting offline snapshot 5ff350a7-4332-46dc-af7c-2da9c9359e0d of volume d308f471-88f9-474b-b936-3a86cfe5e72d {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 10:18:17 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-e1ac4120-39dd-48f6-83a8-af72b770baac tempest-GroupSnapshotsTest-1289579137 None] snapshot_file for this snap is: volume-d308f471-88f9-474b-b936-3a86cfe5e72d.5ff350a7-4332-46dc-af7c-2da9c9359e0d {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 10:18:17 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[5caae5fe-0c10-4a7a-aab7-fc89018f859a]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:18:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e1ac4120-39dd-48f6-83a8-af72b770baac tempest-GroupSnapshotsTest-1289579137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d308f471-88f9-474b-b936-3a86cfe5e72d.5ff350a7-4332-46dc-af7c-2da9c9359e0d {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:18:17 devstack sudo[101690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d308f471-88f9-474b-b936-3a86cfe5e72d.5ff350a7-4332-46dc-af7c-2da9c9359e0d Jul 10 10:18:17 devstack sudo[101690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:18:18 devstack sudo[101690]: pam_unix(sudo:session): session closed for user root Jul 10 10:18:18 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e1ac4120-39dd-48f6-83a8-af72b770baac tempest-GroupSnapshotsTest-1289579137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d308f471-88f9-474b-b936-3a86cfe5e72d.5ff350a7-4332-46dc-af7c-2da9c9359e0d" returned: 0 in 0.939s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:18:18 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-e1ac4120-39dd-48f6-83a8-af72b770baac tempest-GroupSnapshotsTest-1289579137 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d308f471-88f9-474b-b936-3a86cfe5e72d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 10:18:18 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bdb599b-d6e4-4c0a-958c-2532a5b075ba]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:18:18 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e1ac4120-39dd-48f6-83a8-af72b770baac tempest-GroupSnapshotsTest-1289579137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d308f471-88f9-474b-b936-3a86cfe5e72d {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:18:18 devstack sudo[101696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d308f471-88f9-474b-b936-3a86cfe5e72d Jul 10 10:18:18 devstack sudo[101696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:18:19 devstack sudo[101696]: pam_unix(sudo:session): session closed for user root Jul 10 10:18:19 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e1ac4120-39dd-48f6-83a8-af72b770baac tempest-GroupSnapshotsTest-1289579137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d308f471-88f9-474b-b936-3a86cfe5e72d" returned: 0 in 0.912s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:18:19 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e1ac4120-39dd-48f6-83a8-af72b770baac tempest-GroupSnapshotsTest-1289579137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d308f471-88f9-474b-b936-3a86cfe5e72d.5ff350a7-4332-46dc-af7c-2da9c9359e0d {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:18:19 devstack sudo[101702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d308f471-88f9-474b-b936-3a86cfe5e72d.5ff350a7-4332-46dc-af7c-2da9c9359e0d Jul 10 10:18:19 devstack sudo[101702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:18:20 devstack sudo[101702]: pam_unix(sudo:session): session closed for user root Jul 10 10:18:20 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e1ac4120-39dd-48f6-83a8-af72b770baac tempest-GroupSnapshotsTest-1289579137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d308f471-88f9-474b-b936-3a86cfe5e72d.5ff350a7-4332-46dc-af7c-2da9c9359e0d" returned: 0 in 0.928s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:18:20 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e1ac4120-39dd-48f6-83a8-af72b770baac tempest-GroupSnapshotsTest-1289579137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d308f471-88f9-474b-b936-3a86cfe5e72d.5ff350a7-4332-46dc-af7c-2da9c9359e0d {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:18:20 devstack sudo[101708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d308f471-88f9-474b-b936-3a86cfe5e72d.5ff350a7-4332-46dc-af7c-2da9c9359e0d Jul 10 10:18:20 devstack sudo[101708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:18:21 devstack sudo[101708]: pam_unix(sudo:session): session closed for user root Jul 10 10:18:21 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e1ac4120-39dd-48f6-83a8-af72b770baac tempest-GroupSnapshotsTest-1289579137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d308f471-88f9-474b-b936-3a86cfe5e72d.5ff350a7-4332-46dc-af7c-2da9c9359e0d" returned: 0 in 0.847s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:18:21 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-e1ac4120-39dd-48f6-83a8-af72b770baac tempest-GroupSnapshotsTest-1289579137 None] Lock "cinder-quobyte-5ff350a7-4332-46dc-af7c-2da9c9359e0d" released by "_delete_snapshot" :: held 3.786s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:18:21 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-e1ac4120-39dd-48f6-83a8-af72b770baac tempest-GroupSnapshotsTest-1289579137 None] Lock "cinder-quobyte-d308f471-88f9-474b-b936-3a86cfe5e72d" released by "delete_snapshot" :: held 3.831s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:18:21 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-e1ac4120-39dd-48f6-83a8-af72b770baac tempest-GroupSnapshotsTest-1289579137 None] Acquiring lock "cinder-quobyte-f4118196-3721-482b-9e48-fbe7b1566331" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:18:21 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-e1ac4120-39dd-48f6-83a8-af72b770baac tempest-GroupSnapshotsTest-1289579137 None] Lock "cinder-quobyte-f4118196-3721-482b-9e48-fbe7b1566331" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:18:21 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-e1ac4120-39dd-48f6-83a8-af72b770baac tempest-GroupSnapshotsTest-1289579137 None] Acquiring lock "cinder-quobyte-ea8f45a6-583c-4c4f-8885-934ebbcafcaf" by "_delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:18:21 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-e1ac4120-39dd-48f6-83a8-af72b770baac tempest-GroupSnapshotsTest-1289579137 None] Lock "cinder-quobyte-ea8f45a6-583c-4c4f-8885-934ebbcafcaf" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:18:21 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-e1ac4120-39dd-48f6-83a8-af72b770baac tempest-GroupSnapshotsTest-1289579137 None] Deleting offline snapshot ea8f45a6-583c-4c4f-8885-934ebbcafcaf of volume f4118196-3721-482b-9e48-fbe7b1566331 {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 10:18:21 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-e1ac4120-39dd-48f6-83a8-af72b770baac tempest-GroupSnapshotsTest-1289579137 None] snapshot_file for this snap is: volume-f4118196-3721-482b-9e48-fbe7b1566331.ea8f45a6-583c-4c4f-8885-934ebbcafcaf {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 10:18:21 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1aebc24-7246-4b05-ace9-6752d48b302a]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:18:21 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e1ac4120-39dd-48f6-83a8-af72b770baac tempest-GroupSnapshotsTest-1289579137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f4118196-3721-482b-9e48-fbe7b1566331.ea8f45a6-583c-4c4f-8885-934ebbcafcaf {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:18:21 devstack sudo[101711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f4118196-3721-482b-9e48-fbe7b1566331.ea8f45a6-583c-4c4f-8885-934ebbcafcaf Jul 10 10:18:21 devstack sudo[101711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:18:22 devstack sudo[101711]: pam_unix(sudo:session): session closed for user root Jul 10 10:18:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e1ac4120-39dd-48f6-83a8-af72b770baac tempest-GroupSnapshotsTest-1289579137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f4118196-3721-482b-9e48-fbe7b1566331.ea8f45a6-583c-4c4f-8885-934ebbcafcaf" returned: 0 in 0.948s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:18:22 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-e1ac4120-39dd-48f6-83a8-af72b770baac tempest-GroupSnapshotsTest-1289579137 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4118196-3721-482b-9e48-fbe7b1566331(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 10:18:22 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[087bc20b-4185-4296-b3a9-d826993888e6]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:18:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e1ac4120-39dd-48f6-83a8-af72b770baac tempest-GroupSnapshotsTest-1289579137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f4118196-3721-482b-9e48-fbe7b1566331 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:18:22 devstack cinder-volume[87234]: DEBUG dbcounter [-] [87234] Writing DB stats cinder:UPDATE=107,cinder:SELECT=103,cinder:DELETE=6,cinder:INSERT=24 {{(pid=87234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 10:18:22 devstack cinder-volume[87234]: DEBUG dbcounter [-] [87234] Writing DB stats cinder:SELECT=99,cinder:INSERT=21,cinder:UPDATE=102,cinder:DELETE=7 {{(pid=87234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 10:18:22 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b8b4058-4d7e-4f09-9aee-58e1f83abb4a tempest-SnapshotDependencyTests-619562385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:18:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3b8b4058-4d7e-4f09-9aee-58e1f83abb4a tempest-SnapshotDependencyTests-619562385 None] Flow 'volume_create_manager' (f3f006f8-4413-4a33-a72b-420a9d9b86e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:18:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3b8b4058-4d7e-4f09-9aee-58e1f83abb4a tempest-SnapshotDependencyTests-619562385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (157f10c6-f2e8-4ffc-9958-f0214acf7eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:18:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3b8b4058-4d7e-4f09-9aee-58e1f83abb4a tempest-SnapshotDependencyTests-619562385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (157f10c6-f2e8-4ffc-9958-f0214acf7eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:18:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-174662675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bdf3f1a-5269-49f4-a996-9ec8190cb73e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='643b5da94f4f48a3a9b986e780dbe949',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:18:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:18:23Z,use_quota=True,user_id='8fe9c87764c0474d9b570055c1b29d34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:18:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3b8b4058-4d7e-4f09-9aee-58e1f83abb4a tempest-SnapshotDependencyTests-619562385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07cf124b-2e44-4b89-ac28-78788c702ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:18:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3b8b4058-4d7e-4f09-9aee-58e1f83abb4a tempest-SnapshotDependencyTests-619562385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07cf124b-2e44-4b89-ac28-78788c702ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:18:22 devstack sudo[101719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f4118196-3721-482b-9e48-fbe7b1566331 Jul 10 10:18:22 devstack sudo[101719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:18:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3b8b4058-4d7e-4f09-9aee-58e1f83abb4a tempest-SnapshotDependencyTests-619562385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d8b9eab-4950-4d80-9ef3-f3b74e45885e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:18:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3b8b4058-4d7e-4f09-9aee-58e1f83abb4a tempest-SnapshotDependencyTests-619562385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d8b9eab-4950-4d80-9ef3-f3b74e45885e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bdf3f1a-5269-49f4-a996-9ec8190cb73e', 'volume_name': 'volume-8bdf3f1a-5269-49f4-a996-9ec8190cb73e', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:18:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3b8b4058-4d7e-4f09-9aee-58e1f83abb4a tempest-SnapshotDependencyTests-619562385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41716490-bb5e-4960-b228-7c8f4a1f7d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:18:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3b8b4058-4d7e-4f09-9aee-58e1f83abb4a tempest-SnapshotDependencyTests-619562385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41716490-bb5e-4960-b228-7c8f4a1f7d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:18:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3b8b4058-4d7e-4f09-9aee-58e1f83abb4a tempest-SnapshotDependencyTests-619562385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f2ad3f7-1373-4d94-890c-4555935eaa20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:18:22 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-3b8b4058-4d7e-4f09-9aee-58e1f83abb4a tempest-SnapshotDependencyTests-619562385 None] Volume 8bdf3f1a-5269-49f4-a996-9ec8190cb73e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bdf3f1a-5269-49f4-a996-9ec8190cb73e', 'volume_size': 1} Jul 10 10:18:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-3b8b4058-4d7e-4f09-9aee-58e1f83abb4a tempest-SnapshotDependencyTests-619562385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:18:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-3b8b4058-4d7e-4f09-9aee-58e1f83abb4a tempest-SnapshotDependencyTests-619562385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:18:22 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-3b8b4058-4d7e-4f09-9aee-58e1f83abb4a tempest-SnapshotDependencyTests-619562385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:18:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-174662675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bdf3f1a-5269-49f4-a996-9ec8190cb73e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='643b5da94f4f48a3a9b986e780dbe949',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:18:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:18:23Z,use_quota=True,user_id='8fe9c87764c0474d9b570055c1b29d34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:18:22 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-3b8b4058-4d7e-4f09-9aee-58e1f83abb4a tempest-SnapshotDependencyTests-619562385 None] Creating volume 8bdf3f1a-5269-49f4-a996-9ec8190cb73e {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:18:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-3b8b4058-4d7e-4f09-9aee-58e1f83abb4a tempest-SnapshotDependencyTests-619562385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:18:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-3b8b4058-4d7e-4f09-9aee-58e1f83abb4a tempest-SnapshotDependencyTests-619562385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:18:22 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-3b8b4058-4d7e-4f09-9aee-58e1f83abb4a tempest-SnapshotDependencyTests-619562385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:18:22 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-3b8b4058-4d7e-4f09-9aee-58e1f83abb4a tempest-SnapshotDependencyTests-619562385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:18:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-3b8b4058-4d7e-4f09-9aee-58e1f83abb4a tempest-SnapshotDependencyTests-619562385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:18:22 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-3b8b4058-4d7e-4f09-9aee-58e1f83abb4a tempest-SnapshotDependencyTests-619562385 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:18:22 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-3b8b4058-4d7e-4f09-9aee-58e1f83abb4a tempest-SnapshotDependencyTests-619562385 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:18:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3b8b4058-4d7e-4f09-9aee-58e1f83abb4a tempest-SnapshotDependencyTests-619562385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8bdf3f1a-5269-49f4-a996-9ec8190cb73e 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:18:22 devstack sudo[101721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8bdf3f1a-5269-49f4-a996-9ec8190cb73e 1073741824 Jul 10 10:18:22 devstack sudo[101721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:18:23 devstack sudo[101719]: pam_unix(sudo:session): session closed for user root Jul 10 10:18:23 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e1ac4120-39dd-48f6-83a8-af72b770baac tempest-GroupSnapshotsTest-1289579137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f4118196-3721-482b-9e48-fbe7b1566331" returned: 0 in 1.155s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:18:23 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e1ac4120-39dd-48f6-83a8-af72b770baac tempest-GroupSnapshotsTest-1289579137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f4118196-3721-482b-9e48-fbe7b1566331.ea8f45a6-583c-4c4f-8885-934ebbcafcaf {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:18:23 devstack sudo[101730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f4118196-3721-482b-9e48-fbe7b1566331.ea8f45a6-583c-4c4f-8885-934ebbcafcaf Jul 10 10:18:23 devstack sudo[101730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:18:23 devstack sudo[101721]: pam_unix(sudo:session): session closed for user root Jul 10 10:18:23 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3b8b4058-4d7e-4f09-9aee-58e1f83abb4a tempest-SnapshotDependencyTests-619562385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8bdf3f1a-5269-49f4-a996-9ec8190cb73e 1073741824" returned: 0 in 1.086s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:18:23 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3b8b4058-4d7e-4f09-9aee-58e1f83abb4a tempest-SnapshotDependencyTests-619562385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8bdf3f1a-5269-49f4-a996-9ec8190cb73e {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:18:24 devstack sudo[101732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8bdf3f1a-5269-49f4-a996-9ec8190cb73e Jul 10 10:18:24 devstack sudo[101732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:18:24 devstack sudo[101730]: pam_unix(sudo:session): session closed for user root Jul 10 10:18:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e1ac4120-39dd-48f6-83a8-af72b770baac tempest-GroupSnapshotsTest-1289579137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f4118196-3721-482b-9e48-fbe7b1566331.ea8f45a6-583c-4c4f-8885-934ebbcafcaf" returned: 0 in 0.890s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:18:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e1ac4120-39dd-48f6-83a8-af72b770baac tempest-GroupSnapshotsTest-1289579137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f4118196-3721-482b-9e48-fbe7b1566331.ea8f45a6-583c-4c4f-8885-934ebbcafcaf {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:18:24 devstack sudo[101739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f4118196-3721-482b-9e48-fbe7b1566331.ea8f45a6-583c-4c4f-8885-934ebbcafcaf Jul 10 10:18:24 devstack sudo[101739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:18:24 devstack sudo[101732]: pam_unix(sudo:session): session closed for user root Jul 10 10:18:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3b8b4058-4d7e-4f09-9aee-58e1f83abb4a tempest-SnapshotDependencyTests-619562385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8bdf3f1a-5269-49f4-a996-9ec8190cb73e" returned: 0 in 0.804s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:18:24 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-3b8b4058-4d7e-4f09-9aee-58e1f83abb4a tempest-SnapshotDependencyTests-619562385 None] <== create_volume: return (1972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:18:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-3b8b4058-4d7e-4f09-9aee-58e1f83abb4a tempest-SnapshotDependencyTests-619562385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.979s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:18:24 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3b8b4058-4d7e-4f09-9aee-58e1f83abb4a tempest-SnapshotDependencyTests-619562385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f2ad3f7-1373-4d94-890c-4555935eaa20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bdf3f1a-5269-49f4-a996-9ec8190cb73e', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:18:24 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3b8b4058-4d7e-4f09-9aee-58e1f83abb4a tempest-SnapshotDependencyTests-619562385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c06e8e5-8009-4162-85a1-4168b65718a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:18:24 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-3b8b4058-4d7e-4f09-9aee-58e1f83abb4a tempest-SnapshotDependencyTests-619562385 None] Volume volume-8bdf3f1a-5269-49f4-a996-9ec8190cb73e (8bdf3f1a-5269-49f4-a996-9ec8190cb73e): created successfully Jul 10 10:18:24 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3b8b4058-4d7e-4f09-9aee-58e1f83abb4a tempest-SnapshotDependencyTests-619562385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c06e8e5-8009-4162-85a1-4168b65718a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:18:24 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3b8b4058-4d7e-4f09-9aee-58e1f83abb4a tempest-SnapshotDependencyTests-619562385 None] Flow 'volume_create_manager' (f3f006f8-4413-4a33-a72b-420a9d9b86e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:18:24 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-3b8b4058-4d7e-4f09-9aee-58e1f83abb4a tempest-SnapshotDependencyTests-619562385 None] Created volume successfully. Jul 10 10:18:25 devstack sudo[101739]: pam_unix(sudo:session): session closed for user root Jul 10 10:18:25 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e1ac4120-39dd-48f6-83a8-af72b770baac tempest-GroupSnapshotsTest-1289579137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f4118196-3721-482b-9e48-fbe7b1566331.ea8f45a6-583c-4c4f-8885-934ebbcafcaf" returned: 0 in 0.684s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:18:25 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-e1ac4120-39dd-48f6-83a8-af72b770baac tempest-GroupSnapshotsTest-1289579137 None] Lock "cinder-quobyte-ea8f45a6-583c-4c4f-8885-934ebbcafcaf" released by "_delete_snapshot" :: held 3.821s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:18:25 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-e1ac4120-39dd-48f6-83a8-af72b770baac tempest-GroupSnapshotsTest-1289579137 None] Lock "cinder-quobyte-f4118196-3721-482b-9e48-fbe7b1566331" released by "delete_snapshot" :: held 3.857s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:18:25 devstack cinder-volume[87234]: WARNING cinder.quota [None req-e1ac4120-39dd-48f6-83a8-af72b770baac tempest-GroupSnapshotsTest-1289579137 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1367846378 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1367846378, it is now deprecated. Please use the default quota class for default quota. Jul 10 10:18:25 devstack cinder-volume[87234]: WARNING cinder.quota [None req-e1ac4120-39dd-48f6-83a8-af72b770baac tempest-GroupSnapshotsTest-1289579137 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1367846378 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1367846378, it is now deprecated. Please use the default quota class for default quota. Jul 10 10:18:25 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-e1ac4120-39dd-48f6-83a8-af72b770baac tempest-GroupSnapshotsTest-1289579137 None] Created reservations ['8497da43-466f-4e09-a610-e9c265aa3483', '13d9b5c7-418d-4d3c-b3ae-e17fd8cbb194', '2d7e71f3-623b-44bb-a6bc-1433af1da1e9', 'cc683512-aa92-4103-83d5-f10011c54a86'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:18:25 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-e1ac4120-39dd-48f6-83a8-af72b770baac tempest-GroupSnapshotsTest-1289579137 None] Created reservations ['0322f387-5a51-47be-9395-72f50ad60606', '73ffb2a7-86d0-463c-b174-22dd62b07d30', '486e0428-3d89-4f26-9c2a-bd2286f97f83', '369e6a91-b77a-4337-a1ec-7b08cff087ce'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:18:25 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-e1ac4120-39dd-48f6-83a8-af72b770baac tempest-GroupSnapshotsTest-1289579137 None] group_snapshot 6ea3dc9d-d533-483f-a844-90a0334af972: deleted successfully Jul 10 10:18:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-fca097a1-4184-4d3c-9cea-09ca4ea8c9d7 tempest-SnapshotDependencyTests-619562385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:18:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-fca097a1-4184-4d3c-9cea-09ca4ea8c9d7 tempest-SnapshotDependencyTests-619562385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:18:26 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-fca097a1-4184-4d3c-9cea-09ca4ea8c9d7 tempest-SnapshotDependencyTests-619562385 None] Creating offline snapshot 1f141331-4ad2-42a8-a918-5b2de168c593 of volume 8bdf3f1a-5269-49f4-a996-9ec8190cb73e {{(pid=87234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 10:18:26 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[135b8ffe-4a1f-42b1-bc3e-bbd8eb208c62]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:18:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fca097a1-4184-4d3c-9cea-09ca4ea8c9d7 tempest-SnapshotDependencyTests-619562385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8bdf3f1a-5269-49f4-a996-9ec8190cb73e {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:18:26 devstack sudo[101742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8bdf3f1a-5269-49f4-a996-9ec8190cb73e Jul 10 10:18:26 devstack sudo[101742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:18:26 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f160570a-06c2-4717-a044-347929e0e137 tempest-GroupSnapshotsTest-1289579137 None] Acquiring lock "cinder-quobyte-d308f471-88f9-474b-b936-3a86cfe5e72d" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:18:26 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f160570a-06c2-4717-a044-347929e0e137 tempest-GroupSnapshotsTest-1289579137 None] Lock "cinder-quobyte-d308f471-88f9-474b-b936-3a86cfe5e72d" acquired by "delete_volume" :: waited 0.024s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:18:27 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4fe371-888c-4066-8bcb-620c31fbf868]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:18:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f160570a-06c2-4717-a044-347929e0e137 tempest-GroupSnapshotsTest-1289579137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d308f471-88f9-474b-b936-3a86cfe5e72d {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:18:27 devstack sudo[101747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d308f471-88f9-474b-b936-3a86cfe5e72d Jul 10 10:18:27 devstack sudo[101747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:18:27 devstack sudo[101742]: pam_unix(sudo:session): session closed for user root Jul 10 10:18:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fca097a1-4184-4d3c-9cea-09ca4ea8c9d7 tempest-SnapshotDependencyTests-619562385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8bdf3f1a-5269-49f4-a996-9ec8190cb73e" returned: 0 in 0.973s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:18:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fca097a1-4184-4d3c-9cea-09ca4ea8c9d7 tempest-SnapshotDependencyTests-619562385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8bdf3f1a-5269-49f4-a996-9ec8190cb73e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8bdf3f1a-5269-49f4-a996-9ec8190cb73e.1f141331-4ad2-42a8-a918-5b2de168c593 1G {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:18:27 devstack sudo[101750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8bdf3f1a-5269-49f4-a996-9ec8190cb73e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8bdf3f1a-5269-49f4-a996-9ec8190cb73e.1f141331-4ad2-42a8-a918-5b2de168c593 1G Jul 10 10:18:27 devstack sudo[101750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:18:27 devstack sudo[101747]: pam_unix(sudo:session): session closed for user root Jul 10 10:18:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f160570a-06c2-4717-a044-347929e0e137 tempest-GroupSnapshotsTest-1289579137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d308f471-88f9-474b-b936-3a86cfe5e72d" returned: 0 in 0.831s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:18:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f160570a-06c2-4717-a044-347929e0e137 tempest-GroupSnapshotsTest-1289579137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d308f471-88f9-474b-b936-3a86cfe5e72d {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:18:27 devstack sudo[101759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d308f471-88f9-474b-b936-3a86cfe5e72d Jul 10 10:18:27 devstack sudo[101759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:18:28 devstack sudo[101750]: pam_unix(sudo:session): session closed for user root Jul 10 10:18:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fca097a1-4184-4d3c-9cea-09ca4ea8c9d7 tempest-SnapshotDependencyTests-619562385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8bdf3f1a-5269-49f4-a996-9ec8190cb73e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8bdf3f1a-5269-49f4-a996-9ec8190cb73e.1f141331-4ad2-42a8-a918-5b2de168c593 1G" returned: 0 in 0.961s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:18:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fca097a1-4184-4d3c-9cea-09ca4ea8c9d7 tempest-SnapshotDependencyTests-619562385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8bdf3f1a-5269-49f4-a996-9ec8190cb73e -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8bdf3f1a-5269-49f4-a996-9ec8190cb73e.1f141331-4ad2-42a8-a918-5b2de168c593 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:18:28 devstack sudo[101761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8bdf3f1a-5269-49f4-a996-9ec8190cb73e -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8bdf3f1a-5269-49f4-a996-9ec8190cb73e.1f141331-4ad2-42a8-a918-5b2de168c593 Jul 10 10:18:28 devstack sudo[101761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:18:28 devstack sudo[101759]: pam_unix(sudo:session): session closed for user root Jul 10 10:18:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f160570a-06c2-4717-a044-347929e0e137 tempest-GroupSnapshotsTest-1289579137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d308f471-88f9-474b-b936-3a86cfe5e72d" returned: 0 in 0.770s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:18:28 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f160570a-06c2-4717-a044-347929e0e137 tempest-GroupSnapshotsTest-1289579137 None] Lock "cinder-quobyte-d308f471-88f9-474b-b936-3a86cfe5e72d" released by "delete_volume" :: held 1.700s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:18:28 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f160570a-06c2-4717-a044-347929e0e137 tempest-GroupSnapshotsTest-1289579137 None] Acquiring lock "cinder-quobyte-f4118196-3721-482b-9e48-fbe7b1566331" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:18:28 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f160570a-06c2-4717-a044-347929e0e137 tempest-GroupSnapshotsTest-1289579137 None] Lock "cinder-quobyte-f4118196-3721-482b-9e48-fbe7b1566331" acquired by "delete_volume" :: waited 0.019s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:18:28 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe407fe-4eb1-4f64-bf96-6c30aede772a]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:18:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f160570a-06c2-4717-a044-347929e0e137 tempest-GroupSnapshotsTest-1289579137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f4118196-3721-482b-9e48-fbe7b1566331 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:18:28 devstack sudo[101764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f4118196-3721-482b-9e48-fbe7b1566331 Jul 10 10:18:28 devstack sudo[101764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:18:28 devstack sudo[101761]: pam_unix(sudo:session): session closed for user root Jul 10 10:18:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fca097a1-4184-4d3c-9cea-09ca4ea8c9d7 tempest-SnapshotDependencyTests-619562385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8bdf3f1a-5269-49f4-a996-9ec8190cb73e -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8bdf3f1a-5269-49f4-a996-9ec8190cb73e.1f141331-4ad2-42a8-a918-5b2de168c593" returned: 0 in 0.824s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:18:28 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-fca097a1-4184-4d3c-9cea-09ca4ea8c9d7 tempest-SnapshotDependencyTests-619562385 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8bdf3f1a-5269-49f4-a996-9ec8190cb73e.1f141331-4ad2-42a8-a918-5b2de168c593 is being set with open permissions: ugo+rw Jul 10 10:18:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fca097a1-4184-4d3c-9cea-09ca4ea8c9d7 tempest-SnapshotDependencyTests-619562385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8bdf3f1a-5269-49f4-a996-9ec8190cb73e.1f141331-4ad2-42a8-a918-5b2de168c593 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:18:29 devstack sudo[101769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8bdf3f1a-5269-49f4-a996-9ec8190cb73e.1f141331-4ad2-42a8-a918-5b2de168c593 Jul 10 10:18:29 devstack sudo[101769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:18:29 devstack sudo[101764]: pam_unix(sudo:session): session closed for user root Jul 10 10:18:29 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f160570a-06c2-4717-a044-347929e0e137 tempest-GroupSnapshotsTest-1289579137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f4118196-3721-482b-9e48-fbe7b1566331" returned: 0 in 0.877s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:18:29 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f160570a-06c2-4717-a044-347929e0e137 tempest-GroupSnapshotsTest-1289579137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f4118196-3721-482b-9e48-fbe7b1566331 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:18:29 devstack sudo[101776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f4118196-3721-482b-9e48-fbe7b1566331 Jul 10 10:18:29 devstack sudo[101776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:18:29 devstack sudo[101769]: pam_unix(sudo:session): session closed for user root Jul 10 10:18:29 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fca097a1-4184-4d3c-9cea-09ca4ea8c9d7 tempest-SnapshotDependencyTests-619562385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8bdf3f1a-5269-49f4-a996-9ec8190cb73e.1f141331-4ad2-42a8-a918-5b2de168c593" returned: 0 in 0.751s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:18:29 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fca097a1-4184-4d3c-9cea-09ca4ea8c9d7 tempest-SnapshotDependencyTests-619562385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8bdf3f1a-5269-49f4-a996-9ec8190cb73e.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:18:29 devstack sudo[101778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8bdf3f1a-5269-49f4-a996-9ec8190cb73e.info Jul 10 10:18:29 devstack sudo[101778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:18:30 devstack sudo[101776]: pam_unix(sudo:session): session closed for user root Jul 10 10:18:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f160570a-06c2-4717-a044-347929e0e137 tempest-GroupSnapshotsTest-1289579137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f4118196-3721-482b-9e48-fbe7b1566331" returned: 0 in 0.909s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:18:30 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f160570a-06c2-4717-a044-347929e0e137 tempest-GroupSnapshotsTest-1289579137 None] Lock "cinder-quobyte-f4118196-3721-482b-9e48-fbe7b1566331" released by "delete_volume" :: held 1.869s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:18:30 devstack sudo[101778]: pam_unix(sudo:session): session closed for user root Jul 10 10:18:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fca097a1-4184-4d3c-9cea-09ca4ea8c9d7 tempest-SnapshotDependencyTests-619562385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8bdf3f1a-5269-49f4-a996-9ec8190cb73e.info" returned: 0 in 0.804s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:18:30 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-fca097a1-4184-4d3c-9cea-09ca4ea8c9d7 tempest-SnapshotDependencyTests-619562385 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8bdf3f1a-5269-49f4-a996-9ec8190cb73e.info is being set with open permissions: ugo+rw Jul 10 10:18:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fca097a1-4184-4d3c-9cea-09ca4ea8c9d7 tempest-SnapshotDependencyTests-619562385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8bdf3f1a-5269-49f4-a996-9ec8190cb73e.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:18:30 devstack sudo[101788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8bdf3f1a-5269-49f4-a996-9ec8190cb73e.info Jul 10 10:18:30 devstack sudo[101788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:18:30 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-f160570a-06c2-4717-a044-347929e0e137 tempest-GroupSnapshotsTest-1289579137 None] Created reservations ['f06b45f9-44e5-4b9a-b544-37c5aed96a9b'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:18:30 devstack cinder-volume[87234]: WARNING cinder.quota [None req-f160570a-06c2-4717-a044-347929e0e137 tempest-GroupSnapshotsTest-1289579137 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1367846378 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1367846378, it is now deprecated. Please use the default quota class for default quota. Jul 10 10:18:30 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-f160570a-06c2-4717-a044-347929e0e137 tempest-GroupSnapshotsTest-1289579137 None] Created reservations ['30ebe4a5-8787-476d-b479-f11c7dfc6c3b', 'a41aebc1-b1fa-4b98-bd0b-e2d46db3b2be', 'bacb59cc-1e3d-4502-afa6-6638620e1973', 'a9452360-45ce-4868-9c89-32fb61bd5509'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:18:30 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-f160570a-06c2-4717-a044-347929e0e137 tempest-GroupSnapshotsTest-1289579137 None] Created reservations ['cbd37c97-e3be-4b19-afcc-347fafc45d1b', '52afcd2c-4859-48de-92e5-cc7a8e0c68ef', '2102d856-5d6d-49d7-bc82-c273aba77ae8', '6fdd7c80-9174-4a09-9f7e-39acf099ab07'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:18:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f160570a-06c2-4717-a044-347929e0e137 tempest-GroupSnapshotsTest-1289579137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:18:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f160570a-06c2-4717-a044-347929e0e137 tempest-GroupSnapshotsTest-1289579137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:18:31 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f160570a-06c2-4717-a044-347929e0e137 tempest-GroupSnapshotsTest-1289579137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:18:31 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f160570a-06c2-4717-a044-347929e0e137 tempest-GroupSnapshotsTest-1289579137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:18:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f160570a-06c2-4717-a044-347929e0e137 tempest-GroupSnapshotsTest-1289579137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:18:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f160570a-06c2-4717-a044-347929e0e137 tempest-GroupSnapshotsTest-1289579137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:18:31 devstack sudo[101790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:18:31 devstack sudo[101790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:18:31 devstack sudo[101788]: pam_unix(sudo:session): session closed for user root Jul 10 10:18:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fca097a1-4184-4d3c-9cea-09ca4ea8c9d7 tempest-SnapshotDependencyTests-619562385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8bdf3f1a-5269-49f4-a996-9ec8190cb73e.info" returned: 0 in 0.818s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:18:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-fca097a1-4184-4d3c-9cea-09ca4ea8c9d7 tempest-SnapshotDependencyTests-619562385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.256s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:18:31 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-fca097a1-4184-4d3c-9cea-09ca4ea8c9d7 tempest-SnapshotDependencyTests-619562385 None] Create snapshot completed successfully Jul 10 10:18:31 devstack sudo[101790]: pam_unix(sudo:session): session closed for user root Jul 10 10:18:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f160570a-06c2-4717-a044-347929e0e137 tempest-GroupSnapshotsTest-1289579137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.737s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:18:31 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-f160570a-06c2-4717-a044-347929e0e137 tempest-GroupSnapshotsTest-1289579137 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:18:31 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-f160570a-06c2-4717-a044-347929e0e137 tempest-GroupSnapshotsTest-1289579137 None] Delete group completed successfully. Jul 10 10:18:32 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-3647aa0f-d8fa-4ac1-a168-fc3c86700cbf tempest-GroupSnapshotsTest-1289579137 None] Group tempest-GroupSnapshotsTest-Group-1866738263: creating Jul 10 10:18:32 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-3647aa0f-d8fa-4ac1-a168-fc3c86700cbf tempest-GroupSnapshotsTest-1289579137 None] Group tempest-GroupSnapshotsTest-Group-1866738263: created successfully Jul 10 10:18:32 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-3647aa0f-d8fa-4ac1-a168-fc3c86700cbf tempest-GroupSnapshotsTest-1289579137 None] Create group completed successfully. Jul 10 10:18:33 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-883523ff-5fba-405c-bdfa-9b82078eebb9 tempest-SnapshotDependencyTests-619562385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:18:33 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-883523ff-5fba-405c-bdfa-9b82078eebb9 tempest-SnapshotDependencyTests-619562385 None] Flow 'volume_create_manager' (7d57eadb-1efb-4e05-b910-7ac2fe033fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:18:33 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-883523ff-5fba-405c-bdfa-9b82078eebb9 tempest-SnapshotDependencyTests-619562385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1795160e-20cc-42ef-b7d7-a61990ae2f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:18:33 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-883523ff-5fba-405c-bdfa-9b82078eebb9 tempest-SnapshotDependencyTests-619562385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1795160e-20cc-42ef-b7d7-a61990ae2f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:18:33Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8929cb88-f276-4ac0-a578-d75db4a83264,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='643b5da94f4f48a3a9b986e780dbe949',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:18:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1f141331-4ad2-42a8-a918-5b2de168c593,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:18:33Z,use_quota=True,user_id='8fe9c87764c0474d9b570055c1b29d34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:18:33 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-883523ff-5fba-405c-bdfa-9b82078eebb9 tempest-SnapshotDependencyTests-619562385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b121132-5841-4e5b-add6-2f09bc9bfe46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:18:33 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-883523ff-5fba-405c-bdfa-9b82078eebb9 tempest-SnapshotDependencyTests-619562385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b121132-5841-4e5b-add6-2f09bc9bfe46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:18:33 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-883523ff-5fba-405c-bdfa-9b82078eebb9 tempest-SnapshotDependencyTests-619562385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9dde472-81e1-44ab-9f95-c2fa3920768c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:18:33 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-883523ff-5fba-405c-bdfa-9b82078eebb9 tempest-SnapshotDependencyTests-619562385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9dde472-81e1-44ab-9f95-c2fa3920768c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8929cb88-f276-4ac0-a578-d75db4a83264', 'volume_name': 'volume-8929cb88-f276-4ac0-a578-d75db4a83264', 'volume_size': 1, 'snapshot_id': '1f141331-4ad2-42a8-a918-5b2de168c593'}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:18:33 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-883523ff-5fba-405c-bdfa-9b82078eebb9 tempest-SnapshotDependencyTests-619562385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (021491fb-d507-4d7e-8a35-0333712276a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:18:33 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-883523ff-5fba-405c-bdfa-9b82078eebb9 tempest-SnapshotDependencyTests-619562385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (021491fb-d507-4d7e-8a35-0333712276a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:18:33 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-883523ff-5fba-405c-bdfa-9b82078eebb9 tempest-SnapshotDependencyTests-619562385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ef462b2-feb8-4b1c-af10-afe0cc30b253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:18:33 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-883523ff-5fba-405c-bdfa-9b82078eebb9 tempest-SnapshotDependencyTests-619562385 None] Volume 8929cb88-f276-4ac0-a578-d75db4a83264: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8929cb88-f276-4ac0-a578-d75db4a83264', 'volume_size': 1, 'snapshot_id': '1f141331-4ad2-42a8-a918-5b2de168c593'} Jul 10 10:18:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-883523ff-5fba-405c-bdfa-9b82078eebb9 tempest-SnapshotDependencyTests-619562385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:18:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-883523ff-5fba-405c-bdfa-9b82078eebb9 tempest-SnapshotDependencyTests-619562385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:18:33 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-883523ff-5fba-405c-bdfa-9b82078eebb9 tempest-SnapshotDependencyTests-619562385 None] Acquiring lock "cinder-quobyte-1f141331-4ad2-42a8-a918-5b2de168c593-8929cb88-f276-4ac0-a578-d75db4a83264" by "_create_volume_from_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:18:33 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-883523ff-5fba-405c-bdfa-9b82078eebb9 tempest-SnapshotDependencyTests-619562385 None] Lock "cinder-quobyte-1f141331-4ad2-42a8-a918-5b2de168c593-8929cb88-f276-4ac0-a578-d75db4a83264" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:18:33 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-883523ff-5fba-405c-bdfa-9b82078eebb9 tempest-SnapshotDependencyTests-619562385 None] Creating volume 8929cb88-f276-4ac0-a578-d75db4a83264 from snapshot 1f141331-4ad2-42a8-a918-5b2de168c593 {{(pid=87234) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 10:18:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-883523ff-5fba-405c-bdfa-9b82078eebb9 tempest-SnapshotDependencyTests-619562385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:18:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-883523ff-5fba-405c-bdfa-9b82078eebb9 tempest-SnapshotDependencyTests-619562385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:18:33 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-883523ff-5fba-405c-bdfa-9b82078eebb9 tempest-SnapshotDependencyTests-619562385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:18:33 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-883523ff-5fba-405c-bdfa-9b82078eebb9 tempest-SnapshotDependencyTests-619562385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:18:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-883523ff-5fba-405c-bdfa-9b82078eebb9 tempest-SnapshotDependencyTests-619562385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:18:33 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-883523ff-5fba-405c-bdfa-9b82078eebb9 tempest-SnapshotDependencyTests-619562385 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:18:33 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-883523ff-5fba-405c-bdfa-9b82078eebb9 tempest-SnapshotDependencyTests-619562385 None] Acquiring lock "cinder-quobyte-8929cb88-f276-4ac0-a578-d75db4a83264" by "_copy_volume_from_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:18:33 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-883523ff-5fba-405c-bdfa-9b82078eebb9 tempest-SnapshotDependencyTests-619562385 None] Lock "cinder-quobyte-8929cb88-f276-4ac0-a578-d75db4a83264" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:18:33 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-883523ff-5fba-405c-bdfa-9b82078eebb9 tempest-SnapshotDependencyTests-619562385 None] snapshot: 1f141331-4ad2-42a8-a918-5b2de168c593, volume: 8929cb88-f276-4ac0-a578-d75db4a83264, {{(pid=87234) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 10:18:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-883523ff-5fba-405c-bdfa-9b82078eebb9 tempest-SnapshotDependencyTests-619562385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:18:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-883523ff-5fba-405c-bdfa-9b82078eebb9 tempest-SnapshotDependencyTests-619562385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:18:33 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-883523ff-5fba-405c-bdfa-9b82078eebb9 tempest-SnapshotDependencyTests-619562385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:18:33 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-883523ff-5fba-405c-bdfa-9b82078eebb9 tempest-SnapshotDependencyTests-619562385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:18:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-883523ff-5fba-405c-bdfa-9b82078eebb9 tempest-SnapshotDependencyTests-619562385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:18:33 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[845f57e7-3878-4665-af14-da11e94f81c1]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:18:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-883523ff-5fba-405c-bdfa-9b82078eebb9 tempest-SnapshotDependencyTests-619562385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8bdf3f1a-5269-49f4-a996-9ec8190cb73e.1f141331-4ad2-42a8-a918-5b2de168c593 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:18:33 devstack sudo[101794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8bdf3f1a-5269-49f4-a996-9ec8190cb73e.1f141331-4ad2-42a8-a918-5b2de168c593 Jul 10 10:18:33 devstack sudo[101794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:18:34 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f90bcd4-d794-4522-b7a4-d62454f712c9 tempest-GroupSnapshotsTest-1289579137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:18:34 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8f90bcd4-d794-4522-b7a4-d62454f712c9 tempest-GroupSnapshotsTest-1289579137 None] Flow 'volume_create_manager' (982999c8-d58a-4f48-9008-9110cfdcaed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:18:34 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8f90bcd4-d794-4522-b7a4-d62454f712c9 tempest-GroupSnapshotsTest-1289579137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f61e4b34-ac14-48be-9f6d-d6e0dd2c7011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:18:34 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8f90bcd4-d794-4522-b7a4-d62454f712c9 tempest-GroupSnapshotsTest-1289579137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f61e4b34-ac14-48be-9f6d-d6e0dd2c7011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:18:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1618415603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=274d37f3-e564-418c-b358-8e58e962f1f3,host='devstack@QuobyteHD#QuobyteHD',id=b85e2d62-0e57-47f3-92d1-0e1248e75128,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='097deae9d776484f839e860f9201642c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:18:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:18:34Z,use_quota=True,user_id='b6dd8f50a48f4f01a6a6fab14fe85583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9af6704c-e3e8-4d95-ba9b-e8769371719f),volume_type_id=9af6704c-e3e8-4d95-ba9b-e8769371719f)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:18:34 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8f90bcd4-d794-4522-b7a4-d62454f712c9 tempest-GroupSnapshotsTest-1289579137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd291f17-0929-4552-928e-5f5cf07c1fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:18:34 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8f90bcd4-d794-4522-b7a4-d62454f712c9 tempest-GroupSnapshotsTest-1289579137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd291f17-0929-4552-928e-5f5cf07c1fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:18:34 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8f90bcd4-d794-4522-b7a4-d62454f712c9 tempest-GroupSnapshotsTest-1289579137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (717e3594-1a4a-45e9-881c-6f811121d861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:18:34 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8f90bcd4-d794-4522-b7a4-d62454f712c9 tempest-GroupSnapshotsTest-1289579137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (717e3594-1a4a-45e9-881c-6f811121d861) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b85e2d62-0e57-47f3-92d1-0e1248e75128', 'volume_name': 'volume-b85e2d62-0e57-47f3-92d1-0e1248e75128', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:18:34 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8f90bcd4-d794-4522-b7a4-d62454f712c9 tempest-GroupSnapshotsTest-1289579137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14455629-eeef-46ea-a136-67182b232e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:18:34 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8f90bcd4-d794-4522-b7a4-d62454f712c9 tempest-GroupSnapshotsTest-1289579137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14455629-eeef-46ea-a136-67182b232e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:18:34 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8f90bcd4-d794-4522-b7a4-d62454f712c9 tempest-GroupSnapshotsTest-1289579137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (398934c1-4892-485d-90a5-cf5d9b760c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:18:34 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-8f90bcd4-d794-4522-b7a4-d62454f712c9 tempest-GroupSnapshotsTest-1289579137 None] Volume b85e2d62-0e57-47f3-92d1-0e1248e75128: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b85e2d62-0e57-47f3-92d1-0e1248e75128', 'volume_size': 1} Jul 10 10:18:34 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-8f90bcd4-d794-4522-b7a4-d62454f712c9 tempest-GroupSnapshotsTest-1289579137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:18:34 devstack sudo[101794]: pam_unix(sudo:session): session closed for user root Jul 10 10:18:34 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-883523ff-5fba-405c-bdfa-9b82078eebb9 tempest-SnapshotDependencyTests-619562385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8bdf3f1a-5269-49f4-a996-9ec8190cb73e.1f141331-4ad2-42a8-a918-5b2de168c593" returned: 0 in 0.885s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:18:34 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-883523ff-5fba-405c-bdfa-9b82078eebb9 tempest-SnapshotDependencyTests-619562385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8bdf3f1a-5269-49f4-a996-9ec8190cb73e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 10:18:34 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-883523ff-5fba-405c-bdfa-9b82078eebb9 tempest-SnapshotDependencyTests-619562385 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8bdf3f1a-5269-49f4-a996-9ec8190cb73e {{(pid=87234) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 10:18:34 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-883523ff-5fba-405c-bdfa-9b82078eebb9 tempest-SnapshotDependencyTests-619562385 None] Creating direct copy from snapshot {{(pid=87234) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 10:18:34 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c2c09eb-7e9b-411f-9666-148bf2409ff6 tempest-TestStampPattern-1267302871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:18:34 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1c2c09eb-7e9b-411f-9666-148bf2409ff6 tempest-TestStampPattern-1267302871 None] Flow 'volume_create_manager' (1c2af245-3423-4c9c-8a97-f59f30ae8f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:18:34 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1c2c09eb-7e9b-411f-9666-148bf2409ff6 tempest-TestStampPattern-1267302871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c31f4635-a414-42bb-ac65-74493a4f0fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:18:34 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b72c575-a8cb-4d43-a470-506c42eb3870]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:18:34 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-883523ff-5fba-405c-bdfa-9b82078eebb9 tempest-SnapshotDependencyTests-619562385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8bdf3f1a-5269-49f4-a996-9ec8190cb73e {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:18:34 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1c2c09eb-7e9b-411f-9666-148bf2409ff6 tempest-TestStampPattern-1267302871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c31f4635-a414-42bb-ac65-74493a4f0fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:18:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-374584247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f87bb0f-5ab5-4897-939c-fa8c133c13e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1290cc3c2e944a8580c50da797829c5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:18:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:18:34Z,use_quota=True,user_id='349c37595e5e49868d55fdceb305b0ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:18:34 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1c2c09eb-7e9b-411f-9666-148bf2409ff6 tempest-TestStampPattern-1267302871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80f266c1-f95e-40e4-a370-2d915a312cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:18:34 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1c2c09eb-7e9b-411f-9666-148bf2409ff6 tempest-TestStampPattern-1267302871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80f266c1-f95e-40e4-a370-2d915a312cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:18:34 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1c2c09eb-7e9b-411f-9666-148bf2409ff6 tempest-TestStampPattern-1267302871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (964ddc99-8d6c-4b03-8ba8-dfc7ee41f787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:18:34 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1c2c09eb-7e9b-411f-9666-148bf2409ff6 tempest-TestStampPattern-1267302871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (964ddc99-8d6c-4b03-8ba8-dfc7ee41f787) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f87bb0f-5ab5-4897-939c-fa8c133c13e3', 'volume_name': 'volume-7f87bb0f-5ab5-4897-939c-fa8c133c13e3', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:18:34 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1c2c09eb-7e9b-411f-9666-148bf2409ff6 tempest-TestStampPattern-1267302871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be48ee08-323a-4f54-a128-5c4a307bdb1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:18:34 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1c2c09eb-7e9b-411f-9666-148bf2409ff6 tempest-TestStampPattern-1267302871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be48ee08-323a-4f54-a128-5c4a307bdb1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:18:34 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1c2c09eb-7e9b-411f-9666-148bf2409ff6 tempest-TestStampPattern-1267302871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f4cf49b-58ae-4a57-a43e-12a72f72b00d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:18:34 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-1c2c09eb-7e9b-411f-9666-148bf2409ff6 tempest-TestStampPattern-1267302871 None] Volume 7f87bb0f-5ab5-4897-939c-fa8c133c13e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f87bb0f-5ab5-4897-939c-fa8c133c13e3', 'volume_size': 1} Jul 10 10:18:34 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-1c2c09eb-7e9b-411f-9666-148bf2409ff6 tempest-TestStampPattern-1267302871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:18:34 devstack sudo[101800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8bdf3f1a-5269-49f4-a996-9ec8190cb73e Jul 10 10:18:34 devstack sudo[101800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:18:35 devstack sudo[101800]: pam_unix(sudo:session): session closed for user root Jul 10 10:18:35 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-883523ff-5fba-405c-bdfa-9b82078eebb9 tempest-SnapshotDependencyTests-619562385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8bdf3f1a-5269-49f4-a996-9ec8190cb73e" returned: 0 in 0.872s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:18:35 devstack cinder-volume[87234]: DEBUG cinder.utils [None req-883523ff-5fba-405c-bdfa-9b82078eebb9 tempest-SnapshotDependencyTests-619562385 None] Path /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8929cb88-f276-4ac0-a578-d75db4a83264 not found in is_blk_device check {{(pid=87234) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 10:18:35 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-883523ff-5fba-405c-bdfa-9b82078eebb9 tempest-SnapshotDependencyTests-619562385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8bdf3f1a-5269-49f4-a996-9ec8190cb73e /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8929cb88-f276-4ac0-a578-d75db4a83264 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:18:35 devstack sudo[101808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8bdf3f1a-5269-49f4-a996-9ec8190cb73e /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8929cb88-f276-4ac0-a578-d75db4a83264 Jul 10 10:18:35 devstack sudo[101808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:18:40 devstack sudo[101808]: pam_unix(sudo:session): session closed for user root Jul 10 10:18:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-883523ff-5fba-405c-bdfa-9b82078eebb9 tempest-SnapshotDependencyTests-619562385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8bdf3f1a-5269-49f4-a996-9ec8190cb73e /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8929cb88-f276-4ac0-a578-d75db4a83264" returned: 0 in 5.074s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:18:40 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[256b7bfb-0926-4ec2-bc52-3b3cafdd1977]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:18:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-883523ff-5fba-405c-bdfa-9b82078eebb9 tempest-SnapshotDependencyTests-619562385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8bdf3f1a-5269-49f4-a996-9ec8190cb73e {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:18:40 devstack sudo[101822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8bdf3f1a-5269-49f4-a996-9ec8190cb73e Jul 10 10:18:40 devstack sudo[101822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:18:41 devstack sudo[101822]: pam_unix(sudo:session): session closed for user root Jul 10 10:18:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-883523ff-5fba-405c-bdfa-9b82078eebb9 tempest-SnapshotDependencyTests-619562385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8bdf3f1a-5269-49f4-a996-9ec8190cb73e" returned: 0 in 1.093s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:18:41 devstack cinder-volume[87234]: DEBUG cinder.image.image_utils [None req-883523ff-5fba-405c-bdfa-9b82078eebb9 tempest-SnapshotDependencyTests-619562385 None] Image conversion details: src /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8bdf3f1a-5269-49f4-a996-9ec8190cb73e, size 1024.00 MB, duration 5.07 sec, destination /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8929cb88-f276-4ac0-a578-d75db4a83264 {{(pid=87234) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 10:18:41 devstack cinder-volume[87234]: INFO cinder.image.image_utils [None req-883523ff-5fba-405c-bdfa-9b82078eebb9 tempest-SnapshotDependencyTests-619562385 None] Converted 1024.00 MB image at 201.77 MB/s Jul 10 10:18:41 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-883523ff-5fba-405c-bdfa-9b82078eebb9 tempest-SnapshotDependencyTests-619562385 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8929cb88-f276-4ac0-a578-d75db4a83264 is being set with open permissions: ugo+rw Jul 10 10:18:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-883523ff-5fba-405c-bdfa-9b82078eebb9 tempest-SnapshotDependencyTests-619562385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8929cb88-f276-4ac0-a578-d75db4a83264 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:18:41 devstack sudo[101827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8929cb88-f276-4ac0-a578-d75db4a83264 Jul 10 10:18:41 devstack sudo[101827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:18:42 devstack sudo[101827]: pam_unix(sudo:session): session closed for user root Jul 10 10:18:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-883523ff-5fba-405c-bdfa-9b82078eebb9 tempest-SnapshotDependencyTests-619562385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8929cb88-f276-4ac0-a578-d75db4a83264" returned: 0 in 0.718s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:18:42 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-883523ff-5fba-405c-bdfa-9b82078eebb9 tempest-SnapshotDependencyTests-619562385 None] Lock "cinder-quobyte-8929cb88-f276-4ac0-a578-d75db4a83264" released by "_copy_volume_from_snapshot" :: held 8.797s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:18:42 devstack cinder-volume[87234]: DEBUG oslo_service.periodic_task [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 10:18:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:18:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:18:42 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:18:42 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:18:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:18:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:18:42 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-883523ff-5fba-405c-bdfa-9b82078eebb9 tempest-SnapshotDependencyTests-619562385 None] Lock "cinder-quobyte-1f141331-4ad2-42a8-a918-5b2de168c593-8929cb88-f276-4ac0-a578-d75db4a83264" released by "_create_volume_from_snapshot" :: held 8.866s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:18:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-883523ff-5fba-405c-bdfa-9b82078eebb9 tempest-SnapshotDependencyTests-619562385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.886s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:18:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-8f90bcd4-d794-4522-b7a4-d62454f712c9 tempest-GroupSnapshotsTest-1289579137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.959s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:18:42 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-8f90bcd4-d794-4522-b7a4-d62454f712c9 tempest-GroupSnapshotsTest-1289579137 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=274d37f3-e564-418c-b358-8e58e962f1f3,created_at=2026-07-10T08:18:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1618415603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=274d37f3-e564-418c-b358-8e58e962f1f3,host='devstack@QuobyteHD#QuobyteHD',id=b85e2d62-0e57-47f3-92d1-0e1248e75128,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='097deae9d776484f839e860f9201642c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:18:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:18:34Z,use_quota=True,user_id='b6dd8f50a48f4f01a6a6fab14fe85583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9af6704c-e3e8-4d95-ba9b-e8769371719f),volume_type_id=9af6704c-e3e8-4d95-ba9b-e8769371719f)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:18:42 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-8f90bcd4-d794-4522-b7a4-d62454f712c9 tempest-GroupSnapshotsTest-1289579137 None] Creating volume b85e2d62-0e57-47f3-92d1-0e1248e75128 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:18:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-8f90bcd4-d794-4522-b7a4-d62454f712c9 tempest-GroupSnapshotsTest-1289579137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:18:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-8f90bcd4-d794-4522-b7a4-d62454f712c9 tempest-GroupSnapshotsTest-1289579137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:18:42 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-8f90bcd4-d794-4522-b7a4-d62454f712c9 tempest-GroupSnapshotsTest-1289579137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:18:42 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-8f90bcd4-d794-4522-b7a4-d62454f712c9 tempest-GroupSnapshotsTest-1289579137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:18:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-8f90bcd4-d794-4522-b7a4-d62454f712c9 tempest-GroupSnapshotsTest-1289579137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:18:42 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-8f90bcd4-d794-4522-b7a4-d62454f712c9 tempest-GroupSnapshotsTest-1289579137 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:18:42 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-8f90bcd4-d794-4522-b7a4-d62454f712c9 tempest-GroupSnapshotsTest-1289579137 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:18:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-8f90bcd4-d794-4522-b7a4-d62454f712c9 tempest-GroupSnapshotsTest-1289579137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b85e2d62-0e57-47f3-92d1-0e1248e75128 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:18:42 devstack sudo[101841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:18:42 devstack sudo[101841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:18:42 devstack sudo[101843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b85e2d62-0e57-47f3-92d1-0e1248e75128 1073741824 Jul 10 10:18:42 devstack sudo[101843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:18:42 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-883523ff-5fba-405c-bdfa-9b82078eebb9 tempest-SnapshotDependencyTests-619562385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ef462b2-feb8-4b1c-af10-afe0cc30b253) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8929cb88-f276-4ac0-a578-d75db4a83264', 'volume_size': 1, 'snapshot_id': '1f141331-4ad2-42a8-a918-5b2de168c593'}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:18:42 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-883523ff-5fba-405c-bdfa-9b82078eebb9 tempest-SnapshotDependencyTests-619562385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fee0a4b1-9a24-4f70-a73a-a41ae4a61580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:18:42 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-883523ff-5fba-405c-bdfa-9b82078eebb9 tempest-SnapshotDependencyTests-619562385 None] Volume volume-8929cb88-f276-4ac0-a578-d75db4a83264 (8929cb88-f276-4ac0-a578-d75db4a83264): created successfully Jul 10 10:18:42 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-883523ff-5fba-405c-bdfa-9b82078eebb9 tempest-SnapshotDependencyTests-619562385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fee0a4b1-9a24-4f70-a73a-a41ae4a61580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:18:42 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-883523ff-5fba-405c-bdfa-9b82078eebb9 tempest-SnapshotDependencyTests-619562385 None] Flow 'volume_create_manager' (7d57eadb-1efb-4e05-b910-7ac2fe033fd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:18:42 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-883523ff-5fba-405c-bdfa-9b82078eebb9 tempest-SnapshotDependencyTests-619562385 None] Created volume successfully. Jul 10 10:18:42 devstack sudo[101841]: pam_unix(sudo:session): session closed for user root Jul 10 10:18:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.721s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:18:42 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:18:42 devstack cinder-volume[87234]: DEBUG oslo_service.periodic_task [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Running periodic task VolumeManager._thread_info {{(pid=87234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 10:18:42 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] thread count: 28 {{(pid=87234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 10:18:42 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] thread info: [<_MainThread(MainThread, started 131600773742720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 10:18:43 devstack sudo[101843]: pam_unix(sudo:session): session closed for user root Jul 10 10:18:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-8f90bcd4-d794-4522-b7a4-d62454f712c9 tempest-GroupSnapshotsTest-1289579137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b85e2d62-0e57-47f3-92d1-0e1248e75128 1073741824" returned: 0 in 0.966s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:18:43 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-aac18711-fde1-4141-9f65-705b943d8502 tempest-SnapshotDependencyTests-619562385 None] Acquiring lock "cinder-1f141331-4ad2-42a8-a918-5b2de168c593-delete_snapshot" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:18:43 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-aac18711-fde1-4141-9f65-705b943d8502 tempest-SnapshotDependencyTests-619562385 None] Lock "cinder-1f141331-4ad2-42a8-a918-5b2de168c593-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:18:43 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-aac18711-fde1-4141-9f65-705b943d8502 tempest-SnapshotDependencyTests-619562385 None] Acquiring lock "cinder-quobyte-8bdf3f1a-5269-49f4-a996-9ec8190cb73e" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:18:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-8f90bcd4-d794-4522-b7a4-d62454f712c9 tempest-GroupSnapshotsTest-1289579137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b85e2d62-0e57-47f3-92d1-0e1248e75128 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:18:43 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-aac18711-fde1-4141-9f65-705b943d8502 tempest-SnapshotDependencyTests-619562385 None] Lock "cinder-quobyte-8bdf3f1a-5269-49f4-a996-9ec8190cb73e" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:18:43 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-aac18711-fde1-4141-9f65-705b943d8502 tempest-SnapshotDependencyTests-619562385 None] Acquiring lock "cinder-quobyte-1f141331-4ad2-42a8-a918-5b2de168c593" by "_delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:18:43 devstack sudo[101855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b85e2d62-0e57-47f3-92d1-0e1248e75128 Jul 10 10:18:43 devstack sudo[101855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:18:43 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-aac18711-fde1-4141-9f65-705b943d8502 tempest-SnapshotDependencyTests-619562385 None] Lock "cinder-quobyte-1f141331-4ad2-42a8-a918-5b2de168c593" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:18:43 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-aac18711-fde1-4141-9f65-705b943d8502 tempest-SnapshotDependencyTests-619562385 None] Deleting offline snapshot 1f141331-4ad2-42a8-a918-5b2de168c593 of volume 8bdf3f1a-5269-49f4-a996-9ec8190cb73e {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 10:18:43 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-aac18711-fde1-4141-9f65-705b943d8502 tempest-SnapshotDependencyTests-619562385 None] snapshot_file for this snap is: volume-8bdf3f1a-5269-49f4-a996-9ec8190cb73e.1f141331-4ad2-42a8-a918-5b2de168c593 {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 10:18:43 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb155d8-c59d-48ee-9ecc-d13dcafdba77]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:18:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-aac18711-fde1-4141-9f65-705b943d8502 tempest-SnapshotDependencyTests-619562385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8bdf3f1a-5269-49f4-a996-9ec8190cb73e.1f141331-4ad2-42a8-a918-5b2de168c593 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:18:43 devstack sudo[101857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8bdf3f1a-5269-49f4-a996-9ec8190cb73e.1f141331-4ad2-42a8-a918-5b2de168c593 Jul 10 10:18:43 devstack sudo[101857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:18:43 devstack sudo[101855]: pam_unix(sudo:session): session closed for user root Jul 10 10:18:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-8f90bcd4-d794-4522-b7a4-d62454f712c9 tempest-GroupSnapshotsTest-1289579137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b85e2d62-0e57-47f3-92d1-0e1248e75128" returned: 0 in 0.681s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:18:43 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-8f90bcd4-d794-4522-b7a4-d62454f712c9 tempest-GroupSnapshotsTest-1289579137 None] <== create_volume: return (1711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:18:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-8f90bcd4-d794-4522-b7a4-d62454f712c9 tempest-GroupSnapshotsTest-1289579137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.714s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:18:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-1c2c09eb-7e9b-411f-9666-148bf2409ff6 tempest-TestStampPattern-1267302871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.492s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:18:43 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-1c2c09eb-7e9b-411f-9666-148bf2409ff6 tempest-TestStampPattern-1267302871 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:18:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-374584247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f87bb0f-5ab5-4897-939c-fa8c133c13e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1290cc3c2e944a8580c50da797829c5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:18:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:18:34Z,use_quota=True,user_id='349c37595e5e49868d55fdceb305b0ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:18:43 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-1c2c09eb-7e9b-411f-9666-148bf2409ff6 tempest-TestStampPattern-1267302871 None] Creating volume 7f87bb0f-5ab5-4897-939c-fa8c133c13e3 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:18:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-1c2c09eb-7e9b-411f-9666-148bf2409ff6 tempest-TestStampPattern-1267302871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:18:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-1c2c09eb-7e9b-411f-9666-148bf2409ff6 tempest-TestStampPattern-1267302871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:18:43 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-1c2c09eb-7e9b-411f-9666-148bf2409ff6 tempest-TestStampPattern-1267302871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:18:43 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-1c2c09eb-7e9b-411f-9666-148bf2409ff6 tempest-TestStampPattern-1267302871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:18:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-1c2c09eb-7e9b-411f-9666-148bf2409ff6 tempest-TestStampPattern-1267302871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:18:43 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-1c2c09eb-7e9b-411f-9666-148bf2409ff6 tempest-TestStampPattern-1267302871 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:18:43 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-1c2c09eb-7e9b-411f-9666-148bf2409ff6 tempest-TestStampPattern-1267302871 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:18:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1c2c09eb-7e9b-411f-9666-148bf2409ff6 tempest-TestStampPattern-1267302871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7f87bb0f-5ab5-4897-939c-fa8c133c13e3 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:18:43 devstack sudo[101860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7f87bb0f-5ab5-4897-939c-fa8c133c13e3 1073741824 Jul 10 10:18:43 devstack sudo[101860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:18:43 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8f90bcd4-d794-4522-b7a4-d62454f712c9 tempest-GroupSnapshotsTest-1289579137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (398934c1-4892-485d-90a5-cf5d9b760c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b85e2d62-0e57-47f3-92d1-0e1248e75128', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:18:43 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8f90bcd4-d794-4522-b7a4-d62454f712c9 tempest-GroupSnapshotsTest-1289579137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ca49c57-a971-4891-b82f-450b8e25cbef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:18:43 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-8f90bcd4-d794-4522-b7a4-d62454f712c9 tempest-GroupSnapshotsTest-1289579137 None] Volume volume-b85e2d62-0e57-47f3-92d1-0e1248e75128 (b85e2d62-0e57-47f3-92d1-0e1248e75128): created successfully Jul 10 10:18:43 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8f90bcd4-d794-4522-b7a4-d62454f712c9 tempest-GroupSnapshotsTest-1289579137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ca49c57-a971-4891-b82f-450b8e25cbef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:18:43 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8f90bcd4-d794-4522-b7a4-d62454f712c9 tempest-GroupSnapshotsTest-1289579137 None] Flow 'volume_create_manager' (982999c8-d58a-4f48-9008-9110cfdcaed9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:18:43 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-8f90bcd4-d794-4522-b7a4-d62454f712c9 tempest-GroupSnapshotsTest-1289579137 None] Created volume successfully. Jul 10 10:18:44 devstack sudo[101857]: pam_unix(sudo:session): session closed for user root Jul 10 10:18:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-aac18711-fde1-4141-9f65-705b943d8502 tempest-SnapshotDependencyTests-619562385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8bdf3f1a-5269-49f4-a996-9ec8190cb73e.1f141331-4ad2-42a8-a918-5b2de168c593" returned: 0 in 0.854s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:18:44 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-aac18711-fde1-4141-9f65-705b943d8502 tempest-SnapshotDependencyTests-619562385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8bdf3f1a-5269-49f4-a996-9ec8190cb73e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 10:18:44 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde78e77-d668-4275-9d97-642e670cf53f]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:18:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-aac18711-fde1-4141-9f65-705b943d8502 tempest-SnapshotDependencyTests-619562385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8bdf3f1a-5269-49f4-a996-9ec8190cb73e {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:18:44 devstack sudo[101865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8bdf3f1a-5269-49f4-a996-9ec8190cb73e Jul 10 10:18:44 devstack sudo[101865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:18:44 devstack sudo[101860]: pam_unix(sudo:session): session closed for user root Jul 10 10:18:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1c2c09eb-7e9b-411f-9666-148bf2409ff6 tempest-TestStampPattern-1267302871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7f87bb0f-5ab5-4897-939c-fa8c133c13e3 1073741824" returned: 0 in 1.000s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:18:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1c2c09eb-7e9b-411f-9666-148bf2409ff6 tempest-TestStampPattern-1267302871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7f87bb0f-5ab5-4897-939c-fa8c133c13e3 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:18:44 devstack sudo[101865]: pam_unix(sudo:session): session closed for user root Jul 10 10:18:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-aac18711-fde1-4141-9f65-705b943d8502 tempest-SnapshotDependencyTests-619562385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8bdf3f1a-5269-49f4-a996-9ec8190cb73e" returned: 0 in 0.808s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:18:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-aac18711-fde1-4141-9f65-705b943d8502 tempest-SnapshotDependencyTests-619562385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8bdf3f1a-5269-49f4-a996-9ec8190cb73e.1f141331-4ad2-42a8-a918-5b2de168c593 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:18:44 devstack sudo[101873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7f87bb0f-5ab5-4897-939c-fa8c133c13e3 Jul 10 10:18:44 devstack sudo[101873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:18:44 devstack sudo[101874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8bdf3f1a-5269-49f4-a996-9ec8190cb73e.1f141331-4ad2-42a8-a918-5b2de168c593 Jul 10 10:18:44 devstack sudo[101874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:18:45 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-66869fd2-a013-4cec-bb27-69900a116885 tempest-GroupSnapshotsTest-1289579137 None] GroupSnapshot 502bd238-c4df-4235-8323-1f90ff1d5fa6: creating. Jul 10 10:18:45 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-66869fd2-a013-4cec-bb27-69900a116885 tempest-GroupSnapshotsTest-1289579137 None] Group snapshot 502bd238-c4df-4235-8323-1f90ff1d5fa6: creating. {{(pid=87234) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 10 10:18:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-66869fd2-a013-4cec-bb27-69900a116885 tempest-GroupSnapshotsTest-1289579137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:18:45 devstack sudo[101873]: pam_unix(sudo:session): session closed for user root Jul 10 10:18:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1c2c09eb-7e9b-411f-9666-148bf2409ff6 tempest-TestStampPattern-1267302871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7f87bb0f-5ab5-4897-939c-fa8c133c13e3" returned: 0 in 0.906s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:18:45 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-1c2c09eb-7e9b-411f-9666-148bf2409ff6 tempest-TestStampPattern-1267302871 None] <== create_volume: return (1975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:18:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-1c2c09eb-7e9b-411f-9666-148bf2409ff6 tempest-TestStampPattern-1267302871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.978s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:18:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-66869fd2-a013-4cec-bb27-69900a116885 tempest-GroupSnapshotsTest-1289579137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.441s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:18:45 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1c2c09eb-7e9b-411f-9666-148bf2409ff6 tempest-TestStampPattern-1267302871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f4cf49b-58ae-4a57-a43e-12a72f72b00d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f87bb0f-5ab5-4897-939c-fa8c133c13e3', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:18:45 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1c2c09eb-7e9b-411f-9666-148bf2409ff6 tempest-TestStampPattern-1267302871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d59b09d3-eba1-45a3-ad24-af901e722601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:18:45 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-66869fd2-a013-4cec-bb27-69900a116885 tempest-GroupSnapshotsTest-1289579137 None] Creating offline snapshot 1156d9e0-bacd-4ba3-8a49-1d35383332a0 of volume b85e2d62-0e57-47f3-92d1-0e1248e75128 {{(pid=87234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 10:18:45 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-1c2c09eb-7e9b-411f-9666-148bf2409ff6 tempest-TestStampPattern-1267302871 None] Volume volume-7f87bb0f-5ab5-4897-939c-fa8c133c13e3 (7f87bb0f-5ab5-4897-939c-fa8c133c13e3): created successfully Jul 10 10:18:45 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1c2c09eb-7e9b-411f-9666-148bf2409ff6 tempest-TestStampPattern-1267302871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d59b09d3-eba1-45a3-ad24-af901e722601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:18:45 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1c2c09eb-7e9b-411f-9666-148bf2409ff6 tempest-TestStampPattern-1267302871 None] Flow 'volume_create_manager' (1c2af245-3423-4c9c-8a97-f59f30ae8f7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:18:45 devstack sudo[101874]: pam_unix(sudo:session): session closed for user root Jul 10 10:18:45 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bafca5c-b1d8-4820-894c-4a9865e8f835]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:18:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-66869fd2-a013-4cec-bb27-69900a116885 tempest-GroupSnapshotsTest-1289579137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b85e2d62-0e57-47f3-92d1-0e1248e75128 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:18:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-aac18711-fde1-4141-9f65-705b943d8502 tempest-SnapshotDependencyTests-619562385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8bdf3f1a-5269-49f4-a996-9ec8190cb73e.1f141331-4ad2-42a8-a918-5b2de168c593" returned: 0 in 1.009s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:18:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-aac18711-fde1-4141-9f65-705b943d8502 tempest-SnapshotDependencyTests-619562385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8bdf3f1a-5269-49f4-a996-9ec8190cb73e.1f141331-4ad2-42a8-a918-5b2de168c593 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:18:46 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-1c2c09eb-7e9b-411f-9666-148bf2409ff6 tempest-TestStampPattern-1267302871 None] Created volume successfully. Jul 10 10:18:46 devstack sudo[101917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8bdf3f1a-5269-49f4-a996-9ec8190cb73e.1f141331-4ad2-42a8-a918-5b2de168c593 Jul 10 10:18:46 devstack sudo[101917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:18:46 devstack sudo[101915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b85e2d62-0e57-47f3-92d1-0e1248e75128 Jul 10 10:18:46 devstack sudo[101915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:18:46 devstack sudo[101917]: pam_unix(sudo:session): session closed for user root Jul 10 10:18:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-aac18711-fde1-4141-9f65-705b943d8502 tempest-SnapshotDependencyTests-619562385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8bdf3f1a-5269-49f4-a996-9ec8190cb73e.1f141331-4ad2-42a8-a918-5b2de168c593" returned: 0 in 0.796s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:18:46 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-aac18711-fde1-4141-9f65-705b943d8502 tempest-SnapshotDependencyTests-619562385 None] Lock "cinder-quobyte-1f141331-4ad2-42a8-a918-5b2de168c593" released by "_delete_snapshot" :: held 3.583s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:18:46 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-aac18711-fde1-4141-9f65-705b943d8502 tempest-SnapshotDependencyTests-619562385 None] Lock "cinder-quobyte-8bdf3f1a-5269-49f4-a996-9ec8190cb73e" released by "delete_snapshot" :: held 3.612s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:18:46 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-aac18711-fde1-4141-9f65-705b943d8502 tempest-SnapshotDependencyTests-619562385 None] Created reservations ['6e3de2df-738c-4676-b81f-de498249c25c', '2f99f33c-ad71-4281-aaa0-80ba3079b942', '80d41142-f09e-4e85-b77f-0be3bb8a75b3', 'e4ce6287-e456-4bce-a185-fbcb204b6e8d'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:18:46 devstack sudo[101915]: pam_unix(sudo:session): session closed for user root Jul 10 10:18:46 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-aac18711-fde1-4141-9f65-705b943d8502 tempest-SnapshotDependencyTests-619562385 None] Delete snapshot completed successfully. Jul 10 10:18:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-66869fd2-a013-4cec-bb27-69900a116885 tempest-GroupSnapshotsTest-1289579137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b85e2d62-0e57-47f3-92d1-0e1248e75128" returned: 0 in 0.977s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:18:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-66869fd2-a013-4cec-bb27-69900a116885 tempest-GroupSnapshotsTest-1289579137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b85e2d62-0e57-47f3-92d1-0e1248e75128,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b85e2d62-0e57-47f3-92d1-0e1248e75128.1156d9e0-bacd-4ba3-8a49-1d35383332a0 1G {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:18:46 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-aac18711-fde1-4141-9f65-705b943d8502 tempest-SnapshotDependencyTests-619562385 None] Lock "cinder-1f141331-4ad2-42a8-a918-5b2de168c593-delete_snapshot" released by "delete_snapshot" :: held 3.769s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:18:46 devstack sudo[101939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b85e2d62-0e57-47f3-92d1-0e1248e75128,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b85e2d62-0e57-47f3-92d1-0e1248e75128.1156d9e0-bacd-4ba3-8a49-1d35383332a0 1G Jul 10 10:18:46 devstack sudo[101939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:18:47 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-23881961-fff0-4cd9-959b-a2307b55a0de tempest-SnapshotDependencyTests-619562385 None] Acquiring lock "cinder-8bdf3f1a-5269-49f4-a996-9ec8190cb73e-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:18:47 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-23881961-fff0-4cd9-959b-a2307b55a0de tempest-SnapshotDependencyTests-619562385 None] Lock "cinder-8bdf3f1a-5269-49f4-a996-9ec8190cb73e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:18:47 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-23881961-fff0-4cd9-959b-a2307b55a0de tempest-SnapshotDependencyTests-619562385 None] Acquiring lock "cinder-quobyte-8bdf3f1a-5269-49f4-a996-9ec8190cb73e" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:18:47 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-23881961-fff0-4cd9-959b-a2307b55a0de tempest-SnapshotDependencyTests-619562385 None] Lock "cinder-quobyte-8bdf3f1a-5269-49f4-a996-9ec8190cb73e" acquired by "delete_volume" :: waited 0.025s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:18:47 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[070b50a5-b509-4c01-a4a4-ee467b0890a7]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:18:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-23881961-fff0-4cd9-959b-a2307b55a0de tempest-SnapshotDependencyTests-619562385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8bdf3f1a-5269-49f4-a996-9ec8190cb73e {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:18:47 devstack sudo[101965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8bdf3f1a-5269-49f4-a996-9ec8190cb73e Jul 10 10:18:47 devstack sudo[101965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:18:47 devstack sudo[101939]: pam_unix(sudo:session): session closed for user root Jul 10 10:18:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-66869fd2-a013-4cec-bb27-69900a116885 tempest-GroupSnapshotsTest-1289579137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b85e2d62-0e57-47f3-92d1-0e1248e75128,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b85e2d62-0e57-47f3-92d1-0e1248e75128.1156d9e0-bacd-4ba3-8a49-1d35383332a0 1G" returned: 0 in 0.963s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:18:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-66869fd2-a013-4cec-bb27-69900a116885 tempest-GroupSnapshotsTest-1289579137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b85e2d62-0e57-47f3-92d1-0e1248e75128 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b85e2d62-0e57-47f3-92d1-0e1248e75128.1156d9e0-bacd-4ba3-8a49-1d35383332a0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:18:47 devstack sudo[101968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b85e2d62-0e57-47f3-92d1-0e1248e75128 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b85e2d62-0e57-47f3-92d1-0e1248e75128.1156d9e0-bacd-4ba3-8a49-1d35383332a0 Jul 10 10:18:47 devstack sudo[101968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:18:48 devstack sudo[101965]: pam_unix(sudo:session): session closed for user root Jul 10 10:18:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-23881961-fff0-4cd9-959b-a2307b55a0de tempest-SnapshotDependencyTests-619562385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8bdf3f1a-5269-49f4-a996-9ec8190cb73e" returned: 0 in 0.925s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:18:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-23881961-fff0-4cd9-959b-a2307b55a0de tempest-SnapshotDependencyTests-619562385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8bdf3f1a-5269-49f4-a996-9ec8190cb73e {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:18:48 devstack sudo[101975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8bdf3f1a-5269-49f4-a996-9ec8190cb73e Jul 10 10:18:48 devstack sudo[101975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:18:48 devstack sudo[101968]: pam_unix(sudo:session): session closed for user root Jul 10 10:18:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-66869fd2-a013-4cec-bb27-69900a116885 tempest-GroupSnapshotsTest-1289579137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b85e2d62-0e57-47f3-92d1-0e1248e75128 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b85e2d62-0e57-47f3-92d1-0e1248e75128.1156d9e0-bacd-4ba3-8a49-1d35383332a0" returned: 0 in 0.876s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:18:48 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-66869fd2-a013-4cec-bb27-69900a116885 tempest-GroupSnapshotsTest-1289579137 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b85e2d62-0e57-47f3-92d1-0e1248e75128.1156d9e0-bacd-4ba3-8a49-1d35383332a0 is being set with open permissions: ugo+rw: NotImplementedError Jul 10 10:18:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-66869fd2-a013-4cec-bb27-69900a116885 tempest-GroupSnapshotsTest-1289579137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b85e2d62-0e57-47f3-92d1-0e1248e75128.1156d9e0-bacd-4ba3-8a49-1d35383332a0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:18:48 devstack sudo[101980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b85e2d62-0e57-47f3-92d1-0e1248e75128.1156d9e0-bacd-4ba3-8a49-1d35383332a0 Jul 10 10:18:48 devstack sudo[101980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:18:49 devstack sudo[101975]: pam_unix(sudo:session): session closed for user root Jul 10 10:18:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-23881961-fff0-4cd9-959b-a2307b55a0de tempest-SnapshotDependencyTests-619562385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8bdf3f1a-5269-49f4-a996-9ec8190cb73e" returned: 0 in 0.758s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:18:49 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-23881961-fff0-4cd9-959b-a2307b55a0de tempest-SnapshotDependencyTests-619562385 None] Lock "cinder-quobyte-8bdf3f1a-5269-49f4-a996-9ec8190cb73e" released by "delete_volume" :: held 1.757s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:18:49 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-23881961-fff0-4cd9-959b-a2307b55a0de tempest-SnapshotDependencyTests-619562385 None] Created reservations ['77513414-8ebf-4a84-8f63-56181b6d93ba', 'f0a08e26-45cd-41d1-887d-18fc14db9bc2', '6db97801-debd-490c-ae21-86ade96592a3', '98e42063-bc8d-4102-af25-cf6af53467d2'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:18:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-23881961-fff0-4cd9-959b-a2307b55a0de tempest-SnapshotDependencyTests-619562385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:18:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-23881961-fff0-4cd9-959b-a2307b55a0de tempest-SnapshotDependencyTests-619562385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:18:49 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-23881961-fff0-4cd9-959b-a2307b55a0de tempest-SnapshotDependencyTests-619562385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:18:49 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-23881961-fff0-4cd9-959b-a2307b55a0de tempest-SnapshotDependencyTests-619562385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:18:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-23881961-fff0-4cd9-959b-a2307b55a0de tempest-SnapshotDependencyTests-619562385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:18:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-23881961-fff0-4cd9-959b-a2307b55a0de tempest-SnapshotDependencyTests-619562385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:18:49 devstack sudo[101984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:18:49 devstack sudo[101984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:18:49 devstack sudo[101980]: pam_unix(sudo:session): session closed for user root Jul 10 10:18:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-66869fd2-a013-4cec-bb27-69900a116885 tempest-GroupSnapshotsTest-1289579137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b85e2d62-0e57-47f3-92d1-0e1248e75128.1156d9e0-bacd-4ba3-8a49-1d35383332a0" returned: 0 in 0.858s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:18:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-66869fd2-a013-4cec-bb27-69900a116885 tempest-GroupSnapshotsTest-1289579137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b85e2d62-0e57-47f3-92d1-0e1248e75128.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:18:49 devstack sudo[101986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b85e2d62-0e57-47f3-92d1-0e1248e75128.info Jul 10 10:18:49 devstack sudo[101986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:18:49 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-94a90d23-28a4-46d0-8d44-4beed3eb9a46 tempest-SnapshotDependencyTests-619562385 None] Acquiring lock "cinder-8929cb88-f276-4ac0-a578-d75db4a83264-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:18:49 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-94a90d23-28a4-46d0-8d44-4beed3eb9a46 tempest-SnapshotDependencyTests-619562385 None] Lock "cinder-8929cb88-f276-4ac0-a578-d75db4a83264-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:18:49 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-94a90d23-28a4-46d0-8d44-4beed3eb9a46 tempest-SnapshotDependencyTests-619562385 None] Acquiring lock "cinder-quobyte-8929cb88-f276-4ac0-a578-d75db4a83264" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:18:49 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-94a90d23-28a4-46d0-8d44-4beed3eb9a46 tempest-SnapshotDependencyTests-619562385 None] Lock "cinder-quobyte-8929cb88-f276-4ac0-a578-d75db4a83264" acquired by "delete_volume" :: waited 0.044s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:18:49 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd8fb5d-b706-45de-b453-49d25d8390b6]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:18:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-94a90d23-28a4-46d0-8d44-4beed3eb9a46 tempest-SnapshotDependencyTests-619562385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8929cb88-f276-4ac0-a578-d75db4a83264 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:18:50 devstack sudo[101988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8929cb88-f276-4ac0-a578-d75db4a83264 Jul 10 10:18:50 devstack sudo[101988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:18:50 devstack sudo[101984]: pam_unix(sudo:session): session closed for user root Jul 10 10:18:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-23881961-fff0-4cd9-959b-a2307b55a0de tempest-SnapshotDependencyTests-619562385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.838s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:18:50 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-23881961-fff0-4cd9-959b-a2307b55a0de tempest-SnapshotDependencyTests-619562385 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:18:50 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-23881961-fff0-4cd9-959b-a2307b55a0de tempest-SnapshotDependencyTests-619562385 None] Deleted volume successfully. Jul 10 10:18:50 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-23881961-fff0-4cd9-959b-a2307b55a0de tempest-SnapshotDependencyTests-619562385 None] Lock "cinder-8bdf3f1a-5269-49f4-a996-9ec8190cb73e-delete_volume" released by "delete_volume" :: held 2.925s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:18:50 devstack sudo[101986]: pam_unix(sudo:session): session closed for user root Jul 10 10:18:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-66869fd2-a013-4cec-bb27-69900a116885 tempest-GroupSnapshotsTest-1289579137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b85e2d62-0e57-47f3-92d1-0e1248e75128.info" returned: 0 in 0.855s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:18:50 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-66869fd2-a013-4cec-bb27-69900a116885 tempest-GroupSnapshotsTest-1289579137 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b85e2d62-0e57-47f3-92d1-0e1248e75128.info is being set with open permissions: ugo+rw: NotImplementedError Jul 10 10:18:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-66869fd2-a013-4cec-bb27-69900a116885 tempest-GroupSnapshotsTest-1289579137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b85e2d62-0e57-47f3-92d1-0e1248e75128.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:18:50 devstack sudo[101992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b85e2d62-0e57-47f3-92d1-0e1248e75128.info Jul 10 10:18:50 devstack sudo[101992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:18:51 devstack sudo[101988]: pam_unix(sudo:session): session closed for user root Jul 10 10:18:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-94a90d23-28a4-46d0-8d44-4beed3eb9a46 tempest-SnapshotDependencyTests-619562385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8929cb88-f276-4ac0-a578-d75db4a83264" returned: 0 in 1.177s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:18:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-94a90d23-28a4-46d0-8d44-4beed3eb9a46 tempest-SnapshotDependencyTests-619562385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8929cb88-f276-4ac0-a578-d75db4a83264 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:18:51 devstack sudo[101997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8929cb88-f276-4ac0-a578-d75db4a83264 Jul 10 10:18:51 devstack sudo[101997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:18:51 devstack sudo[101992]: pam_unix(sudo:session): session closed for user root Jul 10 10:18:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-66869fd2-a013-4cec-bb27-69900a116885 tempest-GroupSnapshotsTest-1289579137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b85e2d62-0e57-47f3-92d1-0e1248e75128.info" returned: 0 in 0.865s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:18:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-66869fd2-a013-4cec-bb27-69900a116885 tempest-GroupSnapshotsTest-1289579137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.553s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:18:51 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-66869fd2-a013-4cec-bb27-69900a116885 tempest-GroupSnapshotsTest-1289579137 None] group_snapshot 502bd238-c4df-4235-8323-1f90ff1d5fa6: created successfully Jul 10 10:18:51 devstack sudo[101997]: pam_unix(sudo:session): session closed for user root Jul 10 10:18:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-94a90d23-28a4-46d0-8d44-4beed3eb9a46 tempest-SnapshotDependencyTests-619562385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8929cb88-f276-4ac0-a578-d75db4a83264" returned: 0 in 0.749s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:18:51 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-94a90d23-28a4-46d0-8d44-4beed3eb9a46 tempest-SnapshotDependencyTests-619562385 None] Lock "cinder-quobyte-8929cb88-f276-4ac0-a578-d75db4a83264" released by "delete_volume" :: held 2.007s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:18:51 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-8002c2f5-06fa-4171-b04d-e24f481cd7b3 tempest-GroupSnapshotsTest-1289579137 None] group_snapshot 502bd238-c4df-4235-8323-1f90ff1d5fa6: deleting Jul 10 10:18:51 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8002c2f5-06fa-4171-b04d-e24f481cd7b3 tempest-GroupSnapshotsTest-1289579137 None] group_snapshot 502bd238-c4df-4235-8323-1f90ff1d5fa6: deleting {{(pid=87234) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 10 10:18:51 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-94a90d23-28a4-46d0-8d44-4beed3eb9a46 tempest-SnapshotDependencyTests-619562385 None] Created reservations ['60c2e7b0-a85c-4140-868a-34683e193a22', 'acd275c7-5187-4d4e-a6ea-5644e3d8c026', '1bf60f09-07fe-489b-a428-1f09908225d2', '1edc268d-3e4a-400e-ac12-cd64175707e8'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:18:52 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-8002c2f5-06fa-4171-b04d-e24f481cd7b3 tempest-GroupSnapshotsTest-1289579137 None] Acquiring lock "cinder-quobyte-b85e2d62-0e57-47f3-92d1-0e1248e75128" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:18:52 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-8002c2f5-06fa-4171-b04d-e24f481cd7b3 tempest-GroupSnapshotsTest-1289579137 None] Lock "cinder-quobyte-b85e2d62-0e57-47f3-92d1-0e1248e75128" acquired by "delete_snapshot" :: waited 0.054s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:18:52 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-8002c2f5-06fa-4171-b04d-e24f481cd7b3 tempest-GroupSnapshotsTest-1289579137 None] Acquiring lock "cinder-quobyte-1156d9e0-bacd-4ba3-8a49-1d35383332a0" by "_delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:18:52 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-8002c2f5-06fa-4171-b04d-e24f481cd7b3 tempest-GroupSnapshotsTest-1289579137 None] Lock "cinder-quobyte-1156d9e0-bacd-4ba3-8a49-1d35383332a0" acquired by "_delete_snapshot" :: waited 0.065s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:18:52 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-8002c2f5-06fa-4171-b04d-e24f481cd7b3 tempest-GroupSnapshotsTest-1289579137 None] Deleting offline snapshot 1156d9e0-bacd-4ba3-8a49-1d35383332a0 of volume b85e2d62-0e57-47f3-92d1-0e1248e75128 {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 10:18:52 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-8002c2f5-06fa-4171-b04d-e24f481cd7b3 tempest-GroupSnapshotsTest-1289579137 None] snapshot_file for this snap is: volume-b85e2d62-0e57-47f3-92d1-0e1248e75128.1156d9e0-bacd-4ba3-8a49-1d35383332a0 {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 10:18:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-94a90d23-28a4-46d0-8d44-4beed3eb9a46 tempest-SnapshotDependencyTests-619562385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:18:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-94a90d23-28a4-46d0-8d44-4beed3eb9a46 tempest-SnapshotDependencyTests-619562385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:18:52 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-94a90d23-28a4-46d0-8d44-4beed3eb9a46 tempest-SnapshotDependencyTests-619562385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:18:52 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-94a90d23-28a4-46d0-8d44-4beed3eb9a46 tempest-SnapshotDependencyTests-619562385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:18:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-94a90d23-28a4-46d0-8d44-4beed3eb9a46 tempest-SnapshotDependencyTests-619562385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:18:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-94a90d23-28a4-46d0-8d44-4beed3eb9a46 tempest-SnapshotDependencyTests-619562385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:18:52 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[1125d537-e535-4420-9230-5a025ce6718e]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:18:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-8002c2f5-06fa-4171-b04d-e24f481cd7b3 tempest-GroupSnapshotsTest-1289579137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b85e2d62-0e57-47f3-92d1-0e1248e75128.1156d9e0-bacd-4ba3-8a49-1d35383332a0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:18:52 devstack sudo[102002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:18:52 devstack sudo[102002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:18:52 devstack sudo[102003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b85e2d62-0e57-47f3-92d1-0e1248e75128.1156d9e0-bacd-4ba3-8a49-1d35383332a0 Jul 10 10:18:52 devstack sudo[102003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:18:53 devstack sudo[102002]: pam_unix(sudo:session): session closed for user root Jul 10 10:18:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-94a90d23-28a4-46d0-8d44-4beed3eb9a46 tempest-SnapshotDependencyTests-619562385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.812s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:18:53 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-94a90d23-28a4-46d0-8d44-4beed3eb9a46 tempest-SnapshotDependencyTests-619562385 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:18:53 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-94a90d23-28a4-46d0-8d44-4beed3eb9a46 tempest-SnapshotDependencyTests-619562385 None] Deleted volume successfully. Jul 10 10:18:53 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-94a90d23-28a4-46d0-8d44-4beed3eb9a46 tempest-SnapshotDependencyTests-619562385 None] Lock "cinder-8929cb88-f276-4ac0-a578-d75db4a83264-delete_volume" released by "delete_volume" :: held 3.365s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:18:53 devstack sudo[102003]: pam_unix(sudo:session): session closed for user root Jul 10 10:18:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-8002c2f5-06fa-4171-b04d-e24f481cd7b3 tempest-GroupSnapshotsTest-1289579137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b85e2d62-0e57-47f3-92d1-0e1248e75128.1156d9e0-bacd-4ba3-8a49-1d35383332a0" returned: 0 in 0.872s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:18:53 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-8002c2f5-06fa-4171-b04d-e24f481cd7b3 tempest-GroupSnapshotsTest-1289579137 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b85e2d62-0e57-47f3-92d1-0e1248e75128(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 10:18:53 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a2f183-faf5-406a-865e-0c378f85b2d9]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:18:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-8002c2f5-06fa-4171-b04d-e24f481cd7b3 tempest-GroupSnapshotsTest-1289579137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b85e2d62-0e57-47f3-92d1-0e1248e75128 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:18:53 devstack sudo[102010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b85e2d62-0e57-47f3-92d1-0e1248e75128 Jul 10 10:18:53 devstack sudo[102010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:18:54 devstack sudo[102010]: pam_unix(sudo:session): session closed for user root Jul 10 10:18:54 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-8002c2f5-06fa-4171-b04d-e24f481cd7b3 tempest-GroupSnapshotsTest-1289579137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b85e2d62-0e57-47f3-92d1-0e1248e75128" returned: 0 in 1.102s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:18:54 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-8002c2f5-06fa-4171-b04d-e24f481cd7b3 tempest-GroupSnapshotsTest-1289579137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b85e2d62-0e57-47f3-92d1-0e1248e75128.1156d9e0-bacd-4ba3-8a49-1d35383332a0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:18:54 devstack sudo[102017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b85e2d62-0e57-47f3-92d1-0e1248e75128.1156d9e0-bacd-4ba3-8a49-1d35383332a0 Jul 10 10:18:54 devstack sudo[102017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:18:55 devstack sudo[102017]: pam_unix(sudo:session): session closed for user root Jul 10 10:18:55 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-8002c2f5-06fa-4171-b04d-e24f481cd7b3 tempest-GroupSnapshotsTest-1289579137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b85e2d62-0e57-47f3-92d1-0e1248e75128.1156d9e0-bacd-4ba3-8a49-1d35383332a0" returned: 0 in 0.876s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:18:55 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-8002c2f5-06fa-4171-b04d-e24f481cd7b3 tempest-GroupSnapshotsTest-1289579137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b85e2d62-0e57-47f3-92d1-0e1248e75128.1156d9e0-bacd-4ba3-8a49-1d35383332a0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:18:55 devstack sudo[102024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b85e2d62-0e57-47f3-92d1-0e1248e75128.1156d9e0-bacd-4ba3-8a49-1d35383332a0 Jul 10 10:18:55 devstack sudo[102024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:18:55 devstack sudo[102024]: pam_unix(sudo:session): session closed for user root Jul 10 10:18:55 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-8002c2f5-06fa-4171-b04d-e24f481cd7b3 tempest-GroupSnapshotsTest-1289579137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b85e2d62-0e57-47f3-92d1-0e1248e75128.1156d9e0-bacd-4ba3-8a49-1d35383332a0" returned: 0 in 0.708s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:18:55 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-8002c2f5-06fa-4171-b04d-e24f481cd7b3 tempest-GroupSnapshotsTest-1289579137 None] Lock "cinder-quobyte-1156d9e0-bacd-4ba3-8a49-1d35383332a0" released by "_delete_snapshot" :: held 3.770s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:18:55 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-8002c2f5-06fa-4171-b04d-e24f481cd7b3 tempest-GroupSnapshotsTest-1289579137 None] Lock "cinder-quobyte-b85e2d62-0e57-47f3-92d1-0e1248e75128" released by "delete_snapshot" :: held 3.847s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:18:56 devstack cinder-volume[87234]: WARNING cinder.quota [None req-8002c2f5-06fa-4171-b04d-e24f481cd7b3 tempest-GroupSnapshotsTest-1289579137 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1137724594 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1137724594, it is now deprecated. Please use the default quota class for default quota. Jul 10 10:18:56 devstack cinder-volume[87234]: WARNING cinder.quota [None req-8002c2f5-06fa-4171-b04d-e24f481cd7b3 tempest-GroupSnapshotsTest-1289579137 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1137724594 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1137724594, it is now deprecated. Please use the default quota class for default quota. Jul 10 10:18:56 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-8002c2f5-06fa-4171-b04d-e24f481cd7b3 tempest-GroupSnapshotsTest-1289579137 None] Created reservations ['0e6248f0-7a33-4252-ac93-db6f126d0a32', '2a6c33dc-9979-4682-aed3-d07885b27652', '0ff78b5b-413f-4270-8a61-447a6cb8b766', '240f7997-2db2-4928-8cfd-771afd3c23ca'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:18:56 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-8002c2f5-06fa-4171-b04d-e24f481cd7b3 tempest-GroupSnapshotsTest-1289579137 None] group_snapshot 502bd238-c4df-4235-8323-1f90ff1d5fa6: deleted successfully Jul 10 10:18:56 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-04a77a1f-bf83-464c-96e1-3d65ffef227b tempest-GroupSnapshotsTest-1289579137 None] Acquiring lock "cinder-quobyte-b85e2d62-0e57-47f3-92d1-0e1248e75128" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:18:56 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-04a77a1f-bf83-464c-96e1-3d65ffef227b tempest-GroupSnapshotsTest-1289579137 None] Lock "cinder-quobyte-b85e2d62-0e57-47f3-92d1-0e1248e75128" acquired by "delete_volume" :: waited 0.022s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:18:56 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3c28d3-f2e3-4f7c-aa68-42493c78e60f]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:18:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-04a77a1f-bf83-464c-96e1-3d65ffef227b tempest-GroupSnapshotsTest-1289579137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b85e2d62-0e57-47f3-92d1-0e1248e75128 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:18:57 devstack sudo[102027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b85e2d62-0e57-47f3-92d1-0e1248e75128 Jul 10 10:18:57 devstack sudo[102027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:18:57 devstack sudo[102027]: pam_unix(sudo:session): session closed for user root Jul 10 10:18:57 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-04a77a1f-bf83-464c-96e1-3d65ffef227b tempest-GroupSnapshotsTest-1289579137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b85e2d62-0e57-47f3-92d1-0e1248e75128" returned: 0 in 0.902s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:18:57 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-04a77a1f-bf83-464c-96e1-3d65ffef227b tempest-GroupSnapshotsTest-1289579137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b85e2d62-0e57-47f3-92d1-0e1248e75128 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:18:57 devstack sudo[102034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b85e2d62-0e57-47f3-92d1-0e1248e75128 Jul 10 10:18:57 devstack sudo[102034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:18:58 devstack sudo[102034]: pam_unix(sudo:session): session closed for user root Jul 10 10:18:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-04a77a1f-bf83-464c-96e1-3d65ffef227b tempest-GroupSnapshotsTest-1289579137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b85e2d62-0e57-47f3-92d1-0e1248e75128" returned: 0 in 0.778s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:18:58 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-04a77a1f-bf83-464c-96e1-3d65ffef227b tempest-GroupSnapshotsTest-1289579137 None] Lock "cinder-quobyte-b85e2d62-0e57-47f3-92d1-0e1248e75128" released by "delete_volume" :: held 1.777s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:18:58 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-04a77a1f-bf83-464c-96e1-3d65ffef227b tempest-GroupSnapshotsTest-1289579137 None] Created reservations ['579edba5-141a-43c4-a5bf-27eae738e10e'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:18:58 devstack cinder-volume[87234]: WARNING cinder.quota [None req-04a77a1f-bf83-464c-96e1-3d65ffef227b tempest-GroupSnapshotsTest-1289579137 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1137724594 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1137724594, it is now deprecated. Please use the default quota class for default quota. Jul 10 10:18:58 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-04a77a1f-bf83-464c-96e1-3d65ffef227b tempest-GroupSnapshotsTest-1289579137 None] Created reservations ['9799db74-4a4f-49a3-9f93-c3757ff8cb12', '34d396b2-59fd-4e65-9741-d3bfb7ce897b', '7c23f874-1e0e-4884-8046-a129614510c8', '672d9a04-0933-4360-8236-94cc26189714'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:18:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-04a77a1f-bf83-464c-96e1-3d65ffef227b tempest-GroupSnapshotsTest-1289579137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:18:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-04a77a1f-bf83-464c-96e1-3d65ffef227b tempest-GroupSnapshotsTest-1289579137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:18:58 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-04a77a1f-bf83-464c-96e1-3d65ffef227b tempest-GroupSnapshotsTest-1289579137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:18:58 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-04a77a1f-bf83-464c-96e1-3d65ffef227b tempest-GroupSnapshotsTest-1289579137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:18:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-04a77a1f-bf83-464c-96e1-3d65ffef227b tempest-GroupSnapshotsTest-1289579137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:18:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-04a77a1f-bf83-464c-96e1-3d65ffef227b tempest-GroupSnapshotsTest-1289579137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:18:58 devstack sudo[102038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:18:58 devstack sudo[102038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:18:59 devstack sudo[102038]: pam_unix(sudo:session): session closed for user root Jul 10 10:18:59 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-04a77a1f-bf83-464c-96e1-3d65ffef227b tempest-GroupSnapshotsTest-1289579137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.727s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:18:59 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-04a77a1f-bf83-464c-96e1-3d65ffef227b tempest-GroupSnapshotsTest-1289579137 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:18:59 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-04a77a1f-bf83-464c-96e1-3d65ffef227b tempest-GroupSnapshotsTest-1289579137 None] Delete group completed successfully. Jul 10 10:19:04 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-3212e62e-bd43-4e6d-b8d8-272584b53acd tempest-GroupsTest-1267538885 None] Group tempest-Group1-242411191: creating Jul 10 10:19:04 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-3212e62e-bd43-4e6d-b8d8-272584b53acd tempest-GroupsTest-1267538885 None] Group tempest-Group1-242411191: created successfully Jul 10 10:19:04 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-3212e62e-bd43-4e6d-b8d8-272584b53acd tempest-GroupsTest-1267538885 None] Create group completed successfully. Jul 10 10:19:05 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-8149e9e2-febb-4430-838d-d25b66010c00 tempest-GroupsTest-1267538885 None] Group tempest-Group2-1594989252: creating Jul 10 10:19:05 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-8149e9e2-febb-4430-838d-d25b66010c00 tempest-GroupsTest-1267538885 None] Group tempest-Group2-1594989252: created successfully Jul 10 10:19:05 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-8149e9e2-febb-4430-838d-d25b66010c00 tempest-GroupsTest-1267538885 None] Create group completed successfully. Jul 10 10:19:07 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-84f8e002-ba4f-45fc-91d4-0681d86d394c tempest-GroupsTest-1267538885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:19:07 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-84f8e002-ba4f-45fc-91d4-0681d86d394c tempest-GroupsTest-1267538885 None] Flow 'volume_create_manager' (7549b7c1-2c89-42be-b21e-06bd30cfbffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:19:07 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-84f8e002-ba4f-45fc-91d4-0681d86d394c tempest-GroupsTest-1267538885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a711cc95-1f26-4df7-a96c-e18e445a37de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:19:07 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-84f8e002-ba4f-45fc-91d4-0681d86d394c tempest-GroupsTest-1267538885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a711cc95-1f26-4df7-a96c-e18e445a37de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:19:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-846560519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e9e67aa6-6583-4df2-b285-d95c3acaf8de,host='devstack@QuobyteHD#QuobyteHD',id=5f0c3d6f-3e43-4b67-9d07-087e0e0ae334,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55a5f2dd36b04cdb98d5fb67dba2e5a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:19:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:19:08Z,use_quota=True,user_id='07859c48f6eb4b6394ce95290c19a0a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad094a44-f564-42cd-9a60-d34230cb7b3c),volume_type_id=ad094a44-f564-42cd-9a60-d34230cb7b3c)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:19:07 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-84f8e002-ba4f-45fc-91d4-0681d86d394c tempest-GroupsTest-1267538885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec2cbccb-ca95-4afb-b2b4-2e9dc11509ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:19:07 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-84f8e002-ba4f-45fc-91d4-0681d86d394c tempest-GroupsTest-1267538885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec2cbccb-ca95-4afb-b2b4-2e9dc11509ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:19:07 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-84f8e002-ba4f-45fc-91d4-0681d86d394c tempest-GroupsTest-1267538885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb36d724-72b8-4c28-b102-178dc26a815f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:19:07 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-84f8e002-ba4f-45fc-91d4-0681d86d394c tempest-GroupsTest-1267538885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb36d724-72b8-4c28-b102-178dc26a815f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f0c3d6f-3e43-4b67-9d07-087e0e0ae334', 'volume_name': 'volume-5f0c3d6f-3e43-4b67-9d07-087e0e0ae334', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:19:07 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-84f8e002-ba4f-45fc-91d4-0681d86d394c tempest-GroupsTest-1267538885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a65dde0-c2f9-4248-96ad-0e0aefc7e55a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:19:07 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-84f8e002-ba4f-45fc-91d4-0681d86d394c tempest-GroupsTest-1267538885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a65dde0-c2f9-4248-96ad-0e0aefc7e55a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:19:07 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-84f8e002-ba4f-45fc-91d4-0681d86d394c tempest-GroupsTest-1267538885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e45d00e1-7159-496f-9e39-f6b728ef3c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:19:07 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-84f8e002-ba4f-45fc-91d4-0681d86d394c tempest-GroupsTest-1267538885 None] Volume 5f0c3d6f-3e43-4b67-9d07-087e0e0ae334: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f0c3d6f-3e43-4b67-9d07-087e0e0ae334', 'volume_size': 1} Jul 10 10:19:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-84f8e002-ba4f-45fc-91d4-0681d86d394c tempest-GroupsTest-1267538885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:19:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-84f8e002-ba4f-45fc-91d4-0681d86d394c tempest-GroupsTest-1267538885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:19:07 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-84f8e002-ba4f-45fc-91d4-0681d86d394c tempest-GroupsTest-1267538885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e9e67aa6-6583-4df2-b285-d95c3acaf8de,created_at=2026-07-10T08:19:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-846560519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e9e67aa6-6583-4df2-b285-d95c3acaf8de,host='devstack@QuobyteHD#QuobyteHD',id=5f0c3d6f-3e43-4b67-9d07-087e0e0ae334,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55a5f2dd36b04cdb98d5fb67dba2e5a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:19:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:19:08Z,use_quota=True,user_id='07859c48f6eb4b6394ce95290c19a0a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad094a44-f564-42cd-9a60-d34230cb7b3c),volume_type_id=ad094a44-f564-42cd-9a60-d34230cb7b3c)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:19:07 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-84f8e002-ba4f-45fc-91d4-0681d86d394c tempest-GroupsTest-1267538885 None] Creating volume 5f0c3d6f-3e43-4b67-9d07-087e0e0ae334 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:19:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-84f8e002-ba4f-45fc-91d4-0681d86d394c tempest-GroupsTest-1267538885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:19:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-84f8e002-ba4f-45fc-91d4-0681d86d394c tempest-GroupsTest-1267538885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:19:07 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-84f8e002-ba4f-45fc-91d4-0681d86d394c tempest-GroupsTest-1267538885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:19:07 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-84f8e002-ba4f-45fc-91d4-0681d86d394c tempest-GroupsTest-1267538885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:19:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-84f8e002-ba4f-45fc-91d4-0681d86d394c tempest-GroupsTest-1267538885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:19:07 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-84f8e002-ba4f-45fc-91d4-0681d86d394c tempest-GroupsTest-1267538885 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:19:07 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-84f8e002-ba4f-45fc-91d4-0681d86d394c tempest-GroupsTest-1267538885 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:19:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-84f8e002-ba4f-45fc-91d4-0681d86d394c tempest-GroupsTest-1267538885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5f0c3d6f-3e43-4b67-9d07-087e0e0ae334 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:19:07 devstack sudo[102072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5f0c3d6f-3e43-4b67-9d07-087e0e0ae334 1073741824 Jul 10 10:19:07 devstack sudo[102072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:19:08 devstack sudo[102072]: pam_unix(sudo:session): session closed for user root Jul 10 10:19:08 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-84f8e002-ba4f-45fc-91d4-0681d86d394c tempest-GroupsTest-1267538885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5f0c3d6f-3e43-4b67-9d07-087e0e0ae334 1073741824" returned: 0 in 0.821s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:19:08 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-84f8e002-ba4f-45fc-91d4-0681d86d394c tempest-GroupsTest-1267538885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5f0c3d6f-3e43-4b67-9d07-087e0e0ae334 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:19:08 devstack sudo[102077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5f0c3d6f-3e43-4b67-9d07-087e0e0ae334 Jul 10 10:19:08 devstack sudo[102077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:19:09 devstack sudo[102077]: pam_unix(sudo:session): session closed for user root Jul 10 10:19:09 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-84f8e002-ba4f-45fc-91d4-0681d86d394c tempest-GroupsTest-1267538885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5f0c3d6f-3e43-4b67-9d07-087e0e0ae334" returned: 0 in 0.675s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:19:09 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-84f8e002-ba4f-45fc-91d4-0681d86d394c tempest-GroupsTest-1267538885 None] <== create_volume: return (1540ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:19:09 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-84f8e002-ba4f-45fc-91d4-0681d86d394c tempest-GroupsTest-1267538885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.542s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:19:09 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-84f8e002-ba4f-45fc-91d4-0681d86d394c tempest-GroupsTest-1267538885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e45d00e1-7159-496f-9e39-f6b728ef3c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f0c3d6f-3e43-4b67-9d07-087e0e0ae334', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:19:09 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-84f8e002-ba4f-45fc-91d4-0681d86d394c tempest-GroupsTest-1267538885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75d148f3-66f9-413d-82f5-24b9ffb249ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:19:09 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-84f8e002-ba4f-45fc-91d4-0681d86d394c tempest-GroupsTest-1267538885 None] Volume volume-5f0c3d6f-3e43-4b67-9d07-087e0e0ae334 (5f0c3d6f-3e43-4b67-9d07-087e0e0ae334): created successfully Jul 10 10:19:09 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-84f8e002-ba4f-45fc-91d4-0681d86d394c tempest-GroupsTest-1267538885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75d148f3-66f9-413d-82f5-24b9ffb249ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:19:09 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-84f8e002-ba4f-45fc-91d4-0681d86d394c tempest-GroupsTest-1267538885 None] Flow 'volume_create_manager' (7549b7c1-2c89-42be-b21e-06bd30cfbffb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:19:09 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-84f8e002-ba4f-45fc-91d4-0681d86d394c tempest-GroupsTest-1267538885 None] Created volume successfully. Jul 10 10:19:10 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-bc6d2927-692a-46f7-b52c-d09f733264ee tempest-GroupsTest-1267538885 None] Acquiring lock "cinder-quobyte-5f0c3d6f-3e43-4b67-9d07-087e0e0ae334" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:19:10 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-bc6d2927-692a-46f7-b52c-d09f733264ee tempest-GroupsTest-1267538885 None] Lock "cinder-quobyte-5f0c3d6f-3e43-4b67-9d07-087e0e0ae334" acquired by "delete_volume" :: waited 0.017s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:19:10 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1899d25-7d1f-4a04-aa70-3f97805ed69a]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:19:10 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-bc6d2927-692a-46f7-b52c-d09f733264ee tempest-GroupsTest-1267538885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5f0c3d6f-3e43-4b67-9d07-087e0e0ae334 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:19:10 devstack sudo[102080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5f0c3d6f-3e43-4b67-9d07-087e0e0ae334 Jul 10 10:19:10 devstack sudo[102080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:19:11 devstack sudo[102080]: pam_unix(sudo:session): session closed for user root Jul 10 10:19:11 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-bc6d2927-692a-46f7-b52c-d09f733264ee tempest-GroupsTest-1267538885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5f0c3d6f-3e43-4b67-9d07-087e0e0ae334" returned: 0 in 0.760s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:19:11 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-bc6d2927-692a-46f7-b52c-d09f733264ee tempest-GroupsTest-1267538885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5f0c3d6f-3e43-4b67-9d07-087e0e0ae334 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:19:11 devstack sudo[102085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5f0c3d6f-3e43-4b67-9d07-087e0e0ae334 Jul 10 10:19:11 devstack sudo[102085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:19:11 devstack sudo[102085]: pam_unix(sudo:session): session closed for user root Jul 10 10:19:11 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-bc6d2927-692a-46f7-b52c-d09f733264ee tempest-GroupsTest-1267538885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5f0c3d6f-3e43-4b67-9d07-087e0e0ae334" returned: 0 in 0.651s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:19:11 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-bc6d2927-692a-46f7-b52c-d09f733264ee tempest-GroupsTest-1267538885 None] Lock "cinder-quobyte-5f0c3d6f-3e43-4b67-9d07-087e0e0ae334" released by "delete_volume" :: held 1.448s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:19:12 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-bc6d2927-692a-46f7-b52c-d09f733264ee tempest-GroupsTest-1267538885 None] Created reservations ['9bb9596d-5cb6-447b-a2dd-0b1787459986'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:19:12 devstack cinder-volume[87234]: WARNING cinder.quota [None req-bc6d2927-692a-46f7-b52c-d09f733264ee tempest-GroupsTest-1267538885 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-179116781 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-179116781, it is now deprecated. Please use the default quota class for default quota. Jul 10 10:19:12 devstack cinder-volume[87234]: WARNING cinder.quota [None req-bc6d2927-692a-46f7-b52c-d09f733264ee tempest-GroupsTest-1267538885 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-179116781 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-179116781, it is now deprecated. Please use the default quota class for default quota. Jul 10 10:19:12 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-bc6d2927-692a-46f7-b52c-d09f733264ee tempest-GroupsTest-1267538885 None] Created reservations ['a88131c2-6170-4d65-ac2d-fe805357e3fa', 'c794f1b4-efe5-4f12-affa-abae69f5e616', 'd670f5af-5053-4e5e-9eb6-4b672136d5a1', '6278e95d-56d9-48a0-8875-36d4eae54437'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:19:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-bc6d2927-692a-46f7-b52c-d09f733264ee tempest-GroupsTest-1267538885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:19:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-bc6d2927-692a-46f7-b52c-d09f733264ee tempest-GroupsTest-1267538885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:19:12 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-bc6d2927-692a-46f7-b52c-d09f733264ee tempest-GroupsTest-1267538885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:19:12 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-bc6d2927-692a-46f7-b52c-d09f733264ee tempest-GroupsTest-1267538885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:19:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-bc6d2927-692a-46f7-b52c-d09f733264ee tempest-GroupsTest-1267538885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:19:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-bc6d2927-692a-46f7-b52c-d09f733264ee tempest-GroupsTest-1267538885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:19:12 devstack sudo[102089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:19:12 devstack sudo[102089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:19:12 devstack sudo[102089]: pam_unix(sudo:session): session closed for user root Jul 10 10:19:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-bc6d2927-692a-46f7-b52c-d09f733264ee tempest-GroupsTest-1267538885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.672s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:19:12 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-bc6d2927-692a-46f7-b52c-d09f733264ee tempest-GroupsTest-1267538885 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:19:12 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-bc6d2927-692a-46f7-b52c-d09f733264ee tempest-GroupsTest-1267538885 None] Delete group completed successfully. Jul 10 10:19:12 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-279feb15-7a2c-403b-b561-51a7e158cbaf tempest-GroupsTest-1267538885 None] Created reservations ['ec4a685c-8d57-4aed-889a-47562463f578'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:19:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-279feb15-7a2c-403b-b561-51a7e158cbaf tempest-GroupsTest-1267538885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:19:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-279feb15-7a2c-403b-b561-51a7e158cbaf tempest-GroupsTest-1267538885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:19:12 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-279feb15-7a2c-403b-b561-51a7e158cbaf tempest-GroupsTest-1267538885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:19:12 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-279feb15-7a2c-403b-b561-51a7e158cbaf tempest-GroupsTest-1267538885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:19:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-279feb15-7a2c-403b-b561-51a7e158cbaf tempest-GroupsTest-1267538885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:19:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-279feb15-7a2c-403b-b561-51a7e158cbaf tempest-GroupsTest-1267538885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:19:13 devstack sudo[102092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:19:13 devstack sudo[102092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:19:13 devstack sudo[102092]: pam_unix(sudo:session): session closed for user root Jul 10 10:19:13 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-279feb15-7a2c-403b-b561-51a7e158cbaf tempest-GroupsTest-1267538885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.684s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:19:13 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-279feb15-7a2c-403b-b561-51a7e158cbaf tempest-GroupsTest-1267538885 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:19:13 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-279feb15-7a2c-403b-b561-51a7e158cbaf tempest-GroupsTest-1267538885 None] Delete group completed successfully. Jul 10 10:19:14 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-300f6d2f-58c9-4671-9781-016c1f8ede30 tempest-GroupsTest-1267538885 None] Group tempest-GroupsTest-Group-1012785664: creating Jul 10 10:19:14 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-300f6d2f-58c9-4671-9781-016c1f8ede30 tempest-GroupsTest-1267538885 None] Group tempest-GroupsTest-Group-1012785664: created successfully Jul 10 10:19:14 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-300f6d2f-58c9-4671-9781-016c1f8ede30 tempest-GroupsTest-1267538885 None] Create group completed successfully. Jul 10 10:19:16 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b6daefc-bc69-4aa5-b4f5-8e7f8889ed26 tempest-GroupsTest-1267538885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:19:16 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8b6daefc-bc69-4aa5-b4f5-8e7f8889ed26 tempest-GroupsTest-1267538885 None] Flow 'volume_create_manager' (7edec11a-b456-4b18-82da-782fbdb1b59d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:19:16 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8b6daefc-bc69-4aa5-b4f5-8e7f8889ed26 tempest-GroupsTest-1267538885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d15647f-6eec-4b38-a63c-57e1a580ac3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:19:16 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8b6daefc-bc69-4aa5-b4f5-8e7f8889ed26 tempest-GroupsTest-1267538885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d15647f-6eec-4b38-a63c-57e1a580ac3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:19:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2145756581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=eff334e8-4d65-41fd-ac22-092eb4dd9cc5,host='devstack@QuobyteHD#QuobyteHD',id=29a1b96b-8b66-475b-8de8-8cdbce88d95e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55a5f2dd36b04cdb98d5fb67dba2e5a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:19:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:19:16Z,use_quota=True,user_id='07859c48f6eb4b6394ce95290c19a0a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90c55e29-3755-4a74-a4c2-ffecaefba496),volume_type_id=90c55e29-3755-4a74-a4c2-ffecaefba496)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:19:16 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8b6daefc-bc69-4aa5-b4f5-8e7f8889ed26 tempest-GroupsTest-1267538885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b57efd6-9a84-459d-a443-c4c06949f731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:19:16 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8b6daefc-bc69-4aa5-b4f5-8e7f8889ed26 tempest-GroupsTest-1267538885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b57efd6-9a84-459d-a443-c4c06949f731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:19:16 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8b6daefc-bc69-4aa5-b4f5-8e7f8889ed26 tempest-GroupsTest-1267538885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (481e04f3-1e36-42a7-b687-82518c010bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:19:16 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8b6daefc-bc69-4aa5-b4f5-8e7f8889ed26 tempest-GroupsTest-1267538885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (481e04f3-1e36-42a7-b687-82518c010bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29a1b96b-8b66-475b-8de8-8cdbce88d95e', 'volume_name': 'volume-29a1b96b-8b66-475b-8de8-8cdbce88d95e', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:19:16 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8b6daefc-bc69-4aa5-b4f5-8e7f8889ed26 tempest-GroupsTest-1267538885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2384f88f-cb48-4d06-bb7b-357bf91fd4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:19:16 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8b6daefc-bc69-4aa5-b4f5-8e7f8889ed26 tempest-GroupsTest-1267538885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2384f88f-cb48-4d06-bb7b-357bf91fd4f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:19:16 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8b6daefc-bc69-4aa5-b4f5-8e7f8889ed26 tempest-GroupsTest-1267538885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c286814-a726-4dcd-a188-e035fc395db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:19:16 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-8b6daefc-bc69-4aa5-b4f5-8e7f8889ed26 tempest-GroupsTest-1267538885 None] Volume 29a1b96b-8b66-475b-8de8-8cdbce88d95e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29a1b96b-8b66-475b-8de8-8cdbce88d95e', 'volume_size': 1} Jul 10 10:19:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-8b6daefc-bc69-4aa5-b4f5-8e7f8889ed26 tempest-GroupsTest-1267538885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:19:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-8b6daefc-bc69-4aa5-b4f5-8e7f8889ed26 tempest-GroupsTest-1267538885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:19:16 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-8b6daefc-bc69-4aa5-b4f5-8e7f8889ed26 tempest-GroupsTest-1267538885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=eff334e8-4d65-41fd-ac22-092eb4dd9cc5,created_at=2026-07-10T08:19:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2145756581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=eff334e8-4d65-41fd-ac22-092eb4dd9cc5,host='devstack@QuobyteHD#QuobyteHD',id=29a1b96b-8b66-475b-8de8-8cdbce88d95e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55a5f2dd36b04cdb98d5fb67dba2e5a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:19:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:19:16Z,use_quota=True,user_id='07859c48f6eb4b6394ce95290c19a0a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90c55e29-3755-4a74-a4c2-ffecaefba496),volume_type_id=90c55e29-3755-4a74-a4c2-ffecaefba496)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:19:16 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-8b6daefc-bc69-4aa5-b4f5-8e7f8889ed26 tempest-GroupsTest-1267538885 None] Creating volume 29a1b96b-8b66-475b-8de8-8cdbce88d95e {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:19:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-8b6daefc-bc69-4aa5-b4f5-8e7f8889ed26 tempest-GroupsTest-1267538885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:19:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-8b6daefc-bc69-4aa5-b4f5-8e7f8889ed26 tempest-GroupsTest-1267538885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:19:16 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-8b6daefc-bc69-4aa5-b4f5-8e7f8889ed26 tempest-GroupsTest-1267538885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:19:16 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-8b6daefc-bc69-4aa5-b4f5-8e7f8889ed26 tempest-GroupsTest-1267538885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:19:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-8b6daefc-bc69-4aa5-b4f5-8e7f8889ed26 tempest-GroupsTest-1267538885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:19:16 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-8b6daefc-bc69-4aa5-b4f5-8e7f8889ed26 tempest-GroupsTest-1267538885 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:19:16 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-8b6daefc-bc69-4aa5-b4f5-8e7f8889ed26 tempest-GroupsTest-1267538885 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:19:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-8b6daefc-bc69-4aa5-b4f5-8e7f8889ed26 tempest-GroupsTest-1267538885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-29a1b96b-8b66-475b-8de8-8cdbce88d95e 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:19:16 devstack sudo[102102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-29a1b96b-8b66-475b-8de8-8cdbce88d95e 1073741824 Jul 10 10:19:16 devstack sudo[102102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:19:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-44177ef3-fac9-43a8-8541-cfb470c77b9f req-f22dba73-9eee-4bd6-b900-cca86a61f3e8 tempest-TestStampPattern-1267302871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:19:16 devstack sudo[102102]: pam_unix(sudo:session): session closed for user root Jul 10 10:19:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-8b6daefc-bc69-4aa5-b4f5-8e7f8889ed26 tempest-GroupsTest-1267538885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-29a1b96b-8b66-475b-8de8-8cdbce88d95e 1073741824" returned: 0 in 0.838s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:19:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-8b6daefc-bc69-4aa5-b4f5-8e7f8889ed26 tempest-GroupsTest-1267538885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-29a1b96b-8b66-475b-8de8-8cdbce88d95e {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:19:17 devstack sudo[102116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-29a1b96b-8b66-475b-8de8-8cdbce88d95e Jul 10 10:19:17 devstack sudo[102116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:19:17 devstack sudo[102116]: pam_unix(sudo:session): session closed for user root Jul 10 10:19:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-8b6daefc-bc69-4aa5-b4f5-8e7f8889ed26 tempest-GroupsTest-1267538885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-29a1b96b-8b66-475b-8de8-8cdbce88d95e" returned: 0 in 0.675s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:19:17 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-8b6daefc-bc69-4aa5-b4f5-8e7f8889ed26 tempest-GroupsTest-1267538885 None] <== create_volume: return (1550ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:19:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-8b6daefc-bc69-4aa5-b4f5-8e7f8889ed26 tempest-GroupsTest-1267538885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.553s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:19:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-44177ef3-fac9-43a8-8541-cfb470c77b9f req-f22dba73-9eee-4bd6-b900-cca86a61f3e8 tempest-TestStampPattern-1267302871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.084s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:19:17 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8b6daefc-bc69-4aa5-b4f5-8e7f8889ed26 tempest-GroupsTest-1267538885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c286814-a726-4dcd-a188-e035fc395db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29a1b96b-8b66-475b-8de8-8cdbce88d95e', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:19:17 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8b6daefc-bc69-4aa5-b4f5-8e7f8889ed26 tempest-GroupsTest-1267538885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e8d194c-89cf-435f-bdfc-2a168bf1abbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:19:17 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e95e5b5-7650-480e-90e9-f3856d2018a8]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:19:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-44177ef3-fac9-43a8-8541-cfb470c77b9f req-f22dba73-9eee-4bd6-b900-cca86a61f3e8 tempest-TestStampPattern-1267302871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7f87bb0f-5ab5-4897-939c-fa8c133c13e3 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:19:17 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-8b6daefc-bc69-4aa5-b4f5-8e7f8889ed26 tempest-GroupsTest-1267538885 None] Volume volume-29a1b96b-8b66-475b-8de8-8cdbce88d95e (29a1b96b-8b66-475b-8de8-8cdbce88d95e): created successfully Jul 10 10:19:17 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8b6daefc-bc69-4aa5-b4f5-8e7f8889ed26 tempest-GroupsTest-1267538885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e8d194c-89cf-435f-bdfc-2a168bf1abbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:19:17 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8b6daefc-bc69-4aa5-b4f5-8e7f8889ed26 tempest-GroupsTest-1267538885 None] Flow 'volume_create_manager' (7edec11a-b456-4b18-82da-782fbdb1b59d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:19:17 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-8b6daefc-bc69-4aa5-b4f5-8e7f8889ed26 tempest-GroupsTest-1267538885 None] Created volume successfully. Jul 10 10:19:17 devstack sudo[102156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7f87bb0f-5ab5-4897-939c-fa8c133c13e3 Jul 10 10:19:17 devstack sudo[102156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:19:18 devstack sudo[102156]: pam_unix(sudo:session): session closed for user root Jul 10 10:19:18 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-44177ef3-fac9-43a8-8541-cfb470c77b9f req-f22dba73-9eee-4bd6-b900-cca86a61f3e8 tempest-TestStampPattern-1267302871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7f87bb0f-5ab5-4897-939c-fa8c133c13e3" returned: 0 in 0.803s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:19:18 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-44177ef3-fac9-43a8-8541-cfb470c77b9f req-f22dba73-9eee-4bd6-b900-cca86a61f3e8 tempest-TestStampPattern-1267302871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.831s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:19:18 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [req-44177ef3-fac9-43a8-8541-cfb470c77b9f req-f22dba73-9eee-4bd6-b900-cca86a61f3e8 tempest-TestStampPattern-1267302871 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091', 'name': 'volume-7f87bb0f-5ab5-4897-939c-fa8c133c13e3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b2911039-5b7e-4655-a844-3bfed03db7e8', 'enforce_multipath': True} {{(pid=87234) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 10:19:18 devstack cinder-volume[87234]: INFO cinder.volume.manager [req-44177ef3-fac9-43a8-8541-cfb470c77b9f req-f22dba73-9eee-4bd6-b900-cca86a61f3e8 tempest-TestStampPattern-1267302871 None] attachment_update completed successfully. Jul 10 10:19:18 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-81e98621-e293-4d7c-a35b-b611624c3804 tempest-GroupsTest-1267538885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:19:19 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-81e98621-e293-4d7c-a35b-b611624c3804 tempest-GroupsTest-1267538885 None] Flow 'volume_create_manager' (ee0a9992-0790-4e8d-8ba3-a366212f6ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:19:19 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-81e98621-e293-4d7c-a35b-b611624c3804 tempest-GroupsTest-1267538885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e02bf764-49e1-4334-a413-d9a5de5e0111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:19:19 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-81e98621-e293-4d7c-a35b-b611624c3804 tempest-GroupsTest-1267538885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e02bf764-49e1-4334-a413-d9a5de5e0111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:19:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2011470828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=eff334e8-4d65-41fd-ac22-092eb4dd9cc5,host='devstack@QuobyteHD#QuobyteHD',id=0110cb65-06fc-4212-b111-b6758a13d9d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55a5f2dd36b04cdb98d5fb67dba2e5a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:19:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:19:19Z,use_quota=True,user_id='07859c48f6eb4b6394ce95290c19a0a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90c55e29-3755-4a74-a4c2-ffecaefba496),volume_type_id=90c55e29-3755-4a74-a4c2-ffecaefba496)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:19:19 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-81e98621-e293-4d7c-a35b-b611624c3804 tempest-GroupsTest-1267538885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd241dcd-0f44-472c-89d3-30d04df3185a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:19:19 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-81e98621-e293-4d7c-a35b-b611624c3804 tempest-GroupsTest-1267538885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd241dcd-0f44-472c-89d3-30d04df3185a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:19:19 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-81e98621-e293-4d7c-a35b-b611624c3804 tempest-GroupsTest-1267538885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fed97df8-0246-47c1-a067-1bfb5ab6330b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:19:19 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-81e98621-e293-4d7c-a35b-b611624c3804 tempest-GroupsTest-1267538885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fed97df8-0246-47c1-a067-1bfb5ab6330b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0110cb65-06fc-4212-b111-b6758a13d9d5', 'volume_name': 'volume-0110cb65-06fc-4212-b111-b6758a13d9d5', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:19:19 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-81e98621-e293-4d7c-a35b-b611624c3804 tempest-GroupsTest-1267538885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9c31ace-1e4d-41b7-96c3-50bc5640239f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:19:19 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-81e98621-e293-4d7c-a35b-b611624c3804 tempest-GroupsTest-1267538885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9c31ace-1e4d-41b7-96c3-50bc5640239f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:19:19 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-81e98621-e293-4d7c-a35b-b611624c3804 tempest-GroupsTest-1267538885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64e63245-ba50-4e3c-a680-42d7fad9ba1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:19:19 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-81e98621-e293-4d7c-a35b-b611624c3804 tempest-GroupsTest-1267538885 None] Volume 0110cb65-06fc-4212-b111-b6758a13d9d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0110cb65-06fc-4212-b111-b6758a13d9d5', 'volume_size': 1} Jul 10 10:19:19 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-81e98621-e293-4d7c-a35b-b611624c3804 tempest-GroupsTest-1267538885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:19:19 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-81e98621-e293-4d7c-a35b-b611624c3804 tempest-GroupsTest-1267538885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:19:19 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-81e98621-e293-4d7c-a35b-b611624c3804 tempest-GroupsTest-1267538885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=eff334e8-4d65-41fd-ac22-092eb4dd9cc5,created_at=2026-07-10T08:19:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2011470828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=eff334e8-4d65-41fd-ac22-092eb4dd9cc5,host='devstack@QuobyteHD#QuobyteHD',id=0110cb65-06fc-4212-b111-b6758a13d9d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55a5f2dd36b04cdb98d5fb67dba2e5a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:19:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:19:19Z,use_quota=True,user_id='07859c48f6eb4b6394ce95290c19a0a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90c55e29-3755-4a74-a4c2-ffecaefba496),volume_type_id=90c55e29-3755-4a74-a4c2-ffecaefba496)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:19:19 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-81e98621-e293-4d7c-a35b-b611624c3804 tempest-GroupsTest-1267538885 None] Creating volume 0110cb65-06fc-4212-b111-b6758a13d9d5 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:19:19 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-81e98621-e293-4d7c-a35b-b611624c3804 tempest-GroupsTest-1267538885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:19:19 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-81e98621-e293-4d7c-a35b-b611624c3804 tempest-GroupsTest-1267538885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:19:19 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-81e98621-e293-4d7c-a35b-b611624c3804 tempest-GroupsTest-1267538885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:19:19 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-81e98621-e293-4d7c-a35b-b611624c3804 tempest-GroupsTest-1267538885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:19:19 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-81e98621-e293-4d7c-a35b-b611624c3804 tempest-GroupsTest-1267538885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:19:19 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-81e98621-e293-4d7c-a35b-b611624c3804 tempest-GroupsTest-1267538885 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:19:19 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-81e98621-e293-4d7c-a35b-b611624c3804 tempest-GroupsTest-1267538885 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:19:19 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-81e98621-e293-4d7c-a35b-b611624c3804 tempest-GroupsTest-1267538885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0110cb65-06fc-4212-b111-b6758a13d9d5 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:19:19 devstack sudo[102162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0110cb65-06fc-4212-b111-b6758a13d9d5 1073741824 Jul 10 10:19:19 devstack sudo[102162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:19:20 devstack sudo[102162]: pam_unix(sudo:session): session closed for user root Jul 10 10:19:20 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-81e98621-e293-4d7c-a35b-b611624c3804 tempest-GroupsTest-1267538885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0110cb65-06fc-4212-b111-b6758a13d9d5 1073741824" returned: 0 in 0.944s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:19:20 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-81e98621-e293-4d7c-a35b-b611624c3804 tempest-GroupsTest-1267538885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0110cb65-06fc-4212-b111-b6758a13d9d5 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:19:20 devstack sudo[102550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0110cb65-06fc-4212-b111-b6758a13d9d5 Jul 10 10:19:20 devstack sudo[102550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:19:20 devstack sudo[102550]: pam_unix(sudo:session): session closed for user root Jul 10 10:19:20 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-81e98621-e293-4d7c-a35b-b611624c3804 tempest-GroupsTest-1267538885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0110cb65-06fc-4212-b111-b6758a13d9d5" returned: 0 in 0.657s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:19:20 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-81e98621-e293-4d7c-a35b-b611624c3804 tempest-GroupsTest-1267538885 None] <== create_volume: return (1653ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:19:20 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-81e98621-e293-4d7c-a35b-b611624c3804 tempest-GroupsTest-1267538885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.656s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:19:20 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-81e98621-e293-4d7c-a35b-b611624c3804 tempest-GroupsTest-1267538885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64e63245-ba50-4e3c-a680-42d7fad9ba1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0110cb65-06fc-4212-b111-b6758a13d9d5', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:19:20 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-81e98621-e293-4d7c-a35b-b611624c3804 tempest-GroupsTest-1267538885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba05e0fc-020b-435b-8ec4-9e7c9f95896c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:19:20 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-81e98621-e293-4d7c-a35b-b611624c3804 tempest-GroupsTest-1267538885 None] Volume volume-0110cb65-06fc-4212-b111-b6758a13d9d5 (0110cb65-06fc-4212-b111-b6758a13d9d5): created successfully Jul 10 10:19:20 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-81e98621-e293-4d7c-a35b-b611624c3804 tempest-GroupsTest-1267538885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba05e0fc-020b-435b-8ec4-9e7c9f95896c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:19:20 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-81e98621-e293-4d7c-a35b-b611624c3804 tempest-GroupsTest-1267538885 None] Flow 'volume_create_manager' (ee0a9992-0790-4e8d-8ba3-a366212f6ee7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:19:20 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-81e98621-e293-4d7c-a35b-b611624c3804 tempest-GroupsTest-1267538885 None] Created volume successfully. Jul 10 10:19:21 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-dc1aec9d-31db-4649-89ce-d162079e3949 tempest-GroupsTest-1267538885 None] Update group completed successfully. Jul 10 10:19:22 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-6c27c9ce-229f-4503-b863-a6c913469fd2 tempest-GroupsTest-1267538885 None] Update group completed successfully. Jul 10 10:19:24 devstack cinder-volume[87234]: DEBUG dbcounter [-] [87234] Writing DB stats cinder:SELECT=100,cinder:INSERT=30,cinder:UPDATE=116,cinder:DELETE=5 {{(pid=87234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 10:19:24 devstack cinder-volume[87234]: DEBUG dbcounter [-] [87234] Writing DB stats cinder:SELECT=113,cinder:UPDATE=110,cinder:DELETE=5,cinder:INSERT=22 {{(pid=87234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 10:19:24 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-5c47a89f-4af0-4ba3-a4b9-d1651ea4205c tempest-GroupsTest-1267538885 None] Acquiring lock "cinder-quobyte-0110cb65-06fc-4212-b111-b6758a13d9d5" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:19:24 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-5c47a89f-4af0-4ba3-a4b9-d1651ea4205c tempest-GroupsTest-1267538885 None] Lock "cinder-quobyte-0110cb65-06fc-4212-b111-b6758a13d9d5" acquired by "delete_volume" :: waited 0.027s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:19:24 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[187368ea-cf31-4375-993a-044814d6a1d7]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:19:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5c47a89f-4af0-4ba3-a4b9-d1651ea4205c tempest-GroupsTest-1267538885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0110cb65-06fc-4212-b111-b6758a13d9d5 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:19:24 devstack sudo[102565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0110cb65-06fc-4212-b111-b6758a13d9d5 Jul 10 10:19:24 devstack sudo[102565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:19:25 devstack sudo[102565]: pam_unix(sudo:session): session closed for user root Jul 10 10:19:25 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5c47a89f-4af0-4ba3-a4b9-d1651ea4205c tempest-GroupsTest-1267538885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0110cb65-06fc-4212-b111-b6758a13d9d5" returned: 0 in 0.802s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:19:25 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5c47a89f-4af0-4ba3-a4b9-d1651ea4205c tempest-GroupsTest-1267538885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0110cb65-06fc-4212-b111-b6758a13d9d5 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:19:25 devstack sudo[102582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0110cb65-06fc-4212-b111-b6758a13d9d5 Jul 10 10:19:25 devstack sudo[102582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:19:25 devstack sudo[102582]: pam_unix(sudo:session): session closed for user root Jul 10 10:19:25 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5c47a89f-4af0-4ba3-a4b9-d1651ea4205c tempest-GroupsTest-1267538885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0110cb65-06fc-4212-b111-b6758a13d9d5" returned: 0 in 0.668s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:19:26 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-5c47a89f-4af0-4ba3-a4b9-d1651ea4205c tempest-GroupsTest-1267538885 None] Lock "cinder-quobyte-0110cb65-06fc-4212-b111-b6758a13d9d5" released by "delete_volume" :: held 1.528s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:19:26 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-5c47a89f-4af0-4ba3-a4b9-d1651ea4205c tempest-GroupsTest-1267538885 None] Acquiring lock "cinder-quobyte-29a1b96b-8b66-475b-8de8-8cdbce88d95e" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:19:26 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-5c47a89f-4af0-4ba3-a4b9-d1651ea4205c tempest-GroupsTest-1267538885 None] Lock "cinder-quobyte-29a1b96b-8b66-475b-8de8-8cdbce88d95e" acquired by "delete_volume" :: waited 0.016s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:19:26 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb87a04-41ac-42e9-bbd9-753ff1375e8c]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:19:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5c47a89f-4af0-4ba3-a4b9-d1651ea4205c tempest-GroupsTest-1267538885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-29a1b96b-8b66-475b-8de8-8cdbce88d95e {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:19:26 devstack sudo[102585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-29a1b96b-8b66-475b-8de8-8cdbce88d95e Jul 10 10:19:26 devstack sudo[102585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:19:26 devstack sudo[102585]: pam_unix(sudo:session): session closed for user root Jul 10 10:19:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5c47a89f-4af0-4ba3-a4b9-d1651ea4205c tempest-GroupsTest-1267538885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-29a1b96b-8b66-475b-8de8-8cdbce88d95e" returned: 0 in 0.829s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:19:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5c47a89f-4af0-4ba3-a4b9-d1651ea4205c tempest-GroupsTest-1267538885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-29a1b96b-8b66-475b-8de8-8cdbce88d95e {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:19:26 devstack sudo[102618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-29a1b96b-8b66-475b-8de8-8cdbce88d95e Jul 10 10:19:26 devstack sudo[102618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:19:26 devstack cinder-volume[87234]: INFO cinder.volume.manager [req-b2c9833e-464c-4a78-ae75-3d387cb3b4c2 req-fa724f77-807b-423c-a434-0e1b72e27730 tempest-TestStampPattern-1267302871 None] Terminate volume connection completed successfully. Jul 10 10:19:26 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [req-b2c9833e-464c-4a78-ae75-3d387cb3b4c2 req-fa724f77-807b-423c-a434-0e1b72e27730 tempest-TestStampPattern-1267302871 None] Deleting attachment b2911039-5b7e-4655-a844-3bfed03db7e8. {{(pid=87234) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 10:19:27 devstack sudo[102618]: pam_unix(sudo:session): session closed for user root Jul 10 10:19:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5c47a89f-4af0-4ba3-a4b9-d1651ea4205c tempest-GroupsTest-1267538885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-29a1b96b-8b66-475b-8de8-8cdbce88d95e" returned: 0 in 0.684s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:19:27 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-5c47a89f-4af0-4ba3-a4b9-d1651ea4205c tempest-GroupsTest-1267538885 None] Lock "cinder-quobyte-29a1b96b-8b66-475b-8de8-8cdbce88d95e" released by "delete_volume" :: held 1.556s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:19:27 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-5c47a89f-4af0-4ba3-a4b9-d1651ea4205c tempest-GroupsTest-1267538885 None] Created reservations ['37f1c2a4-1f23-4eb6-b34b-558bf5713ee7'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:19:27 devstack cinder-volume[87234]: WARNING cinder.quota [None req-5c47a89f-4af0-4ba3-a4b9-d1651ea4205c tempest-GroupsTest-1267538885 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1822121693 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1822121693, it is now deprecated. Please use the default quota class for default quota. Jul 10 10:19:27 devstack cinder-volume[87234]: WARNING cinder.quota [None req-5c47a89f-4af0-4ba3-a4b9-d1651ea4205c tempest-GroupsTest-1267538885 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1822121693 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1822121693, it is now deprecated. Please use the default quota class for default quota. Jul 10 10:19:27 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-5c47a89f-4af0-4ba3-a4b9-d1651ea4205c tempest-GroupsTest-1267538885 None] Created reservations ['f4eddd44-6ac2-4128-a10c-6f8ed46fb6c6', 'a8e569df-2b86-4b81-989f-cc60e9ab9e48', 'd0e7b4ab-30fe-4d8b-8ec8-d5c4db9ca41c', '6a519b9c-2a54-4d66-ab64-da5e067fc616'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:19:27 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-5c47a89f-4af0-4ba3-a4b9-d1651ea4205c tempest-GroupsTest-1267538885 None] Created reservations ['d5654b51-8b4c-407e-a8a6-c55ba2f2abc8', 'c8b87b39-42b4-4a2f-8a62-9d0047aded2e', 'c00dc662-e894-4a71-a6cf-e9eb55da2a0b', '14cbcc04-4bae-4cc9-aef9-78336b022e82'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:19:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-5c47a89f-4af0-4ba3-a4b9-d1651ea4205c tempest-GroupsTest-1267538885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:19:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-5c47a89f-4af0-4ba3-a4b9-d1651ea4205c tempest-GroupsTest-1267538885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:19:27 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-5c47a89f-4af0-4ba3-a4b9-d1651ea4205c tempest-GroupsTest-1267538885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:19:27 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-5c47a89f-4af0-4ba3-a4b9-d1651ea4205c tempest-GroupsTest-1267538885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:19:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-5c47a89f-4af0-4ba3-a4b9-d1651ea4205c tempest-GroupsTest-1267538885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:19:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5c47a89f-4af0-4ba3-a4b9-d1651ea4205c tempest-GroupsTest-1267538885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:19:27 devstack sudo[102622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:19:27 devstack sudo[102622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:19:28 devstack sudo[102622]: pam_unix(sudo:session): session closed for user root Jul 10 10:19:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5c47a89f-4af0-4ba3-a4b9-d1651ea4205c tempest-GroupsTest-1267538885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.676s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:19:28 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-5c47a89f-4af0-4ba3-a4b9-d1651ea4205c tempest-GroupsTest-1267538885 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:19:28 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-5c47a89f-4af0-4ba3-a4b9-d1651ea4205c tempest-GroupsTest-1267538885 None] Delete group completed successfully. Jul 10 10:19:29 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-dd7ebd65-e9cc-44cd-b1e6-5ca456382690 tempest-TestStampPattern-1267302871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:19:29 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-dd7ebd65-e9cc-44cd-b1e6-5ca456382690 tempest-TestStampPattern-1267302871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:19:29 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-dd7ebd65-e9cc-44cd-b1e6-5ca456382690 tempest-TestStampPattern-1267302871 None] Creating offline snapshot 8cd1bd27-cb2e-4e13-be59-884b8826ca0c of volume 7f87bb0f-5ab5-4897-939c-fa8c133c13e3 {{(pid=87234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 10:19:29 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c216a0-1bb6-46c1-a274-068fe0e5b0cf]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:19:29 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-dd7ebd65-e9cc-44cd-b1e6-5ca456382690 tempest-TestStampPattern-1267302871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7f87bb0f-5ab5-4897-939c-fa8c133c13e3 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:19:29 devstack sudo[102625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7f87bb0f-5ab5-4897-939c-fa8c133c13e3 Jul 10 10:19:29 devstack sudo[102625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:19:30 devstack sudo[102625]: pam_unix(sudo:session): session closed for user root Jul 10 10:19:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-dd7ebd65-e9cc-44cd-b1e6-5ca456382690 tempest-TestStampPattern-1267302871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7f87bb0f-5ab5-4897-939c-fa8c133c13e3" returned: 0 in 0.825s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:19:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-dd7ebd65-e9cc-44cd-b1e6-5ca456382690 tempest-TestStampPattern-1267302871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7f87bb0f-5ab5-4897-939c-fa8c133c13e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7f87bb0f-5ab5-4897-939c-fa8c133c13e3.8cd1bd27-cb2e-4e13-be59-884b8826ca0c 1G {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:19:30 devstack sudo[102631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7f87bb0f-5ab5-4897-939c-fa8c133c13e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7f87bb0f-5ab5-4897-939c-fa8c133c13e3.8cd1bd27-cb2e-4e13-be59-884b8826ca0c 1G Jul 10 10:19:30 devstack sudo[102631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:19:30 devstack sudo[102631]: pam_unix(sudo:session): session closed for user root Jul 10 10:19:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-dd7ebd65-e9cc-44cd-b1e6-5ca456382690 tempest-TestStampPattern-1267302871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7f87bb0f-5ab5-4897-939c-fa8c133c13e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7f87bb0f-5ab5-4897-939c-fa8c133c13e3.8cd1bd27-cb2e-4e13-be59-884b8826ca0c 1G" returned: 0 in 0.903s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:19:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-dd7ebd65-e9cc-44cd-b1e6-5ca456382690 tempest-TestStampPattern-1267302871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f87bb0f-5ab5-4897-939c-fa8c133c13e3 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7f87bb0f-5ab5-4897-939c-fa8c133c13e3.8cd1bd27-cb2e-4e13-be59-884b8826ca0c {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:19:30 devstack sudo[102643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f87bb0f-5ab5-4897-939c-fa8c133c13e3 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7f87bb0f-5ab5-4897-939c-fa8c133c13e3.8cd1bd27-cb2e-4e13-be59-884b8826ca0c Jul 10 10:19:30 devstack sudo[102643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:19:31 devstack sudo[102643]: pam_unix(sudo:session): session closed for user root Jul 10 10:19:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-dd7ebd65-e9cc-44cd-b1e6-5ca456382690 tempest-TestStampPattern-1267302871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f87bb0f-5ab5-4897-939c-fa8c133c13e3 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7f87bb0f-5ab5-4897-939c-fa8c133c13e3.8cd1bd27-cb2e-4e13-be59-884b8826ca0c" returned: 0 in 0.712s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:19:31 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-dd7ebd65-e9cc-44cd-b1e6-5ca456382690 tempest-TestStampPattern-1267302871 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7f87bb0f-5ab5-4897-939c-fa8c133c13e3.8cd1bd27-cb2e-4e13-be59-884b8826ca0c is being set with open permissions: ugo+rw Jul 10 10:19:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-dd7ebd65-e9cc-44cd-b1e6-5ca456382690 tempest-TestStampPattern-1267302871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7f87bb0f-5ab5-4897-939c-fa8c133c13e3.8cd1bd27-cb2e-4e13-be59-884b8826ca0c {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:19:31 devstack sudo[102648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7f87bb0f-5ab5-4897-939c-fa8c133c13e3.8cd1bd27-cb2e-4e13-be59-884b8826ca0c Jul 10 10:19:31 devstack sudo[102648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:19:32 devstack sudo[102648]: pam_unix(sudo:session): session closed for user root Jul 10 10:19:32 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-dd7ebd65-e9cc-44cd-b1e6-5ca456382690 tempest-TestStampPattern-1267302871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7f87bb0f-5ab5-4897-939c-fa8c133c13e3.8cd1bd27-cb2e-4e13-be59-884b8826ca0c" returned: 0 in 0.669s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:19:32 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-dd7ebd65-e9cc-44cd-b1e6-5ca456382690 tempest-TestStampPattern-1267302871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7f87bb0f-5ab5-4897-939c-fa8c133c13e3.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:19:32 devstack sudo[102651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7f87bb0f-5ab5-4897-939c-fa8c133c13e3.info Jul 10 10:19:32 devstack sudo[102651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:19:32 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-254ab3bf-5e25-4413-af1a-2145f9a45a71 tempest-GroupsV320Test-1694074877 None] Group tempest-GroupsV320Test-Group-1462189841: creating Jul 10 10:19:32 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-254ab3bf-5e25-4413-af1a-2145f9a45a71 tempest-GroupsV320Test-1694074877 None] Group tempest-GroupsV320Test-Group-1462189841: created successfully Jul 10 10:19:32 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-254ab3bf-5e25-4413-af1a-2145f9a45a71 tempest-GroupsV320Test-1694074877 None] Create group completed successfully. Jul 10 10:19:33 devstack sudo[102651]: pam_unix(sudo:session): session closed for user root Jul 10 10:19:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-dd7ebd65-e9cc-44cd-b1e6-5ca456382690 tempest-TestStampPattern-1267302871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7f87bb0f-5ab5-4897-939c-fa8c133c13e3.info" returned: 0 in 0.692s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:19:33 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-dd7ebd65-e9cc-44cd-b1e6-5ca456382690 tempest-TestStampPattern-1267302871 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7f87bb0f-5ab5-4897-939c-fa8c133c13e3.info is being set with open permissions: ugo+rw Jul 10 10:19:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-dd7ebd65-e9cc-44cd-b1e6-5ca456382690 tempest-TestStampPattern-1267302871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7f87bb0f-5ab5-4897-939c-fa8c133c13e3.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:19:33 devstack sudo[102654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7f87bb0f-5ab5-4897-939c-fa8c133c13e3.info Jul 10 10:19:33 devstack sudo[102654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:19:33 devstack sudo[102654]: pam_unix(sudo:session): session closed for user root Jul 10 10:19:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-dd7ebd65-e9cc-44cd-b1e6-5ca456382690 tempest-TestStampPattern-1267302871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7f87bb0f-5ab5-4897-939c-fa8c133c13e3.info" returned: 0 in 0.633s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:19:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-dd7ebd65-e9cc-44cd-b1e6-5ca456382690 tempest-TestStampPattern-1267302871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.530s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:19:33 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-dd7ebd65-e9cc-44cd-b1e6-5ca456382690 tempest-TestStampPattern-1267302871 None] Create snapshot completed successfully Jul 10 10:19:34 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-944439f0-8b57-42cd-83b4-ef8d50c21bf6 tempest-GroupsV320Test-1694074877 None] Created reservations ['5b0097a0-ed20-4202-b56f-d336ae8bbb7a'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:19:34 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-944439f0-8b57-42cd-83b4-ef8d50c21bf6 tempest-GroupsV320Test-1694074877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:19:34 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-944439f0-8b57-42cd-83b4-ef8d50c21bf6 tempest-GroupsV320Test-1694074877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:19:34 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-944439f0-8b57-42cd-83b4-ef8d50c21bf6 tempest-GroupsV320Test-1694074877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:19:34 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-944439f0-8b57-42cd-83b4-ef8d50c21bf6 tempest-GroupsV320Test-1694074877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:19:34 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-944439f0-8b57-42cd-83b4-ef8d50c21bf6 tempest-GroupsV320Test-1694074877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:19:34 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-944439f0-8b57-42cd-83b4-ef8d50c21bf6 tempest-GroupsV320Test-1694074877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:19:34 devstack sudo[102657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:19:34 devstack sudo[102657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:19:35 devstack sudo[102657]: pam_unix(sudo:session): session closed for user root Jul 10 10:19:35 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-944439f0-8b57-42cd-83b4-ef8d50c21bf6 tempest-GroupsV320Test-1694074877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.658s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:19:35 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-944439f0-8b57-42cd-83b4-ef8d50c21bf6 tempest-GroupsV320Test-1694074877 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:19:35 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-944439f0-8b57-42cd-83b4-ef8d50c21bf6 tempest-GroupsV320Test-1694074877 None] Delete group completed successfully. Jul 10 10:19:40 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-3caeb675-2ebc-46a6-94b0-508227b52863 tempest-VolumeQuotasNegativeTestJSON-1400922376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:19:40 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3caeb675-2ebc-46a6-94b0-508227b52863 tempest-VolumeQuotasNegativeTestJSON-1400922376 None] Flow 'volume_create_manager' (ddeaa785-f2be-4160-81ef-694fa5c6dac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:19:40 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3caeb675-2ebc-46a6-94b0-508227b52863 tempest-VolumeQuotasNegativeTestJSON-1400922376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2195487a-b2ab-4b9f-adb8-4c522eb8e27e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:19:40 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3caeb675-2ebc-46a6-94b0-508227b52863 tempest-VolumeQuotasNegativeTestJSON-1400922376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2195487a-b2ab-4b9f-adb8-4c522eb8e27e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:19:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2062929022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be592232-d759-4896-9280-a707d626149e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dbc7c9f3e8f4648a33148ea0a76a8d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:19:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:19:41Z,use_quota=True,user_id='0d3a5db24a0348178861be499c6cbfbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:19:40 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3caeb675-2ebc-46a6-94b0-508227b52863 tempest-VolumeQuotasNegativeTestJSON-1400922376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2e23a54-b502-431e-9a62-d78af6b8e259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:19:40 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3caeb675-2ebc-46a6-94b0-508227b52863 tempest-VolumeQuotasNegativeTestJSON-1400922376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2e23a54-b502-431e-9a62-d78af6b8e259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:19:40 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3caeb675-2ebc-46a6-94b0-508227b52863 tempest-VolumeQuotasNegativeTestJSON-1400922376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dedc1cc6-8d65-44cd-b4f6-c153f926f6c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:19:40 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3caeb675-2ebc-46a6-94b0-508227b52863 tempest-VolumeQuotasNegativeTestJSON-1400922376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dedc1cc6-8d65-44cd-b4f6-c153f926f6c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be592232-d759-4896-9280-a707d626149e', 'volume_name': 'volume-be592232-d759-4896-9280-a707d626149e', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:19:40 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3caeb675-2ebc-46a6-94b0-508227b52863 tempest-VolumeQuotasNegativeTestJSON-1400922376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2a5a8dd-aae9-4124-bb6e-9a902de07c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:19:40 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3caeb675-2ebc-46a6-94b0-508227b52863 tempest-VolumeQuotasNegativeTestJSON-1400922376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2a5a8dd-aae9-4124-bb6e-9a902de07c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:19:40 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3caeb675-2ebc-46a6-94b0-508227b52863 tempest-VolumeQuotasNegativeTestJSON-1400922376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2a8d8e5-4c63-4ef8-938c-bc3dcc86bab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:19:40 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-3caeb675-2ebc-46a6-94b0-508227b52863 tempest-VolumeQuotasNegativeTestJSON-1400922376 None] Volume be592232-d759-4896-9280-a707d626149e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be592232-d759-4896-9280-a707d626149e', 'volume_size': 1} Jul 10 10:19:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-3caeb675-2ebc-46a6-94b0-508227b52863 tempest-VolumeQuotasNegativeTestJSON-1400922376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:19:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-3caeb675-2ebc-46a6-94b0-508227b52863 tempest-VolumeQuotasNegativeTestJSON-1400922376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:19:40 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-3caeb675-2ebc-46a6-94b0-508227b52863 tempest-VolumeQuotasNegativeTestJSON-1400922376 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:19:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2062929022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be592232-d759-4896-9280-a707d626149e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dbc7c9f3e8f4648a33148ea0a76a8d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:19:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:19:41Z,use_quota=True,user_id='0d3a5db24a0348178861be499c6cbfbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:19:40 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-3caeb675-2ebc-46a6-94b0-508227b52863 tempest-VolumeQuotasNegativeTestJSON-1400922376 None] Creating volume be592232-d759-4896-9280-a707d626149e {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:19:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-3caeb675-2ebc-46a6-94b0-508227b52863 tempest-VolumeQuotasNegativeTestJSON-1400922376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:19:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-3caeb675-2ebc-46a6-94b0-508227b52863 tempest-VolumeQuotasNegativeTestJSON-1400922376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:19:40 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-3caeb675-2ebc-46a6-94b0-508227b52863 tempest-VolumeQuotasNegativeTestJSON-1400922376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:19:40 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-3caeb675-2ebc-46a6-94b0-508227b52863 tempest-VolumeQuotasNegativeTestJSON-1400922376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:19:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-3caeb675-2ebc-46a6-94b0-508227b52863 tempest-VolumeQuotasNegativeTestJSON-1400922376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:19:40 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-3caeb675-2ebc-46a6-94b0-508227b52863 tempest-VolumeQuotasNegativeTestJSON-1400922376 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:19:40 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-3caeb675-2ebc-46a6-94b0-508227b52863 tempest-VolumeQuotasNegativeTestJSON-1400922376 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:19:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3caeb675-2ebc-46a6-94b0-508227b52863 tempest-VolumeQuotasNegativeTestJSON-1400922376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-be592232-d759-4896-9280-a707d626149e 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:19:40 devstack sudo[102699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-be592232-d759-4896-9280-a707d626149e 1073741824 Jul 10 10:19:40 devstack sudo[102699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:19:41 devstack sudo[102699]: pam_unix(sudo:session): session closed for user root Jul 10 10:19:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3caeb675-2ebc-46a6-94b0-508227b52863 tempest-VolumeQuotasNegativeTestJSON-1400922376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-be592232-d759-4896-9280-a707d626149e 1073741824" returned: 0 in 0.895s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:19:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3caeb675-2ebc-46a6-94b0-508227b52863 tempest-VolumeQuotasNegativeTestJSON-1400922376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-be592232-d759-4896-9280-a707d626149e {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:19:41 devstack sudo[102705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-be592232-d759-4896-9280-a707d626149e Jul 10 10:19:41 devstack sudo[102705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:19:42 devstack cinder-volume[87234]: DEBUG oslo_service.periodic_task [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 10:19:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:19:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:19:42 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:19:42 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:19:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:19:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:19:42 devstack sudo[102707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:19:42 devstack sudo[102707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:19:42 devstack sudo[102705]: pam_unix(sudo:session): session closed for user root Jul 10 10:19:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3caeb675-2ebc-46a6-94b0-508227b52863 tempest-VolumeQuotasNegativeTestJSON-1400922376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-be592232-d759-4896-9280-a707d626149e" returned: 0 in 0.687s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:19:42 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-3caeb675-2ebc-46a6-94b0-508227b52863 tempest-VolumeQuotasNegativeTestJSON-1400922376 None] <== create_volume: return (1623ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:19:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-3caeb675-2ebc-46a6-94b0-508227b52863 tempest-VolumeQuotasNegativeTestJSON-1400922376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.628s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:19:42 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3caeb675-2ebc-46a6-94b0-508227b52863 tempest-VolumeQuotasNegativeTestJSON-1400922376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2a8d8e5-4c63-4ef8-938c-bc3dcc86bab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be592232-d759-4896-9280-a707d626149e', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:19:42 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3caeb675-2ebc-46a6-94b0-508227b52863 tempest-VolumeQuotasNegativeTestJSON-1400922376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16e6df82-5bbb-453b-b849-d07ac2683a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:19:42 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-3caeb675-2ebc-46a6-94b0-508227b52863 tempest-VolumeQuotasNegativeTestJSON-1400922376 None] Volume volume-be592232-d759-4896-9280-a707d626149e (be592232-d759-4896-9280-a707d626149e): created successfully Jul 10 10:19:42 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3caeb675-2ebc-46a6-94b0-508227b52863 tempest-VolumeQuotasNegativeTestJSON-1400922376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16e6df82-5bbb-453b-b849-d07ac2683a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:19:42 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3caeb675-2ebc-46a6-94b0-508227b52863 tempest-VolumeQuotasNegativeTestJSON-1400922376 None] Flow 'volume_create_manager' (ddeaa785-f2be-4160-81ef-694fa5c6dac1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:19:42 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-3caeb675-2ebc-46a6-94b0-508227b52863 tempest-VolumeQuotasNegativeTestJSON-1400922376 None] Created volume successfully. Jul 10 10:19:42 devstack sudo[102707]: pam_unix(sudo:session): session closed for user root Jul 10 10:19:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.749s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:19:42 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:19:42 devstack cinder-volume[87234]: DEBUG oslo_service.periodic_task [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Running periodic task VolumeManager._thread_info {{(pid=87234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 10:19:42 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] thread count: 28 {{(pid=87234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 10:19:42 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] thread info: [<_MainThread(MainThread, started 131600773742720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 10:19:43 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-5b8020fd-cef2-4784-a1e1-de7f36304461 tempest-VolumeQuotasNegativeTestJSON-1400922376 None] Acquiring lock "cinder-be592232-d759-4896-9280-a707d626149e-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:19:43 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-5b8020fd-cef2-4784-a1e1-de7f36304461 tempest-VolumeQuotasNegativeTestJSON-1400922376 None] Lock "cinder-be592232-d759-4896-9280-a707d626149e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:19:43 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-5b8020fd-cef2-4784-a1e1-de7f36304461 tempest-VolumeQuotasNegativeTestJSON-1400922376 None] Acquiring lock "cinder-quobyte-be592232-d759-4896-9280-a707d626149e" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:19:43 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-5b8020fd-cef2-4784-a1e1-de7f36304461 tempest-VolumeQuotasNegativeTestJSON-1400922376 None] Lock "cinder-quobyte-be592232-d759-4896-9280-a707d626149e" acquired by "delete_volume" :: waited 0.017s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:19:43 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[22592c20-7d2a-4c8f-8880-b03f57104b6b]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:19:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5b8020fd-cef2-4784-a1e1-de7f36304461 tempest-VolumeQuotasNegativeTestJSON-1400922376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-be592232-d759-4896-9280-a707d626149e {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:19:43 devstack sudo[102711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-be592232-d759-4896-9280-a707d626149e Jul 10 10:19:43 devstack sudo[102711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:19:44 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-be0f9111-2c0e-49f6-9cfa-5c381ac21200 tempest-TestStampPattern-1267302871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:19:44 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-be0f9111-2c0e-49f6-9cfa-5c381ac21200 tempest-TestStampPattern-1267302871 None] Flow 'volume_create_manager' (24d0daf0-1cef-4c7b-943b-18ff5f9c751d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:19:44 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-be0f9111-2c0e-49f6-9cfa-5c381ac21200 tempest-TestStampPattern-1267302871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d7e83da-9396-4cce-9e68-051f4d68d0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:19:44 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-be0f9111-2c0e-49f6-9cfa-5c381ac21200 tempest-TestStampPattern-1267302871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d7e83da-9396-4cce-9e68-051f4d68d0de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:19:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1975217622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1d516d7-1c9f-4c09-8210-72e69151ad5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1290cc3c2e944a8580c50da797829c5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:19:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8cd1bd27-cb2e-4e13-be59-884b8826ca0c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:19:44Z,use_quota=True,user_id='349c37595e5e49868d55fdceb305b0ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:19:44 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-be0f9111-2c0e-49f6-9cfa-5c381ac21200 tempest-TestStampPattern-1267302871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e516ac9-ebaf-47fb-97f1-0df1b0ec5d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:19:44 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-be0f9111-2c0e-49f6-9cfa-5c381ac21200 tempest-TestStampPattern-1267302871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e516ac9-ebaf-47fb-97f1-0df1b0ec5d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:19:44 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-be0f9111-2c0e-49f6-9cfa-5c381ac21200 tempest-TestStampPattern-1267302871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbb1cf38-e6af-4430-a233-18b82553f8dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:19:44 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-be0f9111-2c0e-49f6-9cfa-5c381ac21200 tempest-TestStampPattern-1267302871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbb1cf38-e6af-4430-a233-18b82553f8dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f1d516d7-1c9f-4c09-8210-72e69151ad5b', 'volume_name': 'volume-f1d516d7-1c9f-4c09-8210-72e69151ad5b', 'volume_size': 1, 'snapshot_id': '8cd1bd27-cb2e-4e13-be59-884b8826ca0c'}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:19:44 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-be0f9111-2c0e-49f6-9cfa-5c381ac21200 tempest-TestStampPattern-1267302871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c13ceb26-ee35-4eb9-b60a-c14310615753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:19:44 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-be0f9111-2c0e-49f6-9cfa-5c381ac21200 tempest-TestStampPattern-1267302871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c13ceb26-ee35-4eb9-b60a-c14310615753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:19:44 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-be0f9111-2c0e-49f6-9cfa-5c381ac21200 tempest-TestStampPattern-1267302871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4be07b5-1b1d-4c35-8d62-bcb7394e9f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:19:44 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-be0f9111-2c0e-49f6-9cfa-5c381ac21200 tempest-TestStampPattern-1267302871 None] Volume f1d516d7-1c9f-4c09-8210-72e69151ad5b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f1d516d7-1c9f-4c09-8210-72e69151ad5b', 'volume_size': 1, 'snapshot_id': '8cd1bd27-cb2e-4e13-be59-884b8826ca0c'} Jul 10 10:19:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-be0f9111-2c0e-49f6-9cfa-5c381ac21200 tempest-TestStampPattern-1267302871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:19:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-be0f9111-2c0e-49f6-9cfa-5c381ac21200 tempest-TestStampPattern-1267302871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:19:44 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-be0f9111-2c0e-49f6-9cfa-5c381ac21200 tempest-TestStampPattern-1267302871 None] Acquiring lock "cinder-quobyte-8cd1bd27-cb2e-4e13-be59-884b8826ca0c-f1d516d7-1c9f-4c09-8210-72e69151ad5b" by "_create_volume_from_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:19:44 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-be0f9111-2c0e-49f6-9cfa-5c381ac21200 tempest-TestStampPattern-1267302871 None] Lock "cinder-quobyte-8cd1bd27-cb2e-4e13-be59-884b8826ca0c-f1d516d7-1c9f-4c09-8210-72e69151ad5b" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:19:44 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-be0f9111-2c0e-49f6-9cfa-5c381ac21200 tempest-TestStampPattern-1267302871 None] Creating volume f1d516d7-1c9f-4c09-8210-72e69151ad5b from snapshot 8cd1bd27-cb2e-4e13-be59-884b8826ca0c {{(pid=87234) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 10:19:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-be0f9111-2c0e-49f6-9cfa-5c381ac21200 tempest-TestStampPattern-1267302871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:19:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-be0f9111-2c0e-49f6-9cfa-5c381ac21200 tempest-TestStampPattern-1267302871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:19:44 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-be0f9111-2c0e-49f6-9cfa-5c381ac21200 tempest-TestStampPattern-1267302871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:19:44 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-be0f9111-2c0e-49f6-9cfa-5c381ac21200 tempest-TestStampPattern-1267302871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:19:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-be0f9111-2c0e-49f6-9cfa-5c381ac21200 tempest-TestStampPattern-1267302871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:19:44 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-be0f9111-2c0e-49f6-9cfa-5c381ac21200 tempest-TestStampPattern-1267302871 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:19:44 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-be0f9111-2c0e-49f6-9cfa-5c381ac21200 tempest-TestStampPattern-1267302871 None] Acquiring lock "cinder-quobyte-f1d516d7-1c9f-4c09-8210-72e69151ad5b" by "_copy_volume_from_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:19:44 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-be0f9111-2c0e-49f6-9cfa-5c381ac21200 tempest-TestStampPattern-1267302871 None] Lock "cinder-quobyte-f1d516d7-1c9f-4c09-8210-72e69151ad5b" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:19:44 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-be0f9111-2c0e-49f6-9cfa-5c381ac21200 tempest-TestStampPattern-1267302871 None] snapshot: 8cd1bd27-cb2e-4e13-be59-884b8826ca0c, volume: f1d516d7-1c9f-4c09-8210-72e69151ad5b, {{(pid=87234) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 10:19:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-be0f9111-2c0e-49f6-9cfa-5c381ac21200 tempest-TestStampPattern-1267302871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:19:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-be0f9111-2c0e-49f6-9cfa-5c381ac21200 tempest-TestStampPattern-1267302871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:19:44 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-be0f9111-2c0e-49f6-9cfa-5c381ac21200 tempest-TestStampPattern-1267302871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:19:44 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-be0f9111-2c0e-49f6-9cfa-5c381ac21200 tempest-TestStampPattern-1267302871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:19:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-be0f9111-2c0e-49f6-9cfa-5c381ac21200 tempest-TestStampPattern-1267302871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:19:44 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8b2921-038f-465b-9453-72417685b170]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:19:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-be0f9111-2c0e-49f6-9cfa-5c381ac21200 tempest-TestStampPattern-1267302871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7f87bb0f-5ab5-4897-939c-fa8c133c13e3.8cd1bd27-cb2e-4e13-be59-884b8826ca0c {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:19:44 devstack sudo[102713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7f87bb0f-5ab5-4897-939c-fa8c133c13e3.8cd1bd27-cb2e-4e13-be59-884b8826ca0c Jul 10 10:19:44 devstack sudo[102713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:19:44 devstack sudo[102711]: pam_unix(sudo:session): session closed for user root Jul 10 10:19:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5b8020fd-cef2-4784-a1e1-de7f36304461 tempest-VolumeQuotasNegativeTestJSON-1400922376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-be592232-d759-4896-9280-a707d626149e" returned: 0 in 0.875s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:19:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5b8020fd-cef2-4784-a1e1-de7f36304461 tempest-VolumeQuotasNegativeTestJSON-1400922376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-be592232-d759-4896-9280-a707d626149e {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:19:44 devstack sudo[102718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-be592232-d759-4896-9280-a707d626149e Jul 10 10:19:44 devstack sudo[102718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:19:45 devstack sudo[102713]: pam_unix(sudo:session): session closed for user root Jul 10 10:19:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-be0f9111-2c0e-49f6-9cfa-5c381ac21200 tempest-TestStampPattern-1267302871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7f87bb0f-5ab5-4897-939c-fa8c133c13e3.8cd1bd27-cb2e-4e13-be59-884b8826ca0c" returned: 0 in 0.923s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:19:45 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-be0f9111-2c0e-49f6-9cfa-5c381ac21200 tempest-TestStampPattern-1267302871 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f87bb0f-5ab5-4897-939c-fa8c133c13e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 10:19:45 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-be0f9111-2c0e-49f6-9cfa-5c381ac21200 tempest-TestStampPattern-1267302871 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7f87bb0f-5ab5-4897-939c-fa8c133c13e3 {{(pid=87234) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 10:19:45 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-be0f9111-2c0e-49f6-9cfa-5c381ac21200 tempest-TestStampPattern-1267302871 None] Creating direct copy from snapshot {{(pid=87234) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 10:19:45 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[2439cf4f-103d-4ae9-a277-a3cdfc1c1d25]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:19:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-be0f9111-2c0e-49f6-9cfa-5c381ac21200 tempest-TestStampPattern-1267302871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7f87bb0f-5ab5-4897-939c-fa8c133c13e3 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:19:45 devstack sudo[102718]: pam_unix(sudo:session): session closed for user root Jul 10 10:19:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5b8020fd-cef2-4784-a1e1-de7f36304461 tempest-VolumeQuotasNegativeTestJSON-1400922376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-be592232-d759-4896-9280-a707d626149e" returned: 0 in 0.744s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:19:45 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-5b8020fd-cef2-4784-a1e1-de7f36304461 tempest-VolumeQuotasNegativeTestJSON-1400922376 None] Lock "cinder-quobyte-be592232-d759-4896-9280-a707d626149e" released by "delete_volume" :: held 1.662s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:19:45 devstack sudo[102727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7f87bb0f-5ab5-4897-939c-fa8c133c13e3 Jul 10 10:19:45 devstack sudo[102727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:19:45 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-5b8020fd-cef2-4784-a1e1-de7f36304461 tempest-VolumeQuotasNegativeTestJSON-1400922376 None] Created reservations ['5cdb3ef0-e9ca-44c8-9da0-f1b1ff1592f0', '88b24068-e5e7-42cd-984d-3427b7c26d2b', '2bad2343-0723-4136-94db-b425cd981a81', 'e01d2513-e878-4ec9-82a1-ad74816ee5a6'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:19:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-5b8020fd-cef2-4784-a1e1-de7f36304461 tempest-VolumeQuotasNegativeTestJSON-1400922376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:19:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-5b8020fd-cef2-4784-a1e1-de7f36304461 tempest-VolumeQuotasNegativeTestJSON-1400922376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:19:45 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-5b8020fd-cef2-4784-a1e1-de7f36304461 tempest-VolumeQuotasNegativeTestJSON-1400922376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:19:45 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-5b8020fd-cef2-4784-a1e1-de7f36304461 tempest-VolumeQuotasNegativeTestJSON-1400922376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:19:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-5b8020fd-cef2-4784-a1e1-de7f36304461 tempest-VolumeQuotasNegativeTestJSON-1400922376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:19:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5b8020fd-cef2-4784-a1e1-de7f36304461 tempest-VolumeQuotasNegativeTestJSON-1400922376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:19:45 devstack sudo[102729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:19:45 devstack sudo[102729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:19:46 devstack sudo[102727]: pam_unix(sudo:session): session closed for user root Jul 10 10:19:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-be0f9111-2c0e-49f6-9cfa-5c381ac21200 tempest-TestStampPattern-1267302871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7f87bb0f-5ab5-4897-939c-fa8c133c13e3" returned: 0 in 0.847s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:19:46 devstack cinder-volume[87234]: DEBUG cinder.utils [None req-be0f9111-2c0e-49f6-9cfa-5c381ac21200 tempest-TestStampPattern-1267302871 None] Path /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f1d516d7-1c9f-4c09-8210-72e69151ad5b not found in is_blk_device check {{(pid=87234) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 10:19:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-be0f9111-2c0e-49f6-9cfa-5c381ac21200 tempest-TestStampPattern-1267302871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7f87bb0f-5ab5-4897-939c-fa8c133c13e3 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f1d516d7-1c9f-4c09-8210-72e69151ad5b {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:19:46 devstack sudo[102735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7f87bb0f-5ab5-4897-939c-fa8c133c13e3 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f1d516d7-1c9f-4c09-8210-72e69151ad5b Jul 10 10:19:46 devstack sudo[102735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:19:46 devstack sudo[102729]: pam_unix(sudo:session): session closed for user root Jul 10 10:19:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5b8020fd-cef2-4784-a1e1-de7f36304461 tempest-VolumeQuotasNegativeTestJSON-1400922376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.707s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:19:46 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-5b8020fd-cef2-4784-a1e1-de7f36304461 tempest-VolumeQuotasNegativeTestJSON-1400922376 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:19:46 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-5b8020fd-cef2-4784-a1e1-de7f36304461 tempest-VolumeQuotasNegativeTestJSON-1400922376 None] Deleted volume successfully. Jul 10 10:19:46 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-5b8020fd-cef2-4784-a1e1-de7f36304461 tempest-VolumeQuotasNegativeTestJSON-1400922376 None] Lock "cinder-be592232-d759-4896-9280-a707d626149e-delete_volume" released by "delete_volume" :: held 2.631s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:19:52 devstack sudo[102735]: pam_unix(sudo:session): session closed for user root Jul 10 10:19:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-be0f9111-2c0e-49f6-9cfa-5c381ac21200 tempest-TestStampPattern-1267302871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7f87bb0f-5ab5-4897-939c-fa8c133c13e3 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f1d516d7-1c9f-4c09-8210-72e69151ad5b" returned: 0 in 6.273s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:19:52 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2232f46-5de1-482f-a8f4-c18d665fcbef]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:19:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-be0f9111-2c0e-49f6-9cfa-5c381ac21200 tempest-TestStampPattern-1267302871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7f87bb0f-5ab5-4897-939c-fa8c133c13e3 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:19:52 devstack sudo[102748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7f87bb0f-5ab5-4897-939c-fa8c133c13e3 Jul 10 10:19:52 devstack sudo[102748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:19:54 devstack sudo[102748]: pam_unix(sudo:session): session closed for user root Jul 10 10:19:54 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-be0f9111-2c0e-49f6-9cfa-5c381ac21200 tempest-TestStampPattern-1267302871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7f87bb0f-5ab5-4897-939c-fa8c133c13e3" returned: 0 in 1.539s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:19:54 devstack cinder-volume[87234]: DEBUG cinder.image.image_utils [None req-be0f9111-2c0e-49f6-9cfa-5c381ac21200 tempest-TestStampPattern-1267302871 None] Image conversion details: src /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7f87bb0f-5ab5-4897-939c-fa8c133c13e3, size 1024.00 MB, duration 6.27 sec, destination /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f1d516d7-1c9f-4c09-8210-72e69151ad5b {{(pid=87234) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 10:19:54 devstack cinder-volume[87234]: INFO cinder.image.image_utils [None req-be0f9111-2c0e-49f6-9cfa-5c381ac21200 tempest-TestStampPattern-1267302871 None] Converted 1024.00 MB image at 163.19 MB/s Jul 10 10:19:54 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-be0f9111-2c0e-49f6-9cfa-5c381ac21200 tempest-TestStampPattern-1267302871 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f1d516d7-1c9f-4c09-8210-72e69151ad5b is being set with open permissions: ugo+rw Jul 10 10:19:54 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-be0f9111-2c0e-49f6-9cfa-5c381ac21200 tempest-TestStampPattern-1267302871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f1d516d7-1c9f-4c09-8210-72e69151ad5b {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:19:54 devstack sudo[102755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f1d516d7-1c9f-4c09-8210-72e69151ad5b Jul 10 10:19:54 devstack sudo[102755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:19:54 devstack sudo[102755]: pam_unix(sudo:session): session closed for user root Jul 10 10:19:54 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-be0f9111-2c0e-49f6-9cfa-5c381ac21200 tempest-TestStampPattern-1267302871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f1d516d7-1c9f-4c09-8210-72e69151ad5b" returned: 0 in 0.829s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:19:54 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-be0f9111-2c0e-49f6-9cfa-5c381ac21200 tempest-TestStampPattern-1267302871 None] Lock "cinder-quobyte-f1d516d7-1c9f-4c09-8210-72e69151ad5b" released by "_copy_volume_from_snapshot" :: held 10.562s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:19:54 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-be0f9111-2c0e-49f6-9cfa-5c381ac21200 tempest-TestStampPattern-1267302871 None] Lock "cinder-quobyte-8cd1bd27-cb2e-4e13-be59-884b8826ca0c-f1d516d7-1c9f-4c09-8210-72e69151ad5b" released by "_create_volume_from_snapshot" :: held 10.606s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:19:54 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-be0f9111-2c0e-49f6-9cfa-5c381ac21200 tempest-TestStampPattern-1267302871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.623s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:19:55 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-be0f9111-2c0e-49f6-9cfa-5c381ac21200 tempest-TestStampPattern-1267302871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4be07b5-1b1d-4c35-8d62-bcb7394e9f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1d516d7-1c9f-4c09-8210-72e69151ad5b', 'volume_size': 1, 'snapshot_id': '8cd1bd27-cb2e-4e13-be59-884b8826ca0c'}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:19:55 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-be0f9111-2c0e-49f6-9cfa-5c381ac21200 tempest-TestStampPattern-1267302871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13b872c5-b5e5-4ef0-a015-f6de4cb380b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:19:55 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-062e10de-cc71-4ed6-9e18-f5e20f8a205c tempest-VolumesServicesTestJSON-1387106988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:19:55 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-062e10de-cc71-4ed6-9e18-f5e20f8a205c tempest-VolumesServicesTestJSON-1387106988 None] Flow 'volume_create_manager' (c3be1538-a9a6-4c75-a873-e56243ba9229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:19:55 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-062e10de-cc71-4ed6-9e18-f5e20f8a205c tempest-VolumesServicesTestJSON-1387106988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cd1a0a2-c2cb-444d-a620-7b11275b8f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:19:55 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-be0f9111-2c0e-49f6-9cfa-5c381ac21200 tempest-TestStampPattern-1267302871 None] Volume volume-f1d516d7-1c9f-4c09-8210-72e69151ad5b (f1d516d7-1c9f-4c09-8210-72e69151ad5b): created successfully Jul 10 10:19:55 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-be0f9111-2c0e-49f6-9cfa-5c381ac21200 tempest-TestStampPattern-1267302871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13b872c5-b5e5-4ef0-a015-f6de4cb380b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:19:55 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-be0f9111-2c0e-49f6-9cfa-5c381ac21200 tempest-TestStampPattern-1267302871 None] Flow 'volume_create_manager' (24d0daf0-1cef-4c7b-943b-18ff5f9c751d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:19:55 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-062e10de-cc71-4ed6-9e18-f5e20f8a205c tempest-VolumesServicesTestJSON-1387106988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cd1a0a2-c2cb-444d-a620-7b11275b8f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:19:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2133804824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2c2b9ae-b311-443a-a8ba-31d4a4654955,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cf44939409b4d9eb297ef885ee6c48d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:19:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:19:55Z,use_quota=True,user_id='0d508676dcfb4d4cb14b820f20bc9311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:19:55 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-062e10de-cc71-4ed6-9e18-f5e20f8a205c tempest-VolumesServicesTestJSON-1387106988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06de75bb-fc75-4aae-9612-af1b1afbbec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:19:55 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-062e10de-cc71-4ed6-9e18-f5e20f8a205c tempest-VolumesServicesTestJSON-1387106988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06de75bb-fc75-4aae-9612-af1b1afbbec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:19:55 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-062e10de-cc71-4ed6-9e18-f5e20f8a205c tempest-VolumesServicesTestJSON-1387106988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0d92103-eddd-4e80-b922-faa285250b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:19:55 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-062e10de-cc71-4ed6-9e18-f5e20f8a205c tempest-VolumesServicesTestJSON-1387106988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0d92103-eddd-4e80-b922-faa285250b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2c2b9ae-b311-443a-a8ba-31d4a4654955', 'volume_name': 'volume-f2c2b9ae-b311-443a-a8ba-31d4a4654955', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:19:55 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-062e10de-cc71-4ed6-9e18-f5e20f8a205c tempest-VolumesServicesTestJSON-1387106988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31a09599-fee2-4433-9e81-71e9cd5db3c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:19:55 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-062e10de-cc71-4ed6-9e18-f5e20f8a205c tempest-VolumesServicesTestJSON-1387106988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31a09599-fee2-4433-9e81-71e9cd5db3c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:19:55 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-062e10de-cc71-4ed6-9e18-f5e20f8a205c tempest-VolumesServicesTestJSON-1387106988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5604b98f-ba76-4d67-a52a-14f2de1f1cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:19:55 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-062e10de-cc71-4ed6-9e18-f5e20f8a205c tempest-VolumesServicesTestJSON-1387106988 None] Volume f2c2b9ae-b311-443a-a8ba-31d4a4654955: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2c2b9ae-b311-443a-a8ba-31d4a4654955', 'volume_size': 1} Jul 10 10:19:55 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-062e10de-cc71-4ed6-9e18-f5e20f8a205c tempest-VolumesServicesTestJSON-1387106988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:19:55 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-062e10de-cc71-4ed6-9e18-f5e20f8a205c tempest-VolumesServicesTestJSON-1387106988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:19:55 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-062e10de-cc71-4ed6-9e18-f5e20f8a205c tempest-VolumesServicesTestJSON-1387106988 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:19:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2133804824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2c2b9ae-b311-443a-a8ba-31d4a4654955,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cf44939409b4d9eb297ef885ee6c48d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:19:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:19:55Z,use_quota=True,user_id='0d508676dcfb4d4cb14b820f20bc9311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:19:55 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-062e10de-cc71-4ed6-9e18-f5e20f8a205c tempest-VolumesServicesTestJSON-1387106988 None] Creating volume f2c2b9ae-b311-443a-a8ba-31d4a4654955 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:19:55 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-062e10de-cc71-4ed6-9e18-f5e20f8a205c tempest-VolumesServicesTestJSON-1387106988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:19:55 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-062e10de-cc71-4ed6-9e18-f5e20f8a205c tempest-VolumesServicesTestJSON-1387106988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:19:55 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-062e10de-cc71-4ed6-9e18-f5e20f8a205c tempest-VolumesServicesTestJSON-1387106988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:19:55 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-062e10de-cc71-4ed6-9e18-f5e20f8a205c tempest-VolumesServicesTestJSON-1387106988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:19:55 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-062e10de-cc71-4ed6-9e18-f5e20f8a205c tempest-VolumesServicesTestJSON-1387106988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:19:55 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-062e10de-cc71-4ed6-9e18-f5e20f8a205c tempest-VolumesServicesTestJSON-1387106988 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:19:55 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-062e10de-cc71-4ed6-9e18-f5e20f8a205c tempest-VolumesServicesTestJSON-1387106988 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:19:55 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-062e10de-cc71-4ed6-9e18-f5e20f8a205c tempest-VolumesServicesTestJSON-1387106988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f2c2b9ae-b311-443a-a8ba-31d4a4654955 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:19:55 devstack sudo[102778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f2c2b9ae-b311-443a-a8ba-31d4a4654955 1073741824 Jul 10 10:19:55 devstack sudo[102778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:19:55 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-be0f9111-2c0e-49f6-9cfa-5c381ac21200 tempest-TestStampPattern-1267302871 None] Created volume successfully. Jul 10 10:19:56 devstack sudo[102778]: pam_unix(sudo:session): session closed for user root Jul 10 10:19:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-062e10de-cc71-4ed6-9e18-f5e20f8a205c tempest-VolumesServicesTestJSON-1387106988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f2c2b9ae-b311-443a-a8ba-31d4a4654955 1073741824" returned: 0 in 0.895s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:19:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-062e10de-cc71-4ed6-9e18-f5e20f8a205c tempest-VolumesServicesTestJSON-1387106988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f2c2b9ae-b311-443a-a8ba-31d4a4654955 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:19:56 devstack sudo[102790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f2c2b9ae-b311-443a-a8ba-31d4a4654955 Jul 10 10:19:56 devstack sudo[102790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:19:56 devstack sudo[102790]: pam_unix(sudo:session): session closed for user root Jul 10 10:19:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-062e10de-cc71-4ed6-9e18-f5e20f8a205c tempest-VolumesServicesTestJSON-1387106988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f2c2b9ae-b311-443a-a8ba-31d4a4654955" returned: 0 in 0.680s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:19:56 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-062e10de-cc71-4ed6-9e18-f5e20f8a205c tempest-VolumesServicesTestJSON-1387106988 None] <== create_volume: return (1624ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:19:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-062e10de-cc71-4ed6-9e18-f5e20f8a205c tempest-VolumesServicesTestJSON-1387106988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.626s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:19:56 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-062e10de-cc71-4ed6-9e18-f5e20f8a205c tempest-VolumesServicesTestJSON-1387106988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5604b98f-ba76-4d67-a52a-14f2de1f1cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2c2b9ae-b311-443a-a8ba-31d4a4654955', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:19:56 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-062e10de-cc71-4ed6-9e18-f5e20f8a205c tempest-VolumesServicesTestJSON-1387106988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c73dfb0-87dd-4c9e-8ef5-12acffdba829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:19:56 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-062e10de-cc71-4ed6-9e18-f5e20f8a205c tempest-VolumesServicesTestJSON-1387106988 None] Volume volume-f2c2b9ae-b311-443a-a8ba-31d4a4654955 (f2c2b9ae-b311-443a-a8ba-31d4a4654955): created successfully Jul 10 10:19:56 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-062e10de-cc71-4ed6-9e18-f5e20f8a205c tempest-VolumesServicesTestJSON-1387106988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c73dfb0-87dd-4c9e-8ef5-12acffdba829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:19:56 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-062e10de-cc71-4ed6-9e18-f5e20f8a205c tempest-VolumesServicesTestJSON-1387106988 None] Flow 'volume_create_manager' (c3be1538-a9a6-4c75-a873-e56243ba9229) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:19:56 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-062e10de-cc71-4ed6-9e18-f5e20f8a205c tempest-VolumesServicesTestJSON-1387106988 None] Created volume successfully. Jul 10 10:19:57 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-167c420c-1de2-4dcf-87a7-8ba8d343b911 tempest-VolumesServicesTestJSON-1387106988 None] Acquiring lock "cinder-f2c2b9ae-b311-443a-a8ba-31d4a4654955-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:19:57 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-167c420c-1de2-4dcf-87a7-8ba8d343b911 tempest-VolumesServicesTestJSON-1387106988 None] Lock "cinder-f2c2b9ae-b311-443a-a8ba-31d4a4654955-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:19:57 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-167c420c-1de2-4dcf-87a7-8ba8d343b911 tempest-VolumesServicesTestJSON-1387106988 None] Acquiring lock "cinder-quobyte-f2c2b9ae-b311-443a-a8ba-31d4a4654955" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:19:57 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-167c420c-1de2-4dcf-87a7-8ba8d343b911 tempest-VolumesServicesTestJSON-1387106988 None] Lock "cinder-quobyte-f2c2b9ae-b311-443a-a8ba-31d4a4654955" acquired by "delete_volume" :: waited 0.016s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:19:57 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1522f94-526e-4fc4-98f4-65de347920dd]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:19:57 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-167c420c-1de2-4dcf-87a7-8ba8d343b911 tempest-VolumesServicesTestJSON-1387106988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f2c2b9ae-b311-443a-a8ba-31d4a4654955 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:19:57 devstack sudo[102794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f2c2b9ae-b311-443a-a8ba-31d4a4654955 Jul 10 10:19:57 devstack sudo[102794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:19:58 devstack sudo[102794]: pam_unix(sudo:session): session closed for user root Jul 10 10:19:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-167c420c-1de2-4dcf-87a7-8ba8d343b911 tempest-VolumesServicesTestJSON-1387106988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f2c2b9ae-b311-443a-a8ba-31d4a4654955" returned: 0 in 1.018s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:19:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-167c420c-1de2-4dcf-87a7-8ba8d343b911 tempest-VolumesServicesTestJSON-1387106988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f2c2b9ae-b311-443a-a8ba-31d4a4654955 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:19:58 devstack sudo[102822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f2c2b9ae-b311-443a-a8ba-31d4a4654955 Jul 10 10:19:58 devstack sudo[102822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:19:58 devstack sudo[102822]: pam_unix(sudo:session): session closed for user root Jul 10 10:19:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-167c420c-1de2-4dcf-87a7-8ba8d343b911 tempest-VolumesServicesTestJSON-1387106988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f2c2b9ae-b311-443a-a8ba-31d4a4654955" returned: 0 in 0.662s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:19:59 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-167c420c-1de2-4dcf-87a7-8ba8d343b911 tempest-VolumesServicesTestJSON-1387106988 None] Lock "cinder-quobyte-f2c2b9ae-b311-443a-a8ba-31d4a4654955" released by "delete_volume" :: held 1.730s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:19:59 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-167c420c-1de2-4dcf-87a7-8ba8d343b911 tempest-VolumesServicesTestJSON-1387106988 None] Created reservations ['5a19abd7-2557-42f8-a09a-99eeab6466ff', 'c5ca6080-ccb9-492c-b19e-b8b0d7cd908f', 'dde43683-e15f-4936-8654-71795626e29b', '97a12ec4-72e3-4a26-93a1-48dc7979247b'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:19:59 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-167c420c-1de2-4dcf-87a7-8ba8d343b911 tempest-VolumesServicesTestJSON-1387106988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:19:59 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-167c420c-1de2-4dcf-87a7-8ba8d343b911 tempest-VolumesServicesTestJSON-1387106988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:19:59 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-167c420c-1de2-4dcf-87a7-8ba8d343b911 tempest-VolumesServicesTestJSON-1387106988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:19:59 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-167c420c-1de2-4dcf-87a7-8ba8d343b911 tempest-VolumesServicesTestJSON-1387106988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:19:59 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-167c420c-1de2-4dcf-87a7-8ba8d343b911 tempest-VolumesServicesTestJSON-1387106988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:19:59 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-167c420c-1de2-4dcf-87a7-8ba8d343b911 tempest-VolumesServicesTestJSON-1387106988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:19:59 devstack sudo[102831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:19:59 devstack sudo[102831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:19:59 devstack sudo[102831]: pam_unix(sudo:session): session closed for user root Jul 10 10:19:59 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-167c420c-1de2-4dcf-87a7-8ba8d343b911 tempest-VolumesServicesTestJSON-1387106988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.759s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:19:59 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-167c420c-1de2-4dcf-87a7-8ba8d343b911 tempest-VolumesServicesTestJSON-1387106988 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:19:59 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-167c420c-1de2-4dcf-87a7-8ba8d343b911 tempest-VolumesServicesTestJSON-1387106988 None] Deleted volume successfully. Jul 10 10:19:59 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-167c420c-1de2-4dcf-87a7-8ba8d343b911 tempest-VolumesServicesTestJSON-1387106988 None] Lock "cinder-f2c2b9ae-b311-443a-a8ba-31d4a4654955-delete_volume" released by "delete_volume" :: held 2.721s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:20:05 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ab42d1e-9467-46f2-92dd-c56a1b80e065 tempest-VolumesListAdminTestJSON-63071180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:20:05 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8ab42d1e-9467-46f2-92dd-c56a1b80e065 tempest-VolumesListAdminTestJSON-63071180 None] Flow 'volume_create_manager' (d34db607-8d7b-4c23-a379-535ede22306c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:20:05 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8ab42d1e-9467-46f2-92dd-c56a1b80e065 tempest-VolumesListAdminTestJSON-63071180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4756e2c-4703-439a-b4b7-93527b07f709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:20:05 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8ab42d1e-9467-46f2-92dd-c56a1b80e065 tempest-VolumesListAdminTestJSON-63071180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4756e2c-4703-439a-b4b7-93527b07f709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:20:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-685452123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd907b79-da33-4b47-8683-dd4bcdb1718f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d91f74a8e7c34598ac1eb3ce5ce7a473',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:20:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:20:05Z,use_quota=True,user_id='085b44c97fd9424ea789cbe725a435ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:20:05 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8ab42d1e-9467-46f2-92dd-c56a1b80e065 tempest-VolumesListAdminTestJSON-63071180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95d91b4c-a914-41c6-9d22-f8d9b7055440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:20:05 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8ab42d1e-9467-46f2-92dd-c56a1b80e065 tempest-VolumesListAdminTestJSON-63071180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95d91b4c-a914-41c6-9d22-f8d9b7055440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:20:05 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8ab42d1e-9467-46f2-92dd-c56a1b80e065 tempest-VolumesListAdminTestJSON-63071180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (846cd911-0914-4f22-ba9b-07ac6390d1b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:20:05 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8ab42d1e-9467-46f2-92dd-c56a1b80e065 tempest-VolumesListAdminTestJSON-63071180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (846cd911-0914-4f22-ba9b-07ac6390d1b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd907b79-da33-4b47-8683-dd4bcdb1718f', 'volume_name': 'volume-bd907b79-da33-4b47-8683-dd4bcdb1718f', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:20:05 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8ab42d1e-9467-46f2-92dd-c56a1b80e065 tempest-VolumesListAdminTestJSON-63071180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (291d76e2-bc14-4d46-baf6-5fef50019a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:20:05 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8ab42d1e-9467-46f2-92dd-c56a1b80e065 tempest-VolumesListAdminTestJSON-63071180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (291d76e2-bc14-4d46-baf6-5fef50019a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:20:05 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8ab42d1e-9467-46f2-92dd-c56a1b80e065 tempest-VolumesListAdminTestJSON-63071180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c29eda7d-fcc5-4b94-a232-471043dc0964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:20:05 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-8ab42d1e-9467-46f2-92dd-c56a1b80e065 tempest-VolumesListAdminTestJSON-63071180 None] Volume bd907b79-da33-4b47-8683-dd4bcdb1718f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd907b79-da33-4b47-8683-dd4bcdb1718f', 'volume_size': 1} Jul 10 10:20:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-8ab42d1e-9467-46f2-92dd-c56a1b80e065 tempest-VolumesListAdminTestJSON-63071180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:20:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-8ab42d1e-9467-46f2-92dd-c56a1b80e065 tempest-VolumesListAdminTestJSON-63071180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:20:05 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-8ab42d1e-9467-46f2-92dd-c56a1b80e065 tempest-VolumesListAdminTestJSON-63071180 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:20:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-685452123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd907b79-da33-4b47-8683-dd4bcdb1718f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d91f74a8e7c34598ac1eb3ce5ce7a473',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:20:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:20:05Z,use_quota=True,user_id='085b44c97fd9424ea789cbe725a435ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:20:05 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-8ab42d1e-9467-46f2-92dd-c56a1b80e065 tempest-VolumesListAdminTestJSON-63071180 None] Creating volume bd907b79-da33-4b47-8683-dd4bcdb1718f {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:20:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-8ab42d1e-9467-46f2-92dd-c56a1b80e065 tempest-VolumesListAdminTestJSON-63071180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:20:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-8ab42d1e-9467-46f2-92dd-c56a1b80e065 tempest-VolumesListAdminTestJSON-63071180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:20:05 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-8ab42d1e-9467-46f2-92dd-c56a1b80e065 tempest-VolumesListAdminTestJSON-63071180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:20:05 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-8ab42d1e-9467-46f2-92dd-c56a1b80e065 tempest-VolumesListAdminTestJSON-63071180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:20:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-8ab42d1e-9467-46f2-92dd-c56a1b80e065 tempest-VolumesListAdminTestJSON-63071180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:20:05 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-8ab42d1e-9467-46f2-92dd-c56a1b80e065 tempest-VolumesListAdminTestJSON-63071180 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:20:05 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-8ab42d1e-9467-46f2-92dd-c56a1b80e065 tempest-VolumesListAdminTestJSON-63071180 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:20:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-8ab42d1e-9467-46f2-92dd-c56a1b80e065 tempest-VolumesListAdminTestJSON-63071180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-bd907b79-da33-4b47-8683-dd4bcdb1718f 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:20:05 devstack sudo[102871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-bd907b79-da33-4b47-8683-dd4bcdb1718f 1073741824 Jul 10 10:20:05 devstack sudo[102871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:20:06 devstack sudo[102871]: pam_unix(sudo:session): session closed for user root Jul 10 10:20:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-8ab42d1e-9467-46f2-92dd-c56a1b80e065 tempest-VolumesListAdminTestJSON-63071180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-bd907b79-da33-4b47-8683-dd4bcdb1718f 1073741824" returned: 0 in 0.931s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:20:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-8ab42d1e-9467-46f2-92dd-c56a1b80e065 tempest-VolumesListAdminTestJSON-63071180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-bd907b79-da33-4b47-8683-dd4bcdb1718f {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:20:06 devstack sudo[102877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-bd907b79-da33-4b47-8683-dd4bcdb1718f Jul 10 10:20:06 devstack sudo[102877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:20:07 devstack sudo[102877]: pam_unix(sudo:session): session closed for user root Jul 10 10:20:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-8ab42d1e-9467-46f2-92dd-c56a1b80e065 tempest-VolumesListAdminTestJSON-63071180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-bd907b79-da33-4b47-8683-dd4bcdb1718f" returned: 0 in 0.661s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:20:07 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-8ab42d1e-9467-46f2-92dd-c56a1b80e065 tempest-VolumesListAdminTestJSON-63071180 None] <== create_volume: return (1637ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:20:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-8ab42d1e-9467-46f2-92dd-c56a1b80e065 tempest-VolumesListAdminTestJSON-63071180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.641s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:20:07 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8ab42d1e-9467-46f2-92dd-c56a1b80e065 tempest-VolumesListAdminTestJSON-63071180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c29eda7d-fcc5-4b94-a232-471043dc0964) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd907b79-da33-4b47-8683-dd4bcdb1718f', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:20:07 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8ab42d1e-9467-46f2-92dd-c56a1b80e065 tempest-VolumesListAdminTestJSON-63071180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98c77be2-d89d-42ab-a6aa-e668c9e7fd83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:20:07 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-8ab42d1e-9467-46f2-92dd-c56a1b80e065 tempest-VolumesListAdminTestJSON-63071180 None] Volume volume-bd907b79-da33-4b47-8683-dd4bcdb1718f (bd907b79-da33-4b47-8683-dd4bcdb1718f): created successfully Jul 10 10:20:07 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8ab42d1e-9467-46f2-92dd-c56a1b80e065 tempest-VolumesListAdminTestJSON-63071180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98c77be2-d89d-42ab-a6aa-e668c9e7fd83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:20:07 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8ab42d1e-9467-46f2-92dd-c56a1b80e065 tempest-VolumesListAdminTestJSON-63071180 None] Flow 'volume_create_manager' (d34db607-8d7b-4c23-a379-535ede22306c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:20:07 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-8ab42d1e-9467-46f2-92dd-c56a1b80e065 tempest-VolumesListAdminTestJSON-63071180 None] Created volume successfully. Jul 10 10:20:07 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9976bf0-df2d-49d8-be6b-5ceb52932e15 tempest-VolumesListAdminTestJSON-63071180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:20:07 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-e9976bf0-df2d-49d8-be6b-5ceb52932e15 tempest-VolumesListAdminTestJSON-63071180 None] Flow 'volume_create_manager' (ec647d92-e83b-4836-b326-c351f8212c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:20:07 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-e9976bf0-df2d-49d8-be6b-5ceb52932e15 tempest-VolumesListAdminTestJSON-63071180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (126edaab-5ff1-4c97-b956-ccf306c455d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:20:07 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-e9976bf0-df2d-49d8-be6b-5ceb52932e15 tempest-VolumesListAdminTestJSON-63071180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (126edaab-5ff1-4c97-b956-ccf306c455d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:20:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1284787322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1fd88d3-a344-47aa-a5db-6cde4fabcffe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d91f74a8e7c34598ac1eb3ce5ce7a473',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:20:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:20:08Z,use_quota=True,user_id='085b44c97fd9424ea789cbe725a435ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:20:07 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-e9976bf0-df2d-49d8-be6b-5ceb52932e15 tempest-VolumesListAdminTestJSON-63071180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9cdff24-25af-4f4e-a134-502bc9c7b525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:20:07 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-e9976bf0-df2d-49d8-be6b-5ceb52932e15 tempest-VolumesListAdminTestJSON-63071180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9cdff24-25af-4f4e-a134-502bc9c7b525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:20:07 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-e9976bf0-df2d-49d8-be6b-5ceb52932e15 tempest-VolumesListAdminTestJSON-63071180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (857ce6ba-9310-44c1-b2c8-b4dbd684ad75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:20:07 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-e9976bf0-df2d-49d8-be6b-5ceb52932e15 tempest-VolumesListAdminTestJSON-63071180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (857ce6ba-9310-44c1-b2c8-b4dbd684ad75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1fd88d3-a344-47aa-a5db-6cde4fabcffe', 'volume_name': 'volume-a1fd88d3-a344-47aa-a5db-6cde4fabcffe', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:20:07 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-e9976bf0-df2d-49d8-be6b-5ceb52932e15 tempest-VolumesListAdminTestJSON-63071180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42f83e9f-ee0f-4e1d-9c67-2ac7b7a3dfd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:20:07 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-e9976bf0-df2d-49d8-be6b-5ceb52932e15 tempest-VolumesListAdminTestJSON-63071180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42f83e9f-ee0f-4e1d-9c67-2ac7b7a3dfd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:20:07 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-e9976bf0-df2d-49d8-be6b-5ceb52932e15 tempest-VolumesListAdminTestJSON-63071180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5101e37d-8bad-4972-9c8d-9631d732dfdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:20:07 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-e9976bf0-df2d-49d8-be6b-5ceb52932e15 tempest-VolumesListAdminTestJSON-63071180 None] Volume a1fd88d3-a344-47aa-a5db-6cde4fabcffe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1fd88d3-a344-47aa-a5db-6cde4fabcffe', 'volume_size': 1} Jul 10 10:20:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-e9976bf0-df2d-49d8-be6b-5ceb52932e15 tempest-VolumesListAdminTestJSON-63071180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:20:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-e9976bf0-df2d-49d8-be6b-5ceb52932e15 tempest-VolumesListAdminTestJSON-63071180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:20:07 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-e9976bf0-df2d-49d8-be6b-5ceb52932e15 tempest-VolumesListAdminTestJSON-63071180 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:20:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1284787322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1fd88d3-a344-47aa-a5db-6cde4fabcffe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d91f74a8e7c34598ac1eb3ce5ce7a473',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:20:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:20:08Z,use_quota=True,user_id='085b44c97fd9424ea789cbe725a435ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:20:07 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-e9976bf0-df2d-49d8-be6b-5ceb52932e15 tempest-VolumesListAdminTestJSON-63071180 None] Creating volume a1fd88d3-a344-47aa-a5db-6cde4fabcffe {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:20:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-e9976bf0-df2d-49d8-be6b-5ceb52932e15 tempest-VolumesListAdminTestJSON-63071180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:20:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-e9976bf0-df2d-49d8-be6b-5ceb52932e15 tempest-VolumesListAdminTestJSON-63071180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:20:07 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-e9976bf0-df2d-49d8-be6b-5ceb52932e15 tempest-VolumesListAdminTestJSON-63071180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:20:07 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-e9976bf0-df2d-49d8-be6b-5ceb52932e15 tempest-VolumesListAdminTestJSON-63071180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:20:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-e9976bf0-df2d-49d8-be6b-5ceb52932e15 tempest-VolumesListAdminTestJSON-63071180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:20:07 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-e9976bf0-df2d-49d8-be6b-5ceb52932e15 tempest-VolumesListAdminTestJSON-63071180 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:20:07 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-e9976bf0-df2d-49d8-be6b-5ceb52932e15 tempest-VolumesListAdminTestJSON-63071180 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:20:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e9976bf0-df2d-49d8-be6b-5ceb52932e15 tempest-VolumesListAdminTestJSON-63071180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a1fd88d3-a344-47aa-a5db-6cde4fabcffe 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:20:07 devstack sudo[102881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a1fd88d3-a344-47aa-a5db-6cde4fabcffe 1073741824 Jul 10 10:20:07 devstack sudo[102881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:20:08 devstack sudo[102881]: pam_unix(sudo:session): session closed for user root Jul 10 10:20:08 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e9976bf0-df2d-49d8-be6b-5ceb52932e15 tempest-VolumesListAdminTestJSON-63071180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a1fd88d3-a344-47aa-a5db-6cde4fabcffe 1073741824" returned: 0 in 0.845s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:20:08 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e9976bf0-df2d-49d8-be6b-5ceb52932e15 tempest-VolumesListAdminTestJSON-63071180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a1fd88d3-a344-47aa-a5db-6cde4fabcffe {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:20:08 devstack sudo[102886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a1fd88d3-a344-47aa-a5db-6cde4fabcffe Jul 10 10:20:08 devstack sudo[102886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:20:09 devstack sudo[102886]: pam_unix(sudo:session): session closed for user root Jul 10 10:20:09 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e9976bf0-df2d-49d8-be6b-5ceb52932e15 tempest-VolumesListAdminTestJSON-63071180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a1fd88d3-a344-47aa-a5db-6cde4fabcffe" returned: 0 in 0.678s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:20:09 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-e9976bf0-df2d-49d8-be6b-5ceb52932e15 tempest-VolumesListAdminTestJSON-63071180 None] <== create_volume: return (1576ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:20:09 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-e9976bf0-df2d-49d8-be6b-5ceb52932e15 tempest-VolumesListAdminTestJSON-63071180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.579s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:20:09 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-e9976bf0-df2d-49d8-be6b-5ceb52932e15 tempest-VolumesListAdminTestJSON-63071180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5101e37d-8bad-4972-9c8d-9631d732dfdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1fd88d3-a344-47aa-a5db-6cde4fabcffe', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:20:09 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-e9976bf0-df2d-49d8-be6b-5ceb52932e15 tempest-VolumesListAdminTestJSON-63071180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aefda68-d202-41b4-aca1-c5d12fae1f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:20:09 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-e9976bf0-df2d-49d8-be6b-5ceb52932e15 tempest-VolumesListAdminTestJSON-63071180 None] Volume volume-a1fd88d3-a344-47aa-a5db-6cde4fabcffe (a1fd88d3-a344-47aa-a5db-6cde4fabcffe): created successfully Jul 10 10:20:09 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-e9976bf0-df2d-49d8-be6b-5ceb52932e15 tempest-VolumesListAdminTestJSON-63071180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aefda68-d202-41b4-aca1-c5d12fae1f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:20:09 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-e9976bf0-df2d-49d8-be6b-5ceb52932e15 tempest-VolumesListAdminTestJSON-63071180 None] Flow 'volume_create_manager' (ec647d92-e83b-4836-b326-c351f8212c2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:20:09 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-e9976bf0-df2d-49d8-be6b-5ceb52932e15 tempest-VolumesListAdminTestJSON-63071180 None] Created volume successfully. Jul 10 10:20:10 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-82fb4257-54c6-426b-8830-64cb9cd0cdcc tempest-VolumesListAdminTestJSON-63071180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:20:10 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-82fb4257-54c6-426b-8830-64cb9cd0cdcc tempest-VolumesListAdminTestJSON-63071180 None] Flow 'volume_create_manager' (0387dee8-81e3-487d-a312-bbeebc75457a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:20:10 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-82fb4257-54c6-426b-8830-64cb9cd0cdcc tempest-VolumesListAdminTestJSON-63071180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9581bfb-645f-459d-ad5a-d847a4a75671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:20:10 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-82fb4257-54c6-426b-8830-64cb9cd0cdcc tempest-VolumesListAdminTestJSON-63071180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9581bfb-645f-459d-ad5a-d847a4a75671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:20:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1254258103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f349e251-7368-439c-98e4-05fbd1a06f64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d91f74a8e7c34598ac1eb3ce5ce7a473',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:20:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:20:10Z,use_quota=True,user_id='085b44c97fd9424ea789cbe725a435ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:20:10 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-82fb4257-54c6-426b-8830-64cb9cd0cdcc tempest-VolumesListAdminTestJSON-63071180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f519cdf-2cfa-4db6-a281-188b4b90f73a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:20:10 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-82fb4257-54c6-426b-8830-64cb9cd0cdcc tempest-VolumesListAdminTestJSON-63071180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f519cdf-2cfa-4db6-a281-188b4b90f73a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:20:10 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-82fb4257-54c6-426b-8830-64cb9cd0cdcc tempest-VolumesListAdminTestJSON-63071180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f4054d1-9ddf-4e49-97fd-eacdccd7f7c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:20:10 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-82fb4257-54c6-426b-8830-64cb9cd0cdcc tempest-VolumesListAdminTestJSON-63071180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f4054d1-9ddf-4e49-97fd-eacdccd7f7c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f349e251-7368-439c-98e4-05fbd1a06f64', 'volume_name': 'volume-f349e251-7368-439c-98e4-05fbd1a06f64', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:20:10 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-82fb4257-54c6-426b-8830-64cb9cd0cdcc tempest-VolumesListAdminTestJSON-63071180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92859a25-0d48-4111-992d-d8dd6ecf9f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:20:10 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-82fb4257-54c6-426b-8830-64cb9cd0cdcc tempest-VolumesListAdminTestJSON-63071180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92859a25-0d48-4111-992d-d8dd6ecf9f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:20:10 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-82fb4257-54c6-426b-8830-64cb9cd0cdcc tempest-VolumesListAdminTestJSON-63071180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf42bf53-0f44-4a2e-8faa-9fdf2a06f2ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:20:10 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-82fb4257-54c6-426b-8830-64cb9cd0cdcc tempest-VolumesListAdminTestJSON-63071180 None] Volume f349e251-7368-439c-98e4-05fbd1a06f64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f349e251-7368-439c-98e4-05fbd1a06f64', 'volume_size': 1} Jul 10 10:20:10 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-82fb4257-54c6-426b-8830-64cb9cd0cdcc tempest-VolumesListAdminTestJSON-63071180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:20:10 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-82fb4257-54c6-426b-8830-64cb9cd0cdcc tempest-VolumesListAdminTestJSON-63071180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:20:10 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-82fb4257-54c6-426b-8830-64cb9cd0cdcc tempest-VolumesListAdminTestJSON-63071180 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:20:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1254258103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f349e251-7368-439c-98e4-05fbd1a06f64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d91f74a8e7c34598ac1eb3ce5ce7a473',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:20:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:20:10Z,use_quota=True,user_id='085b44c97fd9424ea789cbe725a435ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:20:10 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-82fb4257-54c6-426b-8830-64cb9cd0cdcc tempest-VolumesListAdminTestJSON-63071180 None] Creating volume f349e251-7368-439c-98e4-05fbd1a06f64 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:20:10 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-82fb4257-54c6-426b-8830-64cb9cd0cdcc tempest-VolumesListAdminTestJSON-63071180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:20:10 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-82fb4257-54c6-426b-8830-64cb9cd0cdcc tempest-VolumesListAdminTestJSON-63071180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:20:10 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-82fb4257-54c6-426b-8830-64cb9cd0cdcc tempest-VolumesListAdminTestJSON-63071180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:20:10 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-82fb4257-54c6-426b-8830-64cb9cd0cdcc tempest-VolumesListAdminTestJSON-63071180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:20:10 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-82fb4257-54c6-426b-8830-64cb9cd0cdcc tempest-VolumesListAdminTestJSON-63071180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:20:10 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-82fb4257-54c6-426b-8830-64cb9cd0cdcc tempest-VolumesListAdminTestJSON-63071180 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:20:10 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-82fb4257-54c6-426b-8830-64cb9cd0cdcc tempest-VolumesListAdminTestJSON-63071180 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:20:10 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-82fb4257-54c6-426b-8830-64cb9cd0cdcc tempest-VolumesListAdminTestJSON-63071180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f349e251-7368-439c-98e4-05fbd1a06f64 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:20:10 devstack sudo[102889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f349e251-7368-439c-98e4-05fbd1a06f64 1073741824 Jul 10 10:20:10 devstack sudo[102889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:20:11 devstack sudo[102889]: pam_unix(sudo:session): session closed for user root Jul 10 10:20:11 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-82fb4257-54c6-426b-8830-64cb9cd0cdcc tempest-VolumesListAdminTestJSON-63071180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f349e251-7368-439c-98e4-05fbd1a06f64 1073741824" returned: 0 in 0.823s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:20:11 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-82fb4257-54c6-426b-8830-64cb9cd0cdcc tempest-VolumesListAdminTestJSON-63071180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f349e251-7368-439c-98e4-05fbd1a06f64 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:20:11 devstack sudo[102894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f349e251-7368-439c-98e4-05fbd1a06f64 Jul 10 10:20:11 devstack sudo[102894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:20:12 devstack sudo[102894]: pam_unix(sudo:session): session closed for user root Jul 10 10:20:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-82fb4257-54c6-426b-8830-64cb9cd0cdcc tempest-VolumesListAdminTestJSON-63071180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f349e251-7368-439c-98e4-05fbd1a06f64" returned: 0 in 0.679s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:20:12 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-82fb4257-54c6-426b-8830-64cb9cd0cdcc tempest-VolumesListAdminTestJSON-63071180 None] <== create_volume: return (1552ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:20:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-82fb4257-54c6-426b-8830-64cb9cd0cdcc tempest-VolumesListAdminTestJSON-63071180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.555s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:20:12 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-82fb4257-54c6-426b-8830-64cb9cd0cdcc tempest-VolumesListAdminTestJSON-63071180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf42bf53-0f44-4a2e-8faa-9fdf2a06f2ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f349e251-7368-439c-98e4-05fbd1a06f64', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:20:12 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-82fb4257-54c6-426b-8830-64cb9cd0cdcc tempest-VolumesListAdminTestJSON-63071180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (622c305d-18fd-4090-92b4-91377d7c84c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:20:12 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-82fb4257-54c6-426b-8830-64cb9cd0cdcc tempest-VolumesListAdminTestJSON-63071180 None] Volume volume-f349e251-7368-439c-98e4-05fbd1a06f64 (f349e251-7368-439c-98e4-05fbd1a06f64): created successfully Jul 10 10:20:12 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-82fb4257-54c6-426b-8830-64cb9cd0cdcc tempest-VolumesListAdminTestJSON-63071180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (622c305d-18fd-4090-92b4-91377d7c84c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:20:12 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-82fb4257-54c6-426b-8830-64cb9cd0cdcc tempest-VolumesListAdminTestJSON-63071180 None] Flow 'volume_create_manager' (0387dee8-81e3-487d-a312-bbeebc75457a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:20:12 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-82fb4257-54c6-426b-8830-64cb9cd0cdcc tempest-VolumesListAdminTestJSON-63071180 None] Created volume successfully. Jul 10 10:20:13 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-073dd71a-2cd2-49b1-9366-7a54d0579abb tempest-VolumesListAdminTestJSON-1724420502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:20:13 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-073dd71a-2cd2-49b1-9366-7a54d0579abb tempest-VolumesListAdminTestJSON-1724420502 None] Flow 'volume_create_manager' (2dcd5e71-e29f-479e-b838-8941289bd5a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:20:13 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-073dd71a-2cd2-49b1-9366-7a54d0579abb tempest-VolumesListAdminTestJSON-1724420502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fd79e31-1eb2-44fc-9e70-9570a6b11acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:20:13 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-073dd71a-2cd2-49b1-9366-7a54d0579abb tempest-VolumesListAdminTestJSON-1724420502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fd79e31-1eb2-44fc-9e70-9570a6b11acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:20:13Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=766a2fba-2225-4b69-8a59-995833f99bba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8edbc1d8082c4a108213f295dc4663b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:20:13Z,use_quota=True,user_id='626963e6d17343d289429df23330ab08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:20:13 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-073dd71a-2cd2-49b1-9366-7a54d0579abb tempest-VolumesListAdminTestJSON-1724420502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd1dd7c0-84ce-4581-b381-47d5b31b19b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:20:13 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-073dd71a-2cd2-49b1-9366-7a54d0579abb tempest-VolumesListAdminTestJSON-1724420502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd1dd7c0-84ce-4581-b381-47d5b31b19b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:20:13 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-073dd71a-2cd2-49b1-9366-7a54d0579abb tempest-VolumesListAdminTestJSON-1724420502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4c9e42c-7a7c-49e0-8970-097f17bfad88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:20:13 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-073dd71a-2cd2-49b1-9366-7a54d0579abb tempest-VolumesListAdminTestJSON-1724420502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4c9e42c-7a7c-49e0-8970-097f17bfad88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '766a2fba-2225-4b69-8a59-995833f99bba', 'volume_name': 'volume-766a2fba-2225-4b69-8a59-995833f99bba', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:20:13 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-073dd71a-2cd2-49b1-9366-7a54d0579abb tempest-VolumesListAdminTestJSON-1724420502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10b712a3-3b11-4877-943a-426176cfc15d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:20:13 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-073dd71a-2cd2-49b1-9366-7a54d0579abb tempest-VolumesListAdminTestJSON-1724420502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10b712a3-3b11-4877-943a-426176cfc15d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:20:13 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-073dd71a-2cd2-49b1-9366-7a54d0579abb tempest-VolumesListAdminTestJSON-1724420502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72c32834-917c-406a-815e-a9275c6ca050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:20:13 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-073dd71a-2cd2-49b1-9366-7a54d0579abb tempest-VolumesListAdminTestJSON-1724420502 None] Volume 766a2fba-2225-4b69-8a59-995833f99bba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-766a2fba-2225-4b69-8a59-995833f99bba', 'volume_size': 1} Jul 10 10:20:13 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-073dd71a-2cd2-49b1-9366-7a54d0579abb tempest-VolumesListAdminTestJSON-1724420502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:20:13 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-073dd71a-2cd2-49b1-9366-7a54d0579abb tempest-VolumesListAdminTestJSON-1724420502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:20:13 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-073dd71a-2cd2-49b1-9366-7a54d0579abb tempest-VolumesListAdminTestJSON-1724420502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:20:13Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=766a2fba-2225-4b69-8a59-995833f99bba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8edbc1d8082c4a108213f295dc4663b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:20:13Z,use_quota=True,user_id='626963e6d17343d289429df23330ab08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:20:13 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-073dd71a-2cd2-49b1-9366-7a54d0579abb tempest-VolumesListAdminTestJSON-1724420502 None] Creating volume 766a2fba-2225-4b69-8a59-995833f99bba {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:20:13 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-073dd71a-2cd2-49b1-9366-7a54d0579abb tempest-VolumesListAdminTestJSON-1724420502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:20:13 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-073dd71a-2cd2-49b1-9366-7a54d0579abb tempest-VolumesListAdminTestJSON-1724420502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:20:13 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-073dd71a-2cd2-49b1-9366-7a54d0579abb tempest-VolumesListAdminTestJSON-1724420502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:20:13 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-073dd71a-2cd2-49b1-9366-7a54d0579abb tempest-VolumesListAdminTestJSON-1724420502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:20:13 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-073dd71a-2cd2-49b1-9366-7a54d0579abb tempest-VolumesListAdminTestJSON-1724420502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:20:13 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-073dd71a-2cd2-49b1-9366-7a54d0579abb tempest-VolumesListAdminTestJSON-1724420502 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:20:13 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-073dd71a-2cd2-49b1-9366-7a54d0579abb tempest-VolumesListAdminTestJSON-1724420502 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:20:13 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-073dd71a-2cd2-49b1-9366-7a54d0579abb tempest-VolumesListAdminTestJSON-1724420502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-766a2fba-2225-4b69-8a59-995833f99bba 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:20:13 devstack sudo[102907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-766a2fba-2225-4b69-8a59-995833f99bba 1073741824 Jul 10 10:20:13 devstack sudo[102907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:20:14 devstack sudo[102907]: pam_unix(sudo:session): session closed for user root Jul 10 10:20:14 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-073dd71a-2cd2-49b1-9366-7a54d0579abb tempest-VolumesListAdminTestJSON-1724420502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-766a2fba-2225-4b69-8a59-995833f99bba 1073741824" returned: 0 in 0.837s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:20:14 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-073dd71a-2cd2-49b1-9366-7a54d0579abb tempest-VolumesListAdminTestJSON-1724420502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-766a2fba-2225-4b69-8a59-995833f99bba {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:20:14 devstack sudo[102912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-766a2fba-2225-4b69-8a59-995833f99bba Jul 10 10:20:14 devstack sudo[102912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:20:14 devstack sudo[102912]: pam_unix(sudo:session): session closed for user root Jul 10 10:20:14 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-073dd71a-2cd2-49b1-9366-7a54d0579abb tempest-VolumesListAdminTestJSON-1724420502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-766a2fba-2225-4b69-8a59-995833f99bba" returned: 0 in 0.643s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:20:14 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-073dd71a-2cd2-49b1-9366-7a54d0579abb tempest-VolumesListAdminTestJSON-1724420502 None] <== create_volume: return (1529ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:20:14 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-073dd71a-2cd2-49b1-9366-7a54d0579abb tempest-VolumesListAdminTestJSON-1724420502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.532s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:20:14 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-073dd71a-2cd2-49b1-9366-7a54d0579abb tempest-VolumesListAdminTestJSON-1724420502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72c32834-917c-406a-815e-a9275c6ca050) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-766a2fba-2225-4b69-8a59-995833f99bba', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:20:14 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-073dd71a-2cd2-49b1-9366-7a54d0579abb tempest-VolumesListAdminTestJSON-1724420502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98c3af96-d87b-422b-8448-c756d2360d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:20:14 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-073dd71a-2cd2-49b1-9366-7a54d0579abb tempest-VolumesListAdminTestJSON-1724420502 None] Volume volume-766a2fba-2225-4b69-8a59-995833f99bba (766a2fba-2225-4b69-8a59-995833f99bba): created successfully Jul 10 10:20:14 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-073dd71a-2cd2-49b1-9366-7a54d0579abb tempest-VolumesListAdminTestJSON-1724420502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98c3af96-d87b-422b-8448-c756d2360d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:20:14 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-073dd71a-2cd2-49b1-9366-7a54d0579abb tempest-VolumesListAdminTestJSON-1724420502 None] Flow 'volume_create_manager' (2dcd5e71-e29f-479e-b838-8941289bd5a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:20:14 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-073dd71a-2cd2-49b1-9366-7a54d0579abb tempest-VolumesListAdminTestJSON-1724420502 None] Created volume successfully. Jul 10 10:20:15 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-0865e075-1751-4ba8-b3ef-8cce47d17a22 tempest-VolumesListAdminTestJSON-1724420502 None] Acquiring lock "cinder-766a2fba-2225-4b69-8a59-995833f99bba-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:20:15 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-0865e075-1751-4ba8-b3ef-8cce47d17a22 tempest-VolumesListAdminTestJSON-1724420502 None] Lock "cinder-766a2fba-2225-4b69-8a59-995833f99bba-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:20:15 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-0865e075-1751-4ba8-b3ef-8cce47d17a22 tempest-VolumesListAdminTestJSON-1724420502 None] Acquiring lock "cinder-quobyte-766a2fba-2225-4b69-8a59-995833f99bba" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:20:15 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-0865e075-1751-4ba8-b3ef-8cce47d17a22 tempest-VolumesListAdminTestJSON-1724420502 None] Lock "cinder-quobyte-766a2fba-2225-4b69-8a59-995833f99bba" acquired by "delete_volume" :: waited 0.016s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:20:15 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[144d06eb-889b-4468-95e4-011f6b9ae844]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:20:15 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0865e075-1751-4ba8-b3ef-8cce47d17a22 tempest-VolumesListAdminTestJSON-1724420502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-766a2fba-2225-4b69-8a59-995833f99bba {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:20:15 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-7ec8bf56-36ad-4ac3-8dd8-bb155c3ab401 tempest-VolumesListAdminTestJSON-63071180 None] Acquiring lock "cinder-f349e251-7368-439c-98e4-05fbd1a06f64-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:20:15 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-7ec8bf56-36ad-4ac3-8dd8-bb155c3ab401 tempest-VolumesListAdminTestJSON-63071180 None] Lock "cinder-f349e251-7368-439c-98e4-05fbd1a06f64-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:20:15 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-7ec8bf56-36ad-4ac3-8dd8-bb155c3ab401 tempest-VolumesListAdminTestJSON-63071180 None] Acquiring lock "cinder-quobyte-f349e251-7368-439c-98e4-05fbd1a06f64" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:20:15 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-7ec8bf56-36ad-4ac3-8dd8-bb155c3ab401 tempest-VolumesListAdminTestJSON-63071180 None] Lock "cinder-quobyte-f349e251-7368-439c-98e4-05fbd1a06f64" acquired by "delete_volume" :: waited 0.017s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:20:15 devstack sudo[102915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-766a2fba-2225-4b69-8a59-995833f99bba Jul 10 10:20:15 devstack sudo[102915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:20:15 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a5c7400-26a0-46c5-b5cd-e8368b025689]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:20:15 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-7ec8bf56-36ad-4ac3-8dd8-bb155c3ab401 tempest-VolumesListAdminTestJSON-63071180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f349e251-7368-439c-98e4-05fbd1a06f64 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:20:15 devstack sudo[102917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f349e251-7368-439c-98e4-05fbd1a06f64 Jul 10 10:20:15 devstack sudo[102917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:20:16 devstack sudo[102915]: pam_unix(sudo:session): session closed for user root Jul 10 10:20:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0865e075-1751-4ba8-b3ef-8cce47d17a22 tempest-VolumesListAdminTestJSON-1724420502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-766a2fba-2225-4b69-8a59-995833f99bba" returned: 0 in 0.840s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:20:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0865e075-1751-4ba8-b3ef-8cce47d17a22 tempest-VolumesListAdminTestJSON-1724420502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-766a2fba-2225-4b69-8a59-995833f99bba {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:20:16 devstack sudo[102925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-766a2fba-2225-4b69-8a59-995833f99bba Jul 10 10:20:16 devstack sudo[102925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:20:16 devstack sudo[102917]: pam_unix(sudo:session): session closed for user root Jul 10 10:20:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-7ec8bf56-36ad-4ac3-8dd8-bb155c3ab401 tempest-VolumesListAdminTestJSON-63071180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f349e251-7368-439c-98e4-05fbd1a06f64" returned: 0 in 0.813s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:20:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-7ec8bf56-36ad-4ac3-8dd8-bb155c3ab401 tempest-VolumesListAdminTestJSON-63071180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f349e251-7368-439c-98e4-05fbd1a06f64 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:20:16 devstack sudo[102927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f349e251-7368-439c-98e4-05fbd1a06f64 Jul 10 10:20:16 devstack sudo[102927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:20:16 devstack sudo[102925]: pam_unix(sudo:session): session closed for user root Jul 10 10:20:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0865e075-1751-4ba8-b3ef-8cce47d17a22 tempest-VolumesListAdminTestJSON-1724420502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-766a2fba-2225-4b69-8a59-995833f99bba" returned: 0 in 0.695s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:20:16 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-0865e075-1751-4ba8-b3ef-8cce47d17a22 tempest-VolumesListAdminTestJSON-1724420502 None] Lock "cinder-quobyte-766a2fba-2225-4b69-8a59-995833f99bba" released by "delete_volume" :: held 1.581s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:20:16 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-0865e075-1751-4ba8-b3ef-8cce47d17a22 tempest-VolumesListAdminTestJSON-1724420502 None] Created reservations ['34a4d46a-6d09-41c3-bf1f-643d41fddb62', 'fc6837a6-8491-41e7-9778-fa78ffe8e6e3', '5433a219-4658-4fd2-915a-b5ee8f4e6665', '63a9c713-7b4d-43de-9658-36943848f514'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:20:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-0865e075-1751-4ba8-b3ef-8cce47d17a22 tempest-VolumesListAdminTestJSON-1724420502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:20:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-0865e075-1751-4ba8-b3ef-8cce47d17a22 tempest-VolumesListAdminTestJSON-1724420502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:20:17 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-0865e075-1751-4ba8-b3ef-8cce47d17a22 tempest-VolumesListAdminTestJSON-1724420502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:20:17 devstack sudo[102927]: pam_unix(sudo:session): session closed for user root Jul 10 10:20:17 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-0865e075-1751-4ba8-b3ef-8cce47d17a22 tempest-VolumesListAdminTestJSON-1724420502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:20:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-0865e075-1751-4ba8-b3ef-8cce47d17a22 tempest-VolumesListAdminTestJSON-1724420502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:20:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0865e075-1751-4ba8-b3ef-8cce47d17a22 tempest-VolumesListAdminTestJSON-1724420502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:20:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-7ec8bf56-36ad-4ac3-8dd8-bb155c3ab401 tempest-VolumesListAdminTestJSON-63071180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f349e251-7368-439c-98e4-05fbd1a06f64" returned: 0 in 0.720s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:20:17 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-7ec8bf56-36ad-4ac3-8dd8-bb155c3ab401 tempest-VolumesListAdminTestJSON-63071180 None] Lock "cinder-quobyte-f349e251-7368-439c-98e4-05fbd1a06f64" released by "delete_volume" :: held 1.584s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:20:17 devstack sudo[102931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:20:17 devstack sudo[102931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:20:17 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-7ec8bf56-36ad-4ac3-8dd8-bb155c3ab401 tempest-VolumesListAdminTestJSON-63071180 None] Created reservations ['6b34a627-ffb0-4d75-bcd9-7da4f0649a62', 'e6774b20-5c29-4926-9b3d-12bf693e4948', '9f46a087-fb53-4a08-b8c1-acb672b00516', 'f4eb769e-5db7-4022-a47f-6c8195851fbb'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:20:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-7ec8bf56-36ad-4ac3-8dd8-bb155c3ab401 tempest-VolumesListAdminTestJSON-63071180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:20:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-7ec8bf56-36ad-4ac3-8dd8-bb155c3ab401 tempest-VolumesListAdminTestJSON-63071180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:20:17 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-7ec8bf56-36ad-4ac3-8dd8-bb155c3ab401 tempest-VolumesListAdminTestJSON-63071180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:20:17 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-7ec8bf56-36ad-4ac3-8dd8-bb155c3ab401 tempest-VolumesListAdminTestJSON-63071180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:20:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-7ec8bf56-36ad-4ac3-8dd8-bb155c3ab401 tempest-VolumesListAdminTestJSON-63071180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:20:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-7ec8bf56-36ad-4ac3-8dd8-bb155c3ab401 tempest-VolumesListAdminTestJSON-63071180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:20:17 devstack sudo[102933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:20:17 devstack sudo[102933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:20:17 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-db2fd0e0-c1da-48e5-8f34-cf8be6edb499 tempest-VolumesListAdminTestJSON-63071180 None] Acquiring lock "cinder-a1fd88d3-a344-47aa-a5db-6cde4fabcffe-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:20:17 devstack sudo[102931]: pam_unix(sudo:session): session closed for user root Jul 10 10:20:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0865e075-1751-4ba8-b3ef-8cce47d17a22 tempest-VolumesListAdminTestJSON-1724420502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.699s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:20:17 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-0865e075-1751-4ba8-b3ef-8cce47d17a22 tempest-VolumesListAdminTestJSON-1724420502 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:20:17 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-db2fd0e0-c1da-48e5-8f34-cf8be6edb499 tempest-VolumesListAdminTestJSON-63071180 None] Lock "cinder-a1fd88d3-a344-47aa-a5db-6cde4fabcffe-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:20:17 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-0865e075-1751-4ba8-b3ef-8cce47d17a22 tempest-VolumesListAdminTestJSON-1724420502 None] Deleted volume successfully. Jul 10 10:20:17 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-0865e075-1751-4ba8-b3ef-8cce47d17a22 tempest-VolumesListAdminTestJSON-1724420502 None] Lock "cinder-766a2fba-2225-4b69-8a59-995833f99bba-delete_volume" released by "delete_volume" :: held 2.515s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:20:17 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-db2fd0e0-c1da-48e5-8f34-cf8be6edb499 tempest-VolumesListAdminTestJSON-63071180 None] Acquiring lock "cinder-quobyte-a1fd88d3-a344-47aa-a5db-6cde4fabcffe" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:20:17 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-db2fd0e0-c1da-48e5-8f34-cf8be6edb499 tempest-VolumesListAdminTestJSON-63071180 None] Lock "cinder-quobyte-a1fd88d3-a344-47aa-a5db-6cde4fabcffe" acquired by "delete_volume" :: waited 0.032s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:20:17 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[92339591-767d-4b2b-b533-008e9e0aa26d]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:20:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-db2fd0e0-c1da-48e5-8f34-cf8be6edb499 tempest-VolumesListAdminTestJSON-63071180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a1fd88d3-a344-47aa-a5db-6cde4fabcffe {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:20:17 devstack sudo[102933]: pam_unix(sudo:session): session closed for user root Jul 10 10:20:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-7ec8bf56-36ad-4ac3-8dd8-bb155c3ab401 tempest-VolumesListAdminTestJSON-63071180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.780s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:20:17 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-7ec8bf56-36ad-4ac3-8dd8-bb155c3ab401 tempest-VolumesListAdminTestJSON-63071180 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:20:17 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-7ec8bf56-36ad-4ac3-8dd8-bb155c3ab401 tempest-VolumesListAdminTestJSON-63071180 None] Deleted volume successfully. Jul 10 10:20:18 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-7ec8bf56-36ad-4ac3-8dd8-bb155c3ab401 tempest-VolumesListAdminTestJSON-63071180 None] Lock "cinder-f349e251-7368-439c-98e4-05fbd1a06f64-delete_volume" released by "delete_volume" :: held 2.564s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:20:18 devstack sudo[102972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a1fd88d3-a344-47aa-a5db-6cde4fabcffe Jul 10 10:20:18 devstack sudo[102972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:20:18 devstack sudo[102972]: pam_unix(sudo:session): session closed for user root Jul 10 10:20:18 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-db2fd0e0-c1da-48e5-8f34-cf8be6edb499 tempest-VolumesListAdminTestJSON-63071180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a1fd88d3-a344-47aa-a5db-6cde4fabcffe" returned: 0 in 0.781s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:20:18 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-db2fd0e0-c1da-48e5-8f34-cf8be6edb499 tempest-VolumesListAdminTestJSON-63071180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a1fd88d3-a344-47aa-a5db-6cde4fabcffe {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:20:18 devstack sudo[102979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a1fd88d3-a344-47aa-a5db-6cde4fabcffe Jul 10 10:20:18 devstack sudo[102979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:20:19 devstack sudo[102979]: pam_unix(sudo:session): session closed for user root Jul 10 10:20:19 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-db2fd0e0-c1da-48e5-8f34-cf8be6edb499 tempest-VolumesListAdminTestJSON-63071180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a1fd88d3-a344-47aa-a5db-6cde4fabcffe" returned: 0 in 0.663s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:20:19 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-db2fd0e0-c1da-48e5-8f34-cf8be6edb499 tempest-VolumesListAdminTestJSON-63071180 None] Lock "cinder-quobyte-a1fd88d3-a344-47aa-a5db-6cde4fabcffe" released by "delete_volume" :: held 1.498s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:20:19 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-db2fd0e0-c1da-48e5-8f34-cf8be6edb499 tempest-VolumesListAdminTestJSON-63071180 None] Created reservations ['0b4cf1aa-4b3f-4e34-a253-9bb565db2c3e', '59162aaf-df40-4773-93b2-cbd00a47e37b', '141c466a-9f53-435f-8898-2075618c6608', '254f20a4-8442-4b27-8991-1b55b15e0251'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:20:19 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-db2fd0e0-c1da-48e5-8f34-cf8be6edb499 tempest-VolumesListAdminTestJSON-63071180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:20:19 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-db2fd0e0-c1da-48e5-8f34-cf8be6edb499 tempest-VolumesListAdminTestJSON-63071180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:20:19 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-db2fd0e0-c1da-48e5-8f34-cf8be6edb499 tempest-VolumesListAdminTestJSON-63071180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:20:19 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-db2fd0e0-c1da-48e5-8f34-cf8be6edb499 tempest-VolumesListAdminTestJSON-63071180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:20:19 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-db2fd0e0-c1da-48e5-8f34-cf8be6edb499 tempest-VolumesListAdminTestJSON-63071180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:20:19 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-db2fd0e0-c1da-48e5-8f34-cf8be6edb499 tempest-VolumesListAdminTestJSON-63071180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:20:19 devstack sudo[102982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:20:19 devstack sudo[102982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:20:20 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-9f8814ca-decc-4f76-8fdd-275ec2480c8c tempest-VolumesListAdminTestJSON-63071180 None] Acquiring lock "cinder-bd907b79-da33-4b47-8683-dd4bcdb1718f-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:20:20 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-9f8814ca-decc-4f76-8fdd-275ec2480c8c tempest-VolumesListAdminTestJSON-63071180 None] Lock "cinder-bd907b79-da33-4b47-8683-dd4bcdb1718f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:20:20 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-9f8814ca-decc-4f76-8fdd-275ec2480c8c tempest-VolumesListAdminTestJSON-63071180 None] Acquiring lock "cinder-quobyte-bd907b79-da33-4b47-8683-dd4bcdb1718f" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:20:20 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-9f8814ca-decc-4f76-8fdd-275ec2480c8c tempest-VolumesListAdminTestJSON-63071180 None] Lock "cinder-quobyte-bd907b79-da33-4b47-8683-dd4bcdb1718f" acquired by "delete_volume" :: waited 0.015s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:20:20 devstack sudo[102982]: pam_unix(sudo:session): session closed for user root Jul 10 10:20:20 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e4a788-c584-46bb-92f5-d910ac49f490]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:20:20 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9f8814ca-decc-4f76-8fdd-275ec2480c8c tempest-VolumesListAdminTestJSON-63071180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-bd907b79-da33-4b47-8683-dd4bcdb1718f {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:20:20 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-db2fd0e0-c1da-48e5-8f34-cf8be6edb499 tempest-VolumesListAdminTestJSON-63071180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.686s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:20:20 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-db2fd0e0-c1da-48e5-8f34-cf8be6edb499 tempest-VolumesListAdminTestJSON-63071180 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:20:20 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-db2fd0e0-c1da-48e5-8f34-cf8be6edb499 tempest-VolumesListAdminTestJSON-63071180 None] Deleted volume successfully. Jul 10 10:20:20 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-db2fd0e0-c1da-48e5-8f34-cf8be6edb499 tempest-VolumesListAdminTestJSON-63071180 None] Lock "cinder-a1fd88d3-a344-47aa-a5db-6cde4fabcffe-delete_volume" released by "delete_volume" :: held 2.433s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:20:20 devstack sudo[102986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-bd907b79-da33-4b47-8683-dd4bcdb1718f Jul 10 10:20:20 devstack sudo[102986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:20:20 devstack sudo[102986]: pam_unix(sudo:session): session closed for user root Jul 10 10:20:20 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9f8814ca-decc-4f76-8fdd-275ec2480c8c tempest-VolumesListAdminTestJSON-63071180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-bd907b79-da33-4b47-8683-dd4bcdb1718f" returned: 0 in 0.778s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:20:20 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9f8814ca-decc-4f76-8fdd-275ec2480c8c tempest-VolumesListAdminTestJSON-63071180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-bd907b79-da33-4b47-8683-dd4bcdb1718f {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:20:20 devstack sudo[102992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-bd907b79-da33-4b47-8683-dd4bcdb1718f Jul 10 10:20:20 devstack sudo[102992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:20:21 devstack sudo[102992]: pam_unix(sudo:session): session closed for user root Jul 10 10:20:21 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9f8814ca-decc-4f76-8fdd-275ec2480c8c tempest-VolumesListAdminTestJSON-63071180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-bd907b79-da33-4b47-8683-dd4bcdb1718f" returned: 0 in 0.677s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:20:21 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-9f8814ca-decc-4f76-8fdd-275ec2480c8c tempest-VolumesListAdminTestJSON-63071180 None] Lock "cinder-quobyte-bd907b79-da33-4b47-8683-dd4bcdb1718f" released by "delete_volume" :: held 1.496s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:20:21 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-9f8814ca-decc-4f76-8fdd-275ec2480c8c tempest-VolumesListAdminTestJSON-63071180 None] Created reservations ['78f4c605-8e59-457e-8482-65a9c9c76a00', 'b3ce632e-0a39-4b37-b7e2-fd3283d1a546', 'e5b64643-6490-4c9c-8c68-dc6f16600793', 'c62cd74f-a12a-4e73-8a1f-00a2e8083a13'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:20:21 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-9f8814ca-decc-4f76-8fdd-275ec2480c8c tempest-VolumesListAdminTestJSON-63071180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:20:21 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-9f8814ca-decc-4f76-8fdd-275ec2480c8c tempest-VolumesListAdminTestJSON-63071180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:20:21 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-9f8814ca-decc-4f76-8fdd-275ec2480c8c tempest-VolumesListAdminTestJSON-63071180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:20:21 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-9f8814ca-decc-4f76-8fdd-275ec2480c8c tempest-VolumesListAdminTestJSON-63071180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:20:21 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-9f8814ca-decc-4f76-8fdd-275ec2480c8c tempest-VolumesListAdminTestJSON-63071180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:20:21 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9f8814ca-decc-4f76-8fdd-275ec2480c8c tempest-VolumesListAdminTestJSON-63071180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:20:21 devstack sudo[102995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:20:21 devstack sudo[102995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:20:22 devstack sudo[102995]: pam_unix(sudo:session): session closed for user root Jul 10 10:20:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9f8814ca-decc-4f76-8fdd-275ec2480c8c tempest-VolumesListAdminTestJSON-63071180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.649s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:20:22 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-9f8814ca-decc-4f76-8fdd-275ec2480c8c tempest-VolumesListAdminTestJSON-63071180 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:20:22 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-9f8814ca-decc-4f76-8fdd-275ec2480c8c tempest-VolumesListAdminTestJSON-63071180 None] Deleted volume successfully. Jul 10 10:20:22 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-9f8814ca-decc-4f76-8fdd-275ec2480c8c tempest-VolumesListAdminTestJSON-63071180 None] Lock "cinder-bd907b79-da33-4b47-8683-dd4bcdb1718f-delete_volume" released by "delete_volume" :: held 2.346s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:20:26 devstack cinder-volume[87234]: DEBUG dbcounter [-] [87234] Writing DB stats cinder:SELECT=71,cinder:UPDATE=98,cinder:INSERT=21,cinder:DELETE=4 {{(pid=87234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 10:20:26 devstack cinder-volume[87234]: DEBUG dbcounter [-] [87234] Writing DB stats cinder:SELECT=66,cinder:UPDATE=87,cinder:INSERT=20,cinder:DELETE=10 {{(pid=87234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 10:20:26 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-a40768f9-fe31-4cec-b716-912d81c40d92 tempest-VolumesImageMetadata-1234943134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:20:26 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a40768f9-fe31-4cec-b716-912d81c40d92 tempest-VolumesImageMetadata-1234943134 None] Flow 'volume_create_manager' (4b73ceb1-2008-4a54-94a8-103ebf5d15f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:20:26 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a40768f9-fe31-4cec-b716-912d81c40d92 tempest-VolumesImageMetadata-1234943134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93b65187-e9d4-42e8-9668-3be947d445f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:20:26 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a40768f9-fe31-4cec-b716-912d81c40d92 tempest-VolumesImageMetadata-1234943134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93b65187-e9d4-42e8-9668-3be947d445f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:20:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1492471532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c655e346-6902-455a-afb8-03ba0a8cdfd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb3ca401b2f94d63be4eaff65ba21c72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:20:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:20:27Z,use_quota=True,user_id='4e5c2987454940e39ccce3c6c4d3e996',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:20:26 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a40768f9-fe31-4cec-b716-912d81c40d92 tempest-VolumesImageMetadata-1234943134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f75ffc2f-21c9-4b37-b38f-395e0986c0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:20:26 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a40768f9-fe31-4cec-b716-912d81c40d92 tempest-VolumesImageMetadata-1234943134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f75ffc2f-21c9-4b37-b38f-395e0986c0a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:20:26 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a40768f9-fe31-4cec-b716-912d81c40d92 tempest-VolumesImageMetadata-1234943134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b07ed240-8b21-406c-8ba4-2708d5d4de9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:20:26 devstack cinder-volume[87234]: DEBUG cinder.image.glance [None req-a40768f9-fe31-4cec-b716-912d81c40d92 tempest-VolumesImageMetadata-1234943134 None] Creating Keystone auth plugin from conf {{(pid=87234) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 10:20:27 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a40768f9-fe31-4cec-b716-912d81c40d92 tempest-VolumesImageMetadata-1234943134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b07ed240-8b21-406c-8ba4-2708d5d4de9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c655e346-6902-455a-afb8-03ba0a8cdfd5', 'volume_name': 'volume-c655e346-6902-455a-afb8-03ba0a8cdfd5', 'volume_size': 1, 'image_id': '57b49355-8d23-4892-9d66-30ed6d4bc3c1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/57b49355-8d23-4892-9d66-30ed6d4bc3c1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd8e6341302c8449397efca0eea68956a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '57b49355-8d23-4892-9d66-30ed6d4bc3c1', 'created_at': datetime.datetime(2026, 7, 10, 7, 56, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 7, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/57b49355-8d23-4892-9d66-30ed6d4bc3c1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:20:27 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a40768f9-fe31-4cec-b716-912d81c40d92 tempest-VolumesImageMetadata-1234943134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84e0ceff-18ba-4247-ade6-cdb29ee96cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:20:27 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a40768f9-fe31-4cec-b716-912d81c40d92 tempest-VolumesImageMetadata-1234943134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84e0ceff-18ba-4247-ade6-cdb29ee96cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:20:27 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a40768f9-fe31-4cec-b716-912d81c40d92 tempest-VolumesImageMetadata-1234943134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd8366d6-4c6b-456b-800f-aaaca7e838e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:20:27 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-a40768f9-fe31-4cec-b716-912d81c40d92 tempest-VolumesImageMetadata-1234943134 None] Volume c655e346-6902-455a-afb8-03ba0a8cdfd5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c655e346-6902-455a-afb8-03ba0a8cdfd5', 'volume_size': 1, 'image_id': '57b49355-8d23-4892-9d66-30ed6d4bc3c1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/57b49355-8d23-4892-9d66-30ed6d4bc3c1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd8e6341302c8449397efca0eea68956a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '57b49355-8d23-4892-9d66-30ed6d4bc3c1', 'created_at': datetime.datetime(2026, 7, 10, 7, 56, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 7, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/57b49355-8d23-4892-9d66-30ed6d4bc3c1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 10 10:20:27 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-a40768f9-fe31-4cec-b716-912d81c40d92 tempest-VolumesImageMetadata-1234943134 None] Trying to clone c655e346-6902-455a-afb8-03ba0a8cdfd5 from image 57b49355-8d23-4892-9d66-30ed6d4bc3c1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/57b49355-8d23-4892-9d66-30ed6d4bc3c1', 'metadata': {}}]). {{(pid=87234) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 10:20:27 devstack cinder-volume[87234]: DEBUG cinder.image.image_utils [None req-a40768f9-fe31-4cec-b716-912d81c40d92 tempest-VolumesImageMetadata-1234943134 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_57b49355-8d23-4892-9d66-30ed6d4bc3c1_mtymt6cedevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87234) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 10:20:27 devstack cinder-volume[87234]: INFO cinder.image.image_utils [None req-a40768f9-fe31-4cec-b716-912d81c40d92 tempest-VolumesImageMetadata-1234943134 None] Image download 20.69 MB at 20.69 MB/s Jul 10 10:20:27 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e9d2fe-4079-488d-a0fe-5c7eaf5699aa]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:20:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a40768f9-fe31-4cec-b716-912d81c40d92 tempest-VolumesImageMetadata-1234943134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57b49355-8d23-4892-9d66-30ed6d4bc3c1_mtymt6cedevstack@QuobyteHD {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:20:27 devstack sudo[103004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57b49355-8d23-4892-9d66-30ed6d4bc3c1_mtymt6cedevstack@QuobyteHD Jul 10 10:20:27 devstack sudo[103004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:20:28 devstack sudo[103004]: pam_unix(sudo:session): session closed for user root Jul 10 10:20:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a40768f9-fe31-4cec-b716-912d81c40d92 tempest-VolumesImageMetadata-1234943134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57b49355-8d23-4892-9d66-30ed6d4bc3c1_mtymt6cedevstack@QuobyteHD" returned: 0 in 0.813s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:20:28 devstack cinder-volume[87234]: DEBUG cinder.image.image_utils [None req-a40768f9-fe31-4cec-b716-912d81c40d92 tempest-VolumesImageMetadata-1234943134 None] Temporary image 57b49355-8d23-4892-9d66-30ed6d4bc3c1 is fetched for user 4e5c2987454940e39ccce3c6c4d3e996. {{(pid=87234) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 10:20:28 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[3543bd8a-0027-43cf-a4aa-4211beae2d40]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:20:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a40768f9-fe31-4cec-b716-912d81c40d92 tempest-VolumesImageMetadata-1234943134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57b49355-8d23-4892-9d66-30ed6d4bc3c1_mtymt6cedevstack@QuobyteHD {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:20:28 devstack sudo[103014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57b49355-8d23-4892-9d66-30ed6d4bc3c1_mtymt6cedevstack@QuobyteHD Jul 10 10:20:28 devstack sudo[103014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:20:29 devstack sudo[103014]: pam_unix(sudo:session): session closed for user root Jul 10 10:20:29 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a40768f9-fe31-4cec-b716-912d81c40d92 tempest-VolumesImageMetadata-1234943134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57b49355-8d23-4892-9d66-30ed6d4bc3c1_mtymt6cedevstack@QuobyteHD" returned: 0 in 0.735s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:20:29 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-a40768f9-fe31-4cec-b716-912d81c40d92 tempest-VolumesImageMetadata-1234943134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:20:29 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-a40768f9-fe31-4cec-b716-912d81c40d92 tempest-VolumesImageMetadata-1234943134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:20:29 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-a40768f9-fe31-4cec-b716-912d81c40d92 tempest-VolumesImageMetadata-1234943134 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:20:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1492471532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c655e346-6902-455a-afb8-03ba0a8cdfd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb3ca401b2f94d63be4eaff65ba21c72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:20:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:20:27Z,use_quota=True,user_id='4e5c2987454940e39ccce3c6c4d3e996',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:20:29 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-a40768f9-fe31-4cec-b716-912d81c40d92 tempest-VolumesImageMetadata-1234943134 None] Creating volume c655e346-6902-455a-afb8-03ba0a8cdfd5 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:20:29 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-a40768f9-fe31-4cec-b716-912d81c40d92 tempest-VolumesImageMetadata-1234943134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:20:29 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-a40768f9-fe31-4cec-b716-912d81c40d92 tempest-VolumesImageMetadata-1234943134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:20:29 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-a40768f9-fe31-4cec-b716-912d81c40d92 tempest-VolumesImageMetadata-1234943134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:20:29 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-a40768f9-fe31-4cec-b716-912d81c40d92 tempest-VolumesImageMetadata-1234943134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:20:29 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-a40768f9-fe31-4cec-b716-912d81c40d92 tempest-VolumesImageMetadata-1234943134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:20:29 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-a40768f9-fe31-4cec-b716-912d81c40d92 tempest-VolumesImageMetadata-1234943134 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:20:29 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-a40768f9-fe31-4cec-b716-912d81c40d92 tempest-VolumesImageMetadata-1234943134 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:20:29 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a40768f9-fe31-4cec-b716-912d81c40d92 tempest-VolumesImageMetadata-1234943134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c655e346-6902-455a-afb8-03ba0a8cdfd5 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:20:29 devstack sudo[103019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c655e346-6902-455a-afb8-03ba0a8cdfd5 1073741824 Jul 10 10:20:29 devstack sudo[103019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:20:29 devstack sudo[103019]: pam_unix(sudo:session): session closed for user root Jul 10 10:20:29 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a40768f9-fe31-4cec-b716-912d81c40d92 tempest-VolumesImageMetadata-1234943134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c655e346-6902-455a-afb8-03ba0a8cdfd5 1073741824" returned: 0 in 0.828s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:20:29 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a40768f9-fe31-4cec-b716-912d81c40d92 tempest-VolumesImageMetadata-1234943134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c655e346-6902-455a-afb8-03ba0a8cdfd5 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:20:29 devstack sudo[103025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c655e346-6902-455a-afb8-03ba0a8cdfd5 Jul 10 10:20:29 devstack sudo[103025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:20:30 devstack sudo[103025]: pam_unix(sudo:session): session closed for user root Jul 10 10:20:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a40768f9-fe31-4cec-b716-912d81c40d92 tempest-VolumesImageMetadata-1234943134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c655e346-6902-455a-afb8-03ba0a8cdfd5" returned: 0 in 0.658s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:20:30 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-a40768f9-fe31-4cec-b716-912d81c40d92 tempest-VolumesImageMetadata-1234943134 None] <== create_volume: return (1530ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:20:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-a40768f9-fe31-4cec-b716-912d81c40d92 tempest-VolumesImageMetadata-1234943134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.533s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:20:30 devstack cinder-volume[87234]: DEBUG cinder.volume.volume_utils [None req-a40768f9-fe31-4cec-b716-912d81c40d92 tempest-VolumesImageMetadata-1234943134 None] Attempting download of 57b49355-8d23-4892-9d66-30ed6d4bc3c1 ((None, [{'url': 'file:///opt/stack/data/glance/images/57b49355-8d23-4892-9d66-30ed6d4bc3c1', 'metadata': {}}])) to volume c655e346-6902-455a-afb8-03ba0a8cdfd5. {{(pid=87234) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 10:20:30 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1576216-9045-495d-a358-429e9311e917]: (4, 'raw') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:20:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a40768f9-fe31-4cec-b716-912d81c40d92 tempest-VolumesImageMetadata-1234943134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_57b49355-8d23-4892-9d66-30ed6d4bc3c1_6mp10jyh {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:20:30 devstack sudo[103041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_57b49355-8d23-4892-9d66-30ed6d4bc3c1_6mp10jyh Jul 10 10:20:30 devstack sudo[103041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:20:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-918f3e2b-01b9-40f2-9868-b6a0a28e780c req-191f6503-71ee-4309-9fe2-bbf30183319b tempest-TestStampPattern-1267302871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:20:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-918f3e2b-01b9-40f2-9868-b6a0a28e780c req-191f6503-71ee-4309-9fe2-bbf30183319b tempest-TestStampPattern-1267302871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:20:30 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[a80b5334-f7b1-4afb-8d67-caca992d36cc]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:20:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-918f3e2b-01b9-40f2-9868-b6a0a28e780c req-191f6503-71ee-4309-9fe2-bbf30183319b tempest-TestStampPattern-1267302871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f1d516d7-1c9f-4c09-8210-72e69151ad5b {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:20:30 devstack sudo[103044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f1d516d7-1c9f-4c09-8210-72e69151ad5b Jul 10 10:20:30 devstack sudo[103044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:20:31 devstack sudo[103041]: pam_unix(sudo:session): session closed for user root Jul 10 10:20:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a40768f9-fe31-4cec-b716-912d81c40d92 tempest-VolumesImageMetadata-1234943134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_57b49355-8d23-4892-9d66-30ed6d4bc3c1_6mp10jyh" returned: 0 in 0.749s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:20:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a40768f9-fe31-4cec-b716-912d81c40d92 tempest-VolumesImageMetadata-1234943134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_57b49355-8d23-4892-9d66-30ed6d4bc3c1_6mp10jyh {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:20:31 devstack sudo[103048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_57b49355-8d23-4892-9d66-30ed6d4bc3c1_6mp10jyh Jul 10 10:20:31 devstack sudo[103048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:20:31 devstack sudo[103044]: pam_unix(sudo:session): session closed for user root Jul 10 10:20:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-918f3e2b-01b9-40f2-9868-b6a0a28e780c req-191f6503-71ee-4309-9fe2-bbf30183319b tempest-TestStampPattern-1267302871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f1d516d7-1c9f-4c09-8210-72e69151ad5b" returned: 0 in 0.777s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:20:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-918f3e2b-01b9-40f2-9868-b6a0a28e780c req-191f6503-71ee-4309-9fe2-bbf30183319b tempest-TestStampPattern-1267302871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.794s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:20:31 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [req-918f3e2b-01b9-40f2-9868-b6a0a28e780c req-191f6503-71ee-4309-9fe2-bbf30183319b tempest-TestStampPattern-1267302871 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091', 'name': 'volume-f1d516d7-1c9f-4c09-8210-72e69151ad5b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '644b8544-c773-439a-8b25-1cc1fe85153b', 'enforce_multipath': True} {{(pid=87234) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 10:20:31 devstack cinder-volume[87234]: INFO cinder.volume.manager [req-918f3e2b-01b9-40f2-9868-b6a0a28e780c req-191f6503-71ee-4309-9fe2-bbf30183319b tempest-TestStampPattern-1267302871 None] attachment_update completed successfully. Jul 10 10:20:32 devstack sudo[103048]: pam_unix(sudo:session): session closed for user root Jul 10 10:20:32 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a40768f9-fe31-4cec-b716-912d81c40d92 tempest-VolumesImageMetadata-1234943134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_57b49355-8d23-4892-9d66-30ed6d4bc3c1_6mp10jyh" returned: 1 in 0.782s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:20:32 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a40768f9-fe31-4cec-b716-912d81c40d92 tempest-VolumesImageMetadata-1234943134 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_57b49355-8d23-4892-9d66-30ed6d4bc3c1_6mp10jyh' failed. Not Retrying. {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 10:20:32 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b6ceb31-9418-4478-a107-edef20d3cefb]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:20:32 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a40768f9-fe31-4cec-b716-912d81c40d92 tempest-VolumesImageMetadata-1234943134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57b49355-8d23-4892-9d66-30ed6d4bc3c1_mtymt6cedevstack@QuobyteHD {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:20:32 devstack sudo[103122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57b49355-8d23-4892-9d66-30ed6d4bc3c1_mtymt6cedevstack@QuobyteHD Jul 10 10:20:32 devstack sudo[103122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:20:33 devstack sudo[103122]: pam_unix(sudo:session): session closed for user root Jul 10 10:20:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a40768f9-fe31-4cec-b716-912d81c40d92 tempest-VolumesImageMetadata-1234943134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57b49355-8d23-4892-9d66-30ed6d4bc3c1_mtymt6cedevstack@QuobyteHD" returned: 0 in 0.788s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:20:33 devstack cinder-volume[87234]: DEBUG cinder.image.image_utils [None req-a40768f9-fe31-4cec-b716-912d81c40d92 tempest-VolumesImageMetadata-1234943134 None] 57b49355-8d23-4892-9d66-30ed6d4bc3c1 was qcow2, converting to raw {{(pid=87234) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 10:20:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a40768f9-fe31-4cec-b716-912d81c40d92 tempest-VolumesImageMetadata-1234943134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_57b49355-8d23-4892-9d66-30ed6d4bc3c1_mtymt6cedevstack@QuobyteHD /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c655e346-6902-455a-afb8-03ba0a8cdfd5 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:20:33 devstack sudo[103442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_57b49355-8d23-4892-9d66-30ed6d4bc3c1_mtymt6cedevstack@QuobyteHD /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c655e346-6902-455a-afb8-03ba0a8cdfd5 Jul 10 10:20:33 devstack sudo[103442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:20:34 devstack sudo[103442]: pam_unix(sudo:session): session closed for user root Jul 10 10:20:34 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a40768f9-fe31-4cec-b716-912d81c40d92 tempest-VolumesImageMetadata-1234943134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_57b49355-8d23-4892-9d66-30ed6d4bc3c1_mtymt6cedevstack@QuobyteHD /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c655e346-6902-455a-afb8-03ba0a8cdfd5" returned: 0 in 1.847s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:20:34 devstack cinder-volume[87234]: DEBUG cinder.image.image_utils [None req-a40768f9-fe31-4cec-b716-912d81c40d92 tempest-VolumesImageMetadata-1234943134 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_57b49355-8d23-4892-9d66-30ed6d4bc3c1_mtymt6cedevstack@QuobyteHD, size 112.00 MB, duration 1.85 sec, destination /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c655e346-6902-455a-afb8-03ba0a8cdfd5 {{(pid=87234) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 10:20:34 devstack cinder-volume[87234]: INFO cinder.image.image_utils [None req-a40768f9-fe31-4cec-b716-912d81c40d92 tempest-VolumesImageMetadata-1234943134 None] Converted 112.00 MB image at 60.58 MB/s Jul 10 10:20:34 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a40768f9-fe31-4cec-b716-912d81c40d92 tempest-VolumesImageMetadata-1234943134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c655e346-6902-455a-afb8-03ba0a8cdfd5 1G {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:20:34 devstack sudo[103451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c655e346-6902-455a-afb8-03ba0a8cdfd5 1G Jul 10 10:20:34 devstack sudo[103451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:20:35 devstack sudo[103451]: pam_unix(sudo:session): session closed for user root Jul 10 10:20:35 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a40768f9-fe31-4cec-b716-912d81c40d92 tempest-VolumesImageMetadata-1234943134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c655e346-6902-455a-afb8-03ba0a8cdfd5 1G" returned: 0 in 0.685s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:20:35 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f9618ac-6de1-44e4-aa89-46595b9f5062]: (4, 'raw') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:20:35 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a40768f9-fe31-4cec-b716-912d81c40d92 tempest-VolumesImageMetadata-1234943134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c655e346-6902-455a-afb8-03ba0a8cdfd5 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:20:35 devstack sudo[103456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c655e346-6902-455a-afb8-03ba0a8cdfd5 Jul 10 10:20:35 devstack sudo[103456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:20:36 devstack sudo[103456]: pam_unix(sudo:session): session closed for user root Jul 10 10:20:36 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a40768f9-fe31-4cec-b716-912d81c40d92 tempest-VolumesImageMetadata-1234943134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c655e346-6902-455a-afb8-03ba0a8cdfd5" returned: 0 in 0.791s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:20:36 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a40768f9-fe31-4cec-b716-912d81c40d92 tempest-VolumesImageMetadata-1234943134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c655e346-6902-455a-afb8-03ba0a8cdfd5 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:20:36 devstack sudo[103466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c655e346-6902-455a-afb8-03ba0a8cdfd5 Jul 10 10:20:36 devstack sudo[103466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:20:37 devstack sudo[103466]: pam_unix(sudo:session): session closed for user root Jul 10 10:20:37 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a40768f9-fe31-4cec-b716-912d81c40d92 tempest-VolumesImageMetadata-1234943134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c655e346-6902-455a-afb8-03ba0a8cdfd5" returned: 1 in 0.802s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:20:37 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a40768f9-fe31-4cec-b716-912d81c40d92 tempest-VolumesImageMetadata-1234943134 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c655e346-6902-455a-afb8-03ba0a8cdfd5' failed. Not Retrying. {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 10:20:37 devstack cinder-volume[87234]: DEBUG cinder.volume.volume_utils [None req-a40768f9-fe31-4cec-b716-912d81c40d92 tempest-VolumesImageMetadata-1234943134 None] Downloaded image 57b49355-8d23-4892-9d66-30ed6d4bc3c1 ((None, [{'url': 'file:///opt/stack/data/glance/images/57b49355-8d23-4892-9d66-30ed6d4bc3c1', 'metadata': {}}])) to volume c655e346-6902-455a-afb8-03ba0a8cdfd5 successfully. {{(pid=87234) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 10:20:37 devstack cinder-volume[87234]: DEBUG cinder.image.image_utils [None req-a40768f9-fe31-4cec-b716-912d81c40d92 tempest-VolumesImageMetadata-1234943134 None] Temporary image 57b49355-8d23-4892-9d66-30ed6d4bc3c1 for user 4e5c2987454940e39ccce3c6c4d3e996 is deleted. {{(pid=87234) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 10:20:37 devstack cinder-volume[87234]: DEBUG cinder.volume.volume_utils [None req-a40768f9-fe31-4cec-b716-912d81c40d92 tempest-VolumesImageMetadata-1234943134 None] Marking volume c655e346-6902-455a-afb8-03ba0a8cdfd5 as bootable. {{(pid=87234) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 10:20:37 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-a40768f9-fe31-4cec-b716-912d81c40d92 tempest-VolumesImageMetadata-1234943134 None] Copying metadata from image 57b49355-8d23-4892-9d66-30ed6d4bc3c1 to c655e346-6902-455a-afb8-03ba0a8cdfd5. {{(pid=87234) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 10:20:37 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-a40768f9-fe31-4cec-b716-912d81c40d92 tempest-VolumesImageMetadata-1234943134 None] Creating volume glance metadata for volume c655e346-6902-455a-afb8-03ba0a8cdfd5 backed by image 57b49355-8d23-4892-9d66-30ed6d4bc3c1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '57b49355-8d23-4892-9d66-30ed6d4bc3c1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87234) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 10:20:37 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a40768f9-fe31-4cec-b716-912d81c40d92 tempest-VolumesImageMetadata-1234943134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd8366d6-4c6b-456b-800f-aaaca7e838e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c655e346-6902-455a-afb8-03ba0a8cdfd5', 'volume_size': 1, 'image_id': '57b49355-8d23-4892-9d66-30ed6d4bc3c1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/57b49355-8d23-4892-9d66-30ed6d4bc3c1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd8e6341302c8449397efca0eea68956a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '57b49355-8d23-4892-9d66-30ed6d4bc3c1', 'created_at': datetime.datetime(2026, 7, 10, 7, 56, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 7, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/57b49355-8d23-4892-9d66-30ed6d4bc3c1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:20:37 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a40768f9-fe31-4cec-b716-912d81c40d92 tempest-VolumesImageMetadata-1234943134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c33910c-b092-4e3c-b3bd-44951a178945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:20:37 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-a40768f9-fe31-4cec-b716-912d81c40d92 tempest-VolumesImageMetadata-1234943134 None] Volume volume-c655e346-6902-455a-afb8-03ba0a8cdfd5 (c655e346-6902-455a-afb8-03ba0a8cdfd5): created successfully Jul 10 10:20:37 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a40768f9-fe31-4cec-b716-912d81c40d92 tempest-VolumesImageMetadata-1234943134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c33910c-b092-4e3c-b3bd-44951a178945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:20:37 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a40768f9-fe31-4cec-b716-912d81c40d92 tempest-VolumesImageMetadata-1234943134 None] Flow 'volume_create_manager' (4b73ceb1-2008-4a54-94a8-103ebf5d15f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:20:37 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-a40768f9-fe31-4cec-b716-912d81c40d92 tempest-VolumesImageMetadata-1234943134 None] Created volume successfully. Jul 10 10:20:38 devstack cinder-volume[87234]: INFO cinder.volume.manager [req-a9604aa3-91d7-4bd3-9700-9441b4afa561 req-db67553d-be06-4744-946c-49d2f6fdca67 tempest-TestStampPattern-1267302871 None] Terminate volume connection completed successfully. Jul 10 10:20:38 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [req-a9604aa3-91d7-4bd3-9700-9441b4afa561 req-db67553d-be06-4744-946c-49d2f6fdca67 tempest-TestStampPattern-1267302871 None] Deleting attachment 644b8544-c773-439a-8b25-1cc1fe85153b. {{(pid=87234) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 10:20:38 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-1f6082c2-28e8-41d0-ab73-c1b5d9133a29 tempest-VolumesImageMetadata-1234943134 None] Acquiring lock "cinder-c655e346-6902-455a-afb8-03ba0a8cdfd5-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:20:38 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-1f6082c2-28e8-41d0-ab73-c1b5d9133a29 tempest-VolumesImageMetadata-1234943134 None] Lock "cinder-c655e346-6902-455a-afb8-03ba0a8cdfd5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:20:38 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-1f6082c2-28e8-41d0-ab73-c1b5d9133a29 tempest-VolumesImageMetadata-1234943134 None] Acquiring lock "cinder-quobyte-c655e346-6902-455a-afb8-03ba0a8cdfd5" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:20:38 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-1f6082c2-28e8-41d0-ab73-c1b5d9133a29 tempest-VolumesImageMetadata-1234943134 None] Lock "cinder-quobyte-c655e346-6902-455a-afb8-03ba0a8cdfd5" acquired by "delete_volume" :: waited 0.015s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:20:38 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[234281ab-e8b2-419b-8a7b-f78eecb99796]: (4, 'raw') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:20:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1f6082c2-28e8-41d0-ab73-c1b5d9133a29 tempest-VolumesImageMetadata-1234943134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c655e346-6902-455a-afb8-03ba0a8cdfd5 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:20:38 devstack sudo[103509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c655e346-6902-455a-afb8-03ba0a8cdfd5 Jul 10 10:20:38 devstack sudo[103509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:20:39 devstack sudo[103509]: pam_unix(sudo:session): session closed for user root Jul 10 10:20:39 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1f6082c2-28e8-41d0-ab73-c1b5d9133a29 tempest-VolumesImageMetadata-1234943134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c655e346-6902-455a-afb8-03ba0a8cdfd5" returned: 0 in 0.767s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:20:39 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1f6082c2-28e8-41d0-ab73-c1b5d9133a29 tempest-VolumesImageMetadata-1234943134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c655e346-6902-455a-afb8-03ba0a8cdfd5 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:20:39 devstack sudo[103514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c655e346-6902-455a-afb8-03ba0a8cdfd5 Jul 10 10:20:39 devstack sudo[103514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:20:40 devstack sudo[103514]: pam_unix(sudo:session): session closed for user root Jul 10 10:20:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1f6082c2-28e8-41d0-ab73-c1b5d9133a29 tempest-VolumesImageMetadata-1234943134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c655e346-6902-455a-afb8-03ba0a8cdfd5" returned: 1 in 0.746s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:20:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1f6082c2-28e8-41d0-ab73-c1b5d9133a29 tempest-VolumesImageMetadata-1234943134 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c655e346-6902-455a-afb8-03ba0a8cdfd5' failed. Not Retrying. {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 10:20:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1f6082c2-28e8-41d0-ab73-c1b5d9133a29 tempest-VolumesImageMetadata-1234943134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c655e346-6902-455a-afb8-03ba0a8cdfd5 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:20:40 devstack sudo[103520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c655e346-6902-455a-afb8-03ba0a8cdfd5 Jul 10 10:20:40 devstack sudo[103520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:20:41 devstack sudo[103520]: pam_unix(sudo:session): session closed for user root Jul 10 10:20:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1f6082c2-28e8-41d0-ab73-c1b5d9133a29 tempest-VolumesImageMetadata-1234943134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c655e346-6902-455a-afb8-03ba0a8cdfd5" returned: 0 in 0.689s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:20:41 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-1f6082c2-28e8-41d0-ab73-c1b5d9133a29 tempest-VolumesImageMetadata-1234943134 None] Lock "cinder-quobyte-c655e346-6902-455a-afb8-03ba0a8cdfd5" released by "delete_volume" :: held 2.265s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:20:41 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-1f6082c2-28e8-41d0-ab73-c1b5d9133a29 tempest-VolumesImageMetadata-1234943134 None] Created reservations ['6f5603d9-e8d0-4cb2-8e27-7d71523f4684', 'fe623c1d-ad09-4b09-99f0-dd1acc46c500', '5bdd0d7b-20d0-4bab-b494-887c316afb9f', '56bd5953-7628-48f2-ad4a-94317a5c94f0'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:20:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-1f6082c2-28e8-41d0-ab73-c1b5d9133a29 tempest-VolumesImageMetadata-1234943134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:20:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-1f6082c2-28e8-41d0-ab73-c1b5d9133a29 tempest-VolumesImageMetadata-1234943134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:20:41 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-1f6082c2-28e8-41d0-ab73-c1b5d9133a29 tempest-VolumesImageMetadata-1234943134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:20:41 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-1f6082c2-28e8-41d0-ab73-c1b5d9133a29 tempest-VolumesImageMetadata-1234943134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:20:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-1f6082c2-28e8-41d0-ab73-c1b5d9133a29 tempest-VolumesImageMetadata-1234943134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:20:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1f6082c2-28e8-41d0-ab73-c1b5d9133a29 tempest-VolumesImageMetadata-1234943134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:20:41 devstack sudo[103525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:20:41 devstack sudo[103525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:20:41 devstack sudo[103525]: pam_unix(sudo:session): session closed for user root Jul 10 10:20:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1f6082c2-28e8-41d0-ab73-c1b5d9133a29 tempest-VolumesImageMetadata-1234943134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.767s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:20:41 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-1f6082c2-28e8-41d0-ab73-c1b5d9133a29 tempest-VolumesImageMetadata-1234943134 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:20:41 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-1f6082c2-28e8-41d0-ab73-c1b5d9133a29 tempest-VolumesImageMetadata-1234943134 None] Deleted volume successfully. Jul 10 10:20:42 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-1f6082c2-28e8-41d0-ab73-c1b5d9133a29 tempest-VolumesImageMetadata-1234943134 None] Lock "cinder-c655e346-6902-455a-afb8-03ba0a8cdfd5-delete_volume" released by "delete_volume" :: held 3.317s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:20:42 devstack cinder-volume[87234]: DEBUG oslo_service.periodic_task [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 10:20:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:20:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:20:42 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:20:42 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:20:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:20:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:20:42 devstack sudo[103528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:20:42 devstack sudo[103528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:20:42 devstack sudo[103528]: pam_unix(sudo:session): session closed for user root Jul 10 10:20:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.751s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:20:42 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:20:42 devstack cinder-volume[87234]: DEBUG oslo_service.periodic_task [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Running periodic task VolumeManager._thread_info {{(pid=87234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 10:20:42 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] thread count: 28 {{(pid=87234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 10:20:42 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] thread info: [<_MainThread(MainThread, started 131600773742720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 10:20:47 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-1aad841d-b244-47ed-b423-236493eb75aa tempest-VolumesMetadataTest-751758431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:20:47 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1aad841d-b244-47ed-b423-236493eb75aa tempest-VolumesMetadataTest-751758431 None] Flow 'volume_create_manager' (8dd4cdb8-2403-4bed-a236-19f0c2fd698d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:20:47 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1aad841d-b244-47ed-b423-236493eb75aa tempest-VolumesMetadataTest-751758431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1325a52-6858-47f1-b07d-08fa97c4e06d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:20:47 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1aad841d-b244-47ed-b423-236493eb75aa tempest-VolumesMetadataTest-751758431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1325a52-6858-47f1-b07d-08fa97c4e06d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:20:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-12797584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95665e6d-16b2-4941-9c22-8e5b9077aa3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='face0f914b6745029a61f5dae4204904',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:20:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:20:48Z,use_quota=True,user_id='e41855a3fc2b4d0cb70e4ae8ebf51bfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:20:47 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1aad841d-b244-47ed-b423-236493eb75aa tempest-VolumesMetadataTest-751758431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33e01241-d0fd-435f-bb4f-df3fa8bd9778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:20:47 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1aad841d-b244-47ed-b423-236493eb75aa tempest-VolumesMetadataTest-751758431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33e01241-d0fd-435f-bb4f-df3fa8bd9778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:20:47 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1aad841d-b244-47ed-b423-236493eb75aa tempest-VolumesMetadataTest-751758431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2519061-ff4f-487d-a668-5ef7499b4009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:20:47 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1aad841d-b244-47ed-b423-236493eb75aa tempest-VolumesMetadataTest-751758431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2519061-ff4f-487d-a668-5ef7499b4009) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95665e6d-16b2-4941-9c22-8e5b9077aa3b', 'volume_name': 'volume-95665e6d-16b2-4941-9c22-8e5b9077aa3b', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:20:47 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1aad841d-b244-47ed-b423-236493eb75aa tempest-VolumesMetadataTest-751758431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49665ab5-d09a-446e-81e1-a469bb8a1a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:20:47 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1aad841d-b244-47ed-b423-236493eb75aa tempest-VolumesMetadataTest-751758431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49665ab5-d09a-446e-81e1-a469bb8a1a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:20:47 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1aad841d-b244-47ed-b423-236493eb75aa tempest-VolumesMetadataTest-751758431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (217457e0-b4d1-464a-bbd5-d3ed0b7ad037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:20:47 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-1aad841d-b244-47ed-b423-236493eb75aa tempest-VolumesMetadataTest-751758431 None] Volume 95665e6d-16b2-4941-9c22-8e5b9077aa3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95665e6d-16b2-4941-9c22-8e5b9077aa3b', 'volume_size': 1} Jul 10 10:20:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-1aad841d-b244-47ed-b423-236493eb75aa tempest-VolumesMetadataTest-751758431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:20:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-1aad841d-b244-47ed-b423-236493eb75aa tempest-VolumesMetadataTest-751758431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:20:47 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-1aad841d-b244-47ed-b423-236493eb75aa tempest-VolumesMetadataTest-751758431 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:20:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-12797584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95665e6d-16b2-4941-9c22-8e5b9077aa3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='face0f914b6745029a61f5dae4204904',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:20:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:20:48Z,use_quota=True,user_id='e41855a3fc2b4d0cb70e4ae8ebf51bfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:20:47 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-1aad841d-b244-47ed-b423-236493eb75aa tempest-VolumesMetadataTest-751758431 None] Creating volume 95665e6d-16b2-4941-9c22-8e5b9077aa3b {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:20:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-1aad841d-b244-47ed-b423-236493eb75aa tempest-VolumesMetadataTest-751758431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:20:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-1aad841d-b244-47ed-b423-236493eb75aa tempest-VolumesMetadataTest-751758431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:20:47 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-1aad841d-b244-47ed-b423-236493eb75aa tempest-VolumesMetadataTest-751758431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:20:47 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-1aad841d-b244-47ed-b423-236493eb75aa tempest-VolumesMetadataTest-751758431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:20:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-1aad841d-b244-47ed-b423-236493eb75aa tempest-VolumesMetadataTest-751758431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:20:47 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-1aad841d-b244-47ed-b423-236493eb75aa tempest-VolumesMetadataTest-751758431 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:20:47 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-1aad841d-b244-47ed-b423-236493eb75aa tempest-VolumesMetadataTest-751758431 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:20:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1aad841d-b244-47ed-b423-236493eb75aa tempest-VolumesMetadataTest-751758431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-95665e6d-16b2-4941-9c22-8e5b9077aa3b 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:20:47 devstack sudo[103558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-95665e6d-16b2-4941-9c22-8e5b9077aa3b 1073741824 Jul 10 10:20:47 devstack sudo[103558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:20:48 devstack sudo[103558]: pam_unix(sudo:session): session closed for user root Jul 10 10:20:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1aad841d-b244-47ed-b423-236493eb75aa tempest-VolumesMetadataTest-751758431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-95665e6d-16b2-4941-9c22-8e5b9077aa3b 1073741824" returned: 0 in 0.836s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:20:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1aad841d-b244-47ed-b423-236493eb75aa tempest-VolumesMetadataTest-751758431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-95665e6d-16b2-4941-9c22-8e5b9077aa3b {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:20:48 devstack sudo[103564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-95665e6d-16b2-4941-9c22-8e5b9077aa3b Jul 10 10:20:48 devstack sudo[103564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:20:48 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-4047381e-524b-4c66-a07f-7f9aa65d0361 tempest-TestStampPattern-1267302871 None] Acquiring lock "cinder-f1d516d7-1c9f-4c09-8210-72e69151ad5b-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:20:48 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-4047381e-524b-4c66-a07f-7f9aa65d0361 tempest-TestStampPattern-1267302871 None] Lock "cinder-f1d516d7-1c9f-4c09-8210-72e69151ad5b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:20:48 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-4047381e-524b-4c66-a07f-7f9aa65d0361 tempest-TestStampPattern-1267302871 None] Acquiring lock "cinder-quobyte-f1d516d7-1c9f-4c09-8210-72e69151ad5b" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:20:48 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-4047381e-524b-4c66-a07f-7f9aa65d0361 tempest-TestStampPattern-1267302871 None] Lock "cinder-quobyte-f1d516d7-1c9f-4c09-8210-72e69151ad5b" acquired by "delete_volume" :: waited 0.024s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:20:48 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[794e923d-8a7c-41c9-8fec-6095161e072e]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:20:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4047381e-524b-4c66-a07f-7f9aa65d0361 tempest-TestStampPattern-1267302871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f1d516d7-1c9f-4c09-8210-72e69151ad5b {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:20:48 devstack sudo[103566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f1d516d7-1c9f-4c09-8210-72e69151ad5b Jul 10 10:20:48 devstack sudo[103566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:20:49 devstack sudo[103564]: pam_unix(sudo:session): session closed for user root Jul 10 10:20:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1aad841d-b244-47ed-b423-236493eb75aa tempest-VolumesMetadataTest-751758431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-95665e6d-16b2-4941-9c22-8e5b9077aa3b" returned: 0 in 0.656s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:20:49 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-1aad841d-b244-47ed-b423-236493eb75aa tempest-VolumesMetadataTest-751758431 None] <== create_volume: return (1536ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:20:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-1aad841d-b244-47ed-b423-236493eb75aa tempest-VolumesMetadataTest-751758431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.539s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:20:49 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1aad841d-b244-47ed-b423-236493eb75aa tempest-VolumesMetadataTest-751758431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (217457e0-b4d1-464a-bbd5-d3ed0b7ad037) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95665e6d-16b2-4941-9c22-8e5b9077aa3b', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:20:49 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1aad841d-b244-47ed-b423-236493eb75aa tempest-VolumesMetadataTest-751758431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4804f44-e6d3-47d7-9676-3536e2361f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:20:49 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-1aad841d-b244-47ed-b423-236493eb75aa tempest-VolumesMetadataTest-751758431 None] Volume volume-95665e6d-16b2-4941-9c22-8e5b9077aa3b (95665e6d-16b2-4941-9c22-8e5b9077aa3b): created successfully Jul 10 10:20:49 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1aad841d-b244-47ed-b423-236493eb75aa tempest-VolumesMetadataTest-751758431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4804f44-e6d3-47d7-9676-3536e2361f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:20:49 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1aad841d-b244-47ed-b423-236493eb75aa tempest-VolumesMetadataTest-751758431 None] Flow 'volume_create_manager' (8dd4cdb8-2403-4bed-a236-19f0c2fd698d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:20:49 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-1aad841d-b244-47ed-b423-236493eb75aa tempest-VolumesMetadataTest-751758431 None] Created volume successfully. Jul 10 10:20:49 devstack sudo[103566]: pam_unix(sudo:session): session closed for user root Jul 10 10:20:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4047381e-524b-4c66-a07f-7f9aa65d0361 tempest-TestStampPattern-1267302871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f1d516d7-1c9f-4c09-8210-72e69151ad5b" returned: 0 in 0.778s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:20:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4047381e-524b-4c66-a07f-7f9aa65d0361 tempest-TestStampPattern-1267302871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f1d516d7-1c9f-4c09-8210-72e69151ad5b {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:20:49 devstack sudo[103572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f1d516d7-1c9f-4c09-8210-72e69151ad5b Jul 10 10:20:49 devstack sudo[103572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:20:50 devstack sudo[103572]: pam_unix(sudo:session): session closed for user root Jul 10 10:20:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4047381e-524b-4c66-a07f-7f9aa65d0361 tempest-TestStampPattern-1267302871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f1d516d7-1c9f-4c09-8210-72e69151ad5b" returned: 0 in 0.662s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:20:50 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-4047381e-524b-4c66-a07f-7f9aa65d0361 tempest-TestStampPattern-1267302871 None] Lock "cinder-quobyte-f1d516d7-1c9f-4c09-8210-72e69151ad5b" released by "delete_volume" :: held 1.489s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:20:50 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-ae18244c-56c5-4159-9657-90b24784aad3 tempest-VolumesMetadataTest-751758431 None] Acquiring lock "cinder-95665e6d-16b2-4941-9c22-8e5b9077aa3b-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:20:50 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-4047381e-524b-4c66-a07f-7f9aa65d0361 tempest-TestStampPattern-1267302871 None] Created reservations ['a8639ad0-6ac7-44b0-b5a4-c8da115d96d3', '4969a4f9-46b0-4429-b3db-7df06ad350b7', '3561b00e-7e60-4009-a31a-bee703423d9b', '9251b632-716b-448f-a8ce-5be9279cc6b5'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:20:50 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-ae18244c-56c5-4159-9657-90b24784aad3 tempest-VolumesMetadataTest-751758431 None] Lock "cinder-95665e6d-16b2-4941-9c22-8e5b9077aa3b-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:20:50 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-ae18244c-56c5-4159-9657-90b24784aad3 tempest-VolumesMetadataTest-751758431 None] Acquiring lock "cinder-quobyte-95665e6d-16b2-4941-9c22-8e5b9077aa3b" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:20:50 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-ae18244c-56c5-4159-9657-90b24784aad3 tempest-VolumesMetadataTest-751758431 None] Lock "cinder-quobyte-95665e6d-16b2-4941-9c22-8e5b9077aa3b" acquired by "delete_volume" :: waited 0.019s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:20:50 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfafee43-c376-42c2-95c3-4e6e1f4ab86e]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:20:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ae18244c-56c5-4159-9657-90b24784aad3 tempest-VolumesMetadataTest-751758431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-95665e6d-16b2-4941-9c22-8e5b9077aa3b {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:20:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-4047381e-524b-4c66-a07f-7f9aa65d0361 tempest-TestStampPattern-1267302871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:20:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-4047381e-524b-4c66-a07f-7f9aa65d0361 tempest-TestStampPattern-1267302871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:20:50 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-4047381e-524b-4c66-a07f-7f9aa65d0361 tempest-TestStampPattern-1267302871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:20:50 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-4047381e-524b-4c66-a07f-7f9aa65d0361 tempest-TestStampPattern-1267302871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:20:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-4047381e-524b-4c66-a07f-7f9aa65d0361 tempest-TestStampPattern-1267302871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:20:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4047381e-524b-4c66-a07f-7f9aa65d0361 tempest-TestStampPattern-1267302871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:20:50 devstack sudo[103576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:20:50 devstack sudo[103576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:20:50 devstack sudo[103575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-95665e6d-16b2-4941-9c22-8e5b9077aa3b Jul 10 10:20:50 devstack sudo[103575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:20:51 devstack sudo[103576]: pam_unix(sudo:session): session closed for user root Jul 10 10:20:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4047381e-524b-4c66-a07f-7f9aa65d0361 tempest-TestStampPattern-1267302871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.677s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:20:51 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-4047381e-524b-4c66-a07f-7f9aa65d0361 tempest-TestStampPattern-1267302871 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:20:51 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-4047381e-524b-4c66-a07f-7f9aa65d0361 tempest-TestStampPattern-1267302871 None] Deleted volume successfully. Jul 10 10:20:51 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-4047381e-524b-4c66-a07f-7f9aa65d0361 tempest-TestStampPattern-1267302871 None] Lock "cinder-f1d516d7-1c9f-4c09-8210-72e69151ad5b-delete_volume" released by "delete_volume" :: held 2.446s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:20:51 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-01477fb8-9c6a-4be4-b731-ca668b8b209a tempest-TestStampPattern-1267302871 None] Acquiring lock "cinder-8cd1bd27-cb2e-4e13-be59-884b8826ca0c-delete_snapshot" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:20:51 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-01477fb8-9c6a-4be4-b731-ca668b8b209a tempest-TestStampPattern-1267302871 None] Lock "cinder-8cd1bd27-cb2e-4e13-be59-884b8826ca0c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:20:51 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-01477fb8-9c6a-4be4-b731-ca668b8b209a tempest-TestStampPattern-1267302871 None] Acquiring lock "cinder-quobyte-7f87bb0f-5ab5-4897-939c-fa8c133c13e3" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:20:51 devstack sudo[103575]: pam_unix(sudo:session): session closed for user root Jul 10 10:20:51 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-01477fb8-9c6a-4be4-b731-ca668b8b209a tempest-TestStampPattern-1267302871 None] Lock "cinder-quobyte-7f87bb0f-5ab5-4897-939c-fa8c133c13e3" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:20:51 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-01477fb8-9c6a-4be4-b731-ca668b8b209a tempest-TestStampPattern-1267302871 None] Acquiring lock "cinder-quobyte-8cd1bd27-cb2e-4e13-be59-884b8826ca0c" by "_delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:20:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ae18244c-56c5-4159-9657-90b24784aad3 tempest-VolumesMetadataTest-751758431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-95665e6d-16b2-4941-9c22-8e5b9077aa3b" returned: 0 in 0.868s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:20:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ae18244c-56c5-4159-9657-90b24784aad3 tempest-VolumesMetadataTest-751758431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-95665e6d-16b2-4941-9c22-8e5b9077aa3b {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:20:51 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-01477fb8-9c6a-4be4-b731-ca668b8b209a tempest-TestStampPattern-1267302871 None] Lock "cinder-quobyte-8cd1bd27-cb2e-4e13-be59-884b8826ca0c" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:20:51 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-01477fb8-9c6a-4be4-b731-ca668b8b209a tempest-TestStampPattern-1267302871 None] Deleting offline snapshot 8cd1bd27-cb2e-4e13-be59-884b8826ca0c of volume 7f87bb0f-5ab5-4897-939c-fa8c133c13e3 {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 10:20:51 devstack sudo[103583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-95665e6d-16b2-4941-9c22-8e5b9077aa3b Jul 10 10:20:51 devstack sudo[103583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:20:51 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-01477fb8-9c6a-4be4-b731-ca668b8b209a tempest-TestStampPattern-1267302871 None] snapshot_file for this snap is: volume-7f87bb0f-5ab5-4897-939c-fa8c133c13e3.8cd1bd27-cb2e-4e13-be59-884b8826ca0c {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 10:20:51 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb2c2837-22d2-452a-9dd4-80d3595d8d7a]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:20:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-01477fb8-9c6a-4be4-b731-ca668b8b209a tempest-TestStampPattern-1267302871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7f87bb0f-5ab5-4897-939c-fa8c133c13e3.8cd1bd27-cb2e-4e13-be59-884b8826ca0c {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:20:51 devstack sudo[103585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7f87bb0f-5ab5-4897-939c-fa8c133c13e3.8cd1bd27-cb2e-4e13-be59-884b8826ca0c Jul 10 10:20:51 devstack sudo[103585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:20:52 devstack sudo[103583]: pam_unix(sudo:session): session closed for user root Jul 10 10:20:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ae18244c-56c5-4159-9657-90b24784aad3 tempest-VolumesMetadataTest-751758431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-95665e6d-16b2-4941-9c22-8e5b9077aa3b" returned: 0 in 0.713s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:20:52 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-ae18244c-56c5-4159-9657-90b24784aad3 tempest-VolumesMetadataTest-751758431 None] Lock "cinder-quobyte-95665e6d-16b2-4941-9c22-8e5b9077aa3b" released by "delete_volume" :: held 1.626s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:20:52 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-ae18244c-56c5-4159-9657-90b24784aad3 tempest-VolumesMetadataTest-751758431 None] Created reservations ['1298a9c9-9ca6-49ea-adac-adae37dce54a', '608da320-59d0-4682-a539-6e4c99e8e807', '104dbf3c-0333-4d52-a391-4ad6aca99dca', '7260f69e-5a8f-4b33-958a-d217b0068409'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:20:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-ae18244c-56c5-4159-9657-90b24784aad3 tempest-VolumesMetadataTest-751758431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:20:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-ae18244c-56c5-4159-9657-90b24784aad3 tempest-VolumesMetadataTest-751758431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:20:52 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-ae18244c-56c5-4159-9657-90b24784aad3 tempest-VolumesMetadataTest-751758431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:20:52 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-ae18244c-56c5-4159-9657-90b24784aad3 tempest-VolumesMetadataTest-751758431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:20:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-ae18244c-56c5-4159-9657-90b24784aad3 tempest-VolumesMetadataTest-751758431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:20:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ae18244c-56c5-4159-9657-90b24784aad3 tempest-VolumesMetadataTest-751758431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:20:52 devstack sudo[103585]: pam_unix(sudo:session): session closed for user root Jul 10 10:20:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-01477fb8-9c6a-4be4-b731-ca668b8b209a tempest-TestStampPattern-1267302871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7f87bb0f-5ab5-4897-939c-fa8c133c13e3.8cd1bd27-cb2e-4e13-be59-884b8826ca0c" returned: 0 in 0.808s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:20:52 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-01477fb8-9c6a-4be4-b731-ca668b8b209a tempest-TestStampPattern-1267302871 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f87bb0f-5ab5-4897-939c-fa8c133c13e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 10:20:52 devstack sudo[103591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:20:52 devstack sudo[103591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:20:52 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[6867248d-ec6b-485c-b2fb-9ab1fe071bfe]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:20:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-01477fb8-9c6a-4be4-b731-ca668b8b209a tempest-TestStampPattern-1267302871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7f87bb0f-5ab5-4897-939c-fa8c133c13e3 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:20:52 devstack sudo[103593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7f87bb0f-5ab5-4897-939c-fa8c133c13e3 Jul 10 10:20:52 devstack sudo[103593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:20:52 devstack sudo[103591]: pam_unix(sudo:session): session closed for user root Jul 10 10:20:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ae18244c-56c5-4159-9657-90b24784aad3 tempest-VolumesMetadataTest-751758431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.657s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:20:52 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-ae18244c-56c5-4159-9657-90b24784aad3 tempest-VolumesMetadataTest-751758431 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:20:52 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-ae18244c-56c5-4159-9657-90b24784aad3 tempest-VolumesMetadataTest-751758431 None] Deleted volume successfully. Jul 10 10:20:52 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-ae18244c-56c5-4159-9657-90b24784aad3 tempest-VolumesMetadataTest-751758431 None] Lock "cinder-95665e6d-16b2-4941-9c22-8e5b9077aa3b-delete_volume" released by "delete_volume" :: held 2.509s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:20:53 devstack sudo[103593]: pam_unix(sudo:session): session closed for user root Jul 10 10:20:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-01477fb8-9c6a-4be4-b731-ca668b8b209a tempest-TestStampPattern-1267302871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7f87bb0f-5ab5-4897-939c-fa8c133c13e3" returned: 0 in 0.845s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:20:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-01477fb8-9c6a-4be4-b731-ca668b8b209a tempest-TestStampPattern-1267302871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7f87bb0f-5ab5-4897-939c-fa8c133c13e3.8cd1bd27-cb2e-4e13-be59-884b8826ca0c {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:20:53 devstack sudo[103599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7f87bb0f-5ab5-4897-939c-fa8c133c13e3.8cd1bd27-cb2e-4e13-be59-884b8826ca0c Jul 10 10:20:53 devstack sudo[103599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:20:53 devstack sudo[103599]: pam_unix(sudo:session): session closed for user root Jul 10 10:20:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-01477fb8-9c6a-4be4-b731-ca668b8b209a tempest-TestStampPattern-1267302871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7f87bb0f-5ab5-4897-939c-fa8c133c13e3.8cd1bd27-cb2e-4e13-be59-884b8826ca0c" returned: 0 in 0.816s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:20:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-01477fb8-9c6a-4be4-b731-ca668b8b209a tempest-TestStampPattern-1267302871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7f87bb0f-5ab5-4897-939c-fa8c133c13e3.8cd1bd27-cb2e-4e13-be59-884b8826ca0c {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:20:53 devstack sudo[103606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7f87bb0f-5ab5-4897-939c-fa8c133c13e3.8cd1bd27-cb2e-4e13-be59-884b8826ca0c Jul 10 10:20:53 devstack sudo[103606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:20:54 devstack sudo[103606]: pam_unix(sudo:session): session closed for user root Jul 10 10:20:54 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-01477fb8-9c6a-4be4-b731-ca668b8b209a tempest-TestStampPattern-1267302871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7f87bb0f-5ab5-4897-939c-fa8c133c13e3.8cd1bd27-cb2e-4e13-be59-884b8826ca0c" returned: 0 in 0.671s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:20:54 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-01477fb8-9c6a-4be4-b731-ca668b8b209a tempest-TestStampPattern-1267302871 None] Lock "cinder-quobyte-8cd1bd27-cb2e-4e13-be59-884b8826ca0c" released by "_delete_snapshot" :: held 3.256s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:20:54 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-01477fb8-9c6a-4be4-b731-ca668b8b209a tempest-TestStampPattern-1267302871 None] Lock "cinder-quobyte-7f87bb0f-5ab5-4897-939c-fa8c133c13e3" released by "delete_snapshot" :: held 3.293s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:20:54 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-01477fb8-9c6a-4be4-b731-ca668b8b209a tempest-TestStampPattern-1267302871 None] Created reservations ['9bfaf97a-942a-4922-984c-265a35ae52ae', '6e295bb2-1b08-4d08-9904-3c315f1c19f9', '0f4ff09a-4b58-4c6c-9bfb-77b84dfe0b41', 'b5abb971-532b-47cc-8c12-c8fa7298b418'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:20:54 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-01477fb8-9c6a-4be4-b731-ca668b8b209a tempest-TestStampPattern-1267302871 None] Delete snapshot completed successfully. Jul 10 10:20:54 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-01477fb8-9c6a-4be4-b731-ca668b8b209a tempest-TestStampPattern-1267302871 None] Lock "cinder-8cd1bd27-cb2e-4e13-be59-884b8826ca0c-delete_snapshot" released by "delete_snapshot" :: held 3.433s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:20:56 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-aabcd007-42d3-47c9-bd03-91f848fab2b0 tempest-VolumesTransfersV357Test-2028358997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:20:56 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-aabcd007-42d3-47c9-bd03-91f848fab2b0 tempest-VolumesTransfersV357Test-2028358997 None] Flow 'volume_create_manager' (955e9eca-8a87-4e33-b187-5d90e27f6bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:20:56 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-aabcd007-42d3-47c9-bd03-91f848fab2b0 tempest-VolumesTransfersV357Test-2028358997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (648f3624-385e-41f3-bcea-ac7fcc9fb1fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:20:56 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-aabcd007-42d3-47c9-bd03-91f848fab2b0 tempest-VolumesTransfersV357Test-2028358997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (648f3624-385e-41f3-bcea-ac7fcc9fb1fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:20:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1903831114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29ecc5f7-e199-4427-972f-1b4b7a6d0a8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06a9e2c8d65848e4b62590d66948c0c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:20:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:20:57Z,use_quota=True,user_id='31cdbaf2e78e48b782d94348010923b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:20:56 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-aabcd007-42d3-47c9-bd03-91f848fab2b0 tempest-VolumesTransfersV357Test-2028358997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b75934b-4717-497e-99da-04b123019ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:20:56 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-aabcd007-42d3-47c9-bd03-91f848fab2b0 tempest-VolumesTransfersV357Test-2028358997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b75934b-4717-497e-99da-04b123019ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:20:56 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-aabcd007-42d3-47c9-bd03-91f848fab2b0 tempest-VolumesTransfersV357Test-2028358997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb1db239-0eed-47c6-97de-c21d2142c62e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:20:56 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-aabcd007-42d3-47c9-bd03-91f848fab2b0 tempest-VolumesTransfersV357Test-2028358997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb1db239-0eed-47c6-97de-c21d2142c62e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29ecc5f7-e199-4427-972f-1b4b7a6d0a8c', 'volume_name': 'volume-29ecc5f7-e199-4427-972f-1b4b7a6d0a8c', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:20:56 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-aabcd007-42d3-47c9-bd03-91f848fab2b0 tempest-VolumesTransfersV357Test-2028358997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2b643f2-5966-41f8-a9f2-6a3d40cf94ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:20:56 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-aabcd007-42d3-47c9-bd03-91f848fab2b0 tempest-VolumesTransfersV357Test-2028358997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2b643f2-5966-41f8-a9f2-6a3d40cf94ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:20:56 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-aabcd007-42d3-47c9-bd03-91f848fab2b0 tempest-VolumesTransfersV357Test-2028358997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4418fbed-a65f-427c-b36c-4e11092e1d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:20:56 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-aabcd007-42d3-47c9-bd03-91f848fab2b0 tempest-VolumesTransfersV357Test-2028358997 None] Volume 29ecc5f7-e199-4427-972f-1b4b7a6d0a8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29ecc5f7-e199-4427-972f-1b4b7a6d0a8c', 'volume_size': 1} Jul 10 10:20:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-aabcd007-42d3-47c9-bd03-91f848fab2b0 tempest-VolumesTransfersV357Test-2028358997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:20:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-aabcd007-42d3-47c9-bd03-91f848fab2b0 tempest-VolumesTransfersV357Test-2028358997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:20:56 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-aabcd007-42d3-47c9-bd03-91f848fab2b0 tempest-VolumesTransfersV357Test-2028358997 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:20:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1903831114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29ecc5f7-e199-4427-972f-1b4b7a6d0a8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06a9e2c8d65848e4b62590d66948c0c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:20:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:20:57Z,use_quota=True,user_id='31cdbaf2e78e48b782d94348010923b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:20:56 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-aabcd007-42d3-47c9-bd03-91f848fab2b0 tempest-VolumesTransfersV357Test-2028358997 None] Creating volume 29ecc5f7-e199-4427-972f-1b4b7a6d0a8c {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:20:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-aabcd007-42d3-47c9-bd03-91f848fab2b0 tempest-VolumesTransfersV357Test-2028358997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:20:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-aabcd007-42d3-47c9-bd03-91f848fab2b0 tempest-VolumesTransfersV357Test-2028358997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:20:56 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-aabcd007-42d3-47c9-bd03-91f848fab2b0 tempest-VolumesTransfersV357Test-2028358997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:20:57 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-aabcd007-42d3-47c9-bd03-91f848fab2b0 tempest-VolumesTransfersV357Test-2028358997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:20:57 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-aabcd007-42d3-47c9-bd03-91f848fab2b0 tempest-VolumesTransfersV357Test-2028358997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:20:57 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-aabcd007-42d3-47c9-bd03-91f848fab2b0 tempest-VolumesTransfersV357Test-2028358997 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:20:57 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-aabcd007-42d3-47c9-bd03-91f848fab2b0 tempest-VolumesTransfersV357Test-2028358997 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:20:57 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-aabcd007-42d3-47c9-bd03-91f848fab2b0 tempest-VolumesTransfersV357Test-2028358997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-29ecc5f7-e199-4427-972f-1b4b7a6d0a8c 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:20:57 devstack sudo[103611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-29ecc5f7-e199-4427-972f-1b4b7a6d0a8c 1073741824 Jul 10 10:20:57 devstack sudo[103611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:20:57 devstack sudo[103611]: pam_unix(sudo:session): session closed for user root Jul 10 10:20:57 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-aabcd007-42d3-47c9-bd03-91f848fab2b0 tempest-VolumesTransfersV357Test-2028358997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-29ecc5f7-e199-4427-972f-1b4b7a6d0a8c 1073741824" returned: 0 in 0.878s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:20:57 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-aabcd007-42d3-47c9-bd03-91f848fab2b0 tempest-VolumesTransfersV357Test-2028358997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-29ecc5f7-e199-4427-972f-1b4b7a6d0a8c {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:20:57 devstack sudo[103625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-29ecc5f7-e199-4427-972f-1b4b7a6d0a8c Jul 10 10:20:57 devstack sudo[103625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:20:58 devstack sudo[103625]: pam_unix(sudo:session): session closed for user root Jul 10 10:20:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-aabcd007-42d3-47c9-bd03-91f848fab2b0 tempest-VolumesTransfersV357Test-2028358997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-29ecc5f7-e199-4427-972f-1b4b7a6d0a8c" returned: 0 in 0.762s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:20:58 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-aabcd007-42d3-47c9-bd03-91f848fab2b0 tempest-VolumesTransfersV357Test-2028358997 None] <== create_volume: return (1683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:20:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-aabcd007-42d3-47c9-bd03-91f848fab2b0 tempest-VolumesTransfersV357Test-2028358997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.687s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:20:58 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-aabcd007-42d3-47c9-bd03-91f848fab2b0 tempest-VolumesTransfersV357Test-2028358997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4418fbed-a65f-427c-b36c-4e11092e1d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29ecc5f7-e199-4427-972f-1b4b7a6d0a8c', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:20:58 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-aabcd007-42d3-47c9-bd03-91f848fab2b0 tempest-VolumesTransfersV357Test-2028358997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3130214-c997-406c-85dd-bf8e895a8205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:20:58 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-aabcd007-42d3-47c9-bd03-91f848fab2b0 tempest-VolumesTransfersV357Test-2028358997 None] Volume volume-29ecc5f7-e199-4427-972f-1b4b7a6d0a8c (29ecc5f7-e199-4427-972f-1b4b7a6d0a8c): created successfully Jul 10 10:20:58 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-aabcd007-42d3-47c9-bd03-91f848fab2b0 tempest-VolumesTransfersV357Test-2028358997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3130214-c997-406c-85dd-bf8e895a8205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:20:58 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-aabcd007-42d3-47c9-bd03-91f848fab2b0 tempest-VolumesTransfersV357Test-2028358997 None] Flow 'volume_create_manager' (955e9eca-8a87-4e33-b187-5d90e27f6bf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:20:58 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-aabcd007-42d3-47c9-bd03-91f848fab2b0 tempest-VolumesTransfersV357Test-2028358997 None] Created volume successfully. Jul 10 10:20:59 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-13c77d9a-3d8e-4377-91f7-dc81efb8310d tempest-VolumesTransfersV357Test-180294813 None] Transfer volume completed successfully. Jul 10 10:21:00 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-5ae2c4a0-5890-4213-9cbf-00556d353890 tempest-VolumesTransfersV357Test-921460283 None] Acquiring lock "cinder-29ecc5f7-e199-4427-972f-1b4b7a6d0a8c-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:21:00 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-5ae2c4a0-5890-4213-9cbf-00556d353890 tempest-VolumesTransfersV357Test-921460283 None] Lock "cinder-29ecc5f7-e199-4427-972f-1b4b7a6d0a8c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:21:00 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-5ae2c4a0-5890-4213-9cbf-00556d353890 tempest-VolumesTransfersV357Test-921460283 None] Acquiring lock "cinder-quobyte-29ecc5f7-e199-4427-972f-1b4b7a6d0a8c" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:21:00 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-5ae2c4a0-5890-4213-9cbf-00556d353890 tempest-VolumesTransfersV357Test-921460283 None] Lock "cinder-quobyte-29ecc5f7-e199-4427-972f-1b4b7a6d0a8c" acquired by "delete_volume" :: waited 0.014s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:21:00 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c04ebd-6e4d-419a-a22a-596764b8d212]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:21:00 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5ae2c4a0-5890-4213-9cbf-00556d353890 tempest-VolumesTransfersV357Test-921460283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-29ecc5f7-e199-4427-972f-1b4b7a6d0a8c {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:21:00 devstack sudo[103646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-29ecc5f7-e199-4427-972f-1b4b7a6d0a8c Jul 10 10:21:00 devstack sudo[103646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:21:01 devstack sudo[103646]: pam_unix(sudo:session): session closed for user root Jul 10 10:21:01 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5ae2c4a0-5890-4213-9cbf-00556d353890 tempest-VolumesTransfersV357Test-921460283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-29ecc5f7-e199-4427-972f-1b4b7a6d0a8c" returned: 0 in 0.776s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:21:01 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5ae2c4a0-5890-4213-9cbf-00556d353890 tempest-VolumesTransfersV357Test-921460283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-29ecc5f7-e199-4427-972f-1b4b7a6d0a8c {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:21:01 devstack sudo[103651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-29ecc5f7-e199-4427-972f-1b4b7a6d0a8c Jul 10 10:21:01 devstack sudo[103651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:21:02 devstack sudo[103651]: pam_unix(sudo:session): session closed for user root Jul 10 10:21:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5ae2c4a0-5890-4213-9cbf-00556d353890 tempest-VolumesTransfersV357Test-921460283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-29ecc5f7-e199-4427-972f-1b4b7a6d0a8c" returned: 0 in 0.657s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:21:02 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-5ae2c4a0-5890-4213-9cbf-00556d353890 tempest-VolumesTransfersV357Test-921460283 None] Lock "cinder-quobyte-29ecc5f7-e199-4427-972f-1b4b7a6d0a8c" released by "delete_volume" :: held 1.476s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:21:02 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-5ae2c4a0-5890-4213-9cbf-00556d353890 tempest-VolumesTransfersV357Test-921460283 None] Created reservations ['41b961fa-3fe5-4443-a3ca-1b8544ec5306', 'ae249d8d-bfb8-4b4e-9399-8b60ecaa40ad', 'ad2d87ab-268a-45ab-b18a-53d94136c2e0', '37cb71a5-c109-457b-934c-e0bc57c85d7f'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:21:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-5ae2c4a0-5890-4213-9cbf-00556d353890 tempest-VolumesTransfersV357Test-921460283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:21:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-5ae2c4a0-5890-4213-9cbf-00556d353890 tempest-VolumesTransfersV357Test-921460283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:21:02 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-5ae2c4a0-5890-4213-9cbf-00556d353890 tempest-VolumesTransfersV357Test-921460283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:21:02 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-5ae2c4a0-5890-4213-9cbf-00556d353890 tempest-VolumesTransfersV357Test-921460283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:21:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-5ae2c4a0-5890-4213-9cbf-00556d353890 tempest-VolumesTransfersV357Test-921460283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:21:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5ae2c4a0-5890-4213-9cbf-00556d353890 tempest-VolumesTransfersV357Test-921460283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:21:02 devstack sudo[103656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:21:02 devstack sudo[103656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:21:02 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-558eedb1-f9ee-4782-8eb2-f37c24f6afff tempest-TestStampPattern-1267302871 None] Acquiring lock "cinder-7f87bb0f-5ab5-4897-939c-fa8c133c13e3-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:21:02 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-558eedb1-f9ee-4782-8eb2-f37c24f6afff tempest-TestStampPattern-1267302871 None] Lock "cinder-7f87bb0f-5ab5-4897-939c-fa8c133c13e3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:21:02 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-558eedb1-f9ee-4782-8eb2-f37c24f6afff tempest-TestStampPattern-1267302871 None] Acquiring lock "cinder-quobyte-7f87bb0f-5ab5-4897-939c-fa8c133c13e3" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:21:02 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-558eedb1-f9ee-4782-8eb2-f37c24f6afff tempest-TestStampPattern-1267302871 None] Lock "cinder-quobyte-7f87bb0f-5ab5-4897-939c-fa8c133c13e3" acquired by "delete_volume" :: waited 0.019s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:21:02 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc87a2c6-61a3-4f8c-8c9b-7b9b025593ea]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:21:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-558eedb1-f9ee-4782-8eb2-f37c24f6afff tempest-TestStampPattern-1267302871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7f87bb0f-5ab5-4897-939c-fa8c133c13e3 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:21:02 devstack sudo[103656]: pam_unix(sudo:session): session closed for user root Jul 10 10:21:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5ae2c4a0-5890-4213-9cbf-00556d353890 tempest-VolumesTransfersV357Test-921460283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.674s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:21:02 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-5ae2c4a0-5890-4213-9cbf-00556d353890 tempest-VolumesTransfersV357Test-921460283 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:21:02 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-5ae2c4a0-5890-4213-9cbf-00556d353890 tempest-VolumesTransfersV357Test-921460283 None] Deleted volume successfully. Jul 10 10:21:02 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-5ae2c4a0-5890-4213-9cbf-00556d353890 tempest-VolumesTransfersV357Test-921460283 None] Lock "cinder-29ecc5f7-e199-4427-972f-1b4b7a6d0a8c-delete_volume" released by "delete_volume" :: held 2.348s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:21:02 devstack sudo[103659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7f87bb0f-5ab5-4897-939c-fa8c133c13e3 Jul 10 10:21:02 devstack sudo[103659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:21:03 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e037d20-fb98-4f35-a8a0-6d172f9aa62b tempest-VolumesTransfersV357Test-2028358997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:21:03 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4e037d20-fb98-4f35-a8a0-6d172f9aa62b tempest-VolumesTransfersV357Test-2028358997 None] Flow 'volume_create_manager' (2bf0ac38-9a91-4a7f-8c17-b9b2d8cfcd71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:21:03 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4e037d20-fb98-4f35-a8a0-6d172f9aa62b tempest-VolumesTransfersV357Test-2028358997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79301f6f-99e6-49e3-96fa-440ae26d02f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:21:03 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4e037d20-fb98-4f35-a8a0-6d172f9aa62b tempest-VolumesTransfersV357Test-2028358997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79301f6f-99e6-49e3-96fa-440ae26d02f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:21:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1360817720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c99e85ff-4dc0-4e20-aacf-a76b5c97712e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06a9e2c8d65848e4b62590d66948c0c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:21:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:21:03Z,use_quota=True,user_id='31cdbaf2e78e48b782d94348010923b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:21:03 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4e037d20-fb98-4f35-a8a0-6d172f9aa62b tempest-VolumesTransfersV357Test-2028358997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d1d1bb6-1bb8-4606-8d92-37893daeac08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:21:03 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4e037d20-fb98-4f35-a8a0-6d172f9aa62b tempest-VolumesTransfersV357Test-2028358997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d1d1bb6-1bb8-4606-8d92-37893daeac08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:21:03 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4e037d20-fb98-4f35-a8a0-6d172f9aa62b tempest-VolumesTransfersV357Test-2028358997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fde3aba0-3532-47fe-b9cc-f40b0473111f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:21:03 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4e037d20-fb98-4f35-a8a0-6d172f9aa62b tempest-VolumesTransfersV357Test-2028358997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fde3aba0-3532-47fe-b9cc-f40b0473111f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c99e85ff-4dc0-4e20-aacf-a76b5c97712e', 'volume_name': 'volume-c99e85ff-4dc0-4e20-aacf-a76b5c97712e', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:21:03 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4e037d20-fb98-4f35-a8a0-6d172f9aa62b tempest-VolumesTransfersV357Test-2028358997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a47867e6-6c91-4856-b2e3-ad7f11e65292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:21:03 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4e037d20-fb98-4f35-a8a0-6d172f9aa62b tempest-VolumesTransfersV357Test-2028358997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a47867e6-6c91-4856-b2e3-ad7f11e65292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:21:03 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4e037d20-fb98-4f35-a8a0-6d172f9aa62b tempest-VolumesTransfersV357Test-2028358997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1ec13ad-2c67-455f-b92c-ae6af845e62a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:21:03 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-4e037d20-fb98-4f35-a8a0-6d172f9aa62b tempest-VolumesTransfersV357Test-2028358997 None] Volume c99e85ff-4dc0-4e20-aacf-a76b5c97712e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c99e85ff-4dc0-4e20-aacf-a76b5c97712e', 'volume_size': 1} Jul 10 10:21:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-4e037d20-fb98-4f35-a8a0-6d172f9aa62b tempest-VolumesTransfersV357Test-2028358997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:21:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-4e037d20-fb98-4f35-a8a0-6d172f9aa62b tempest-VolumesTransfersV357Test-2028358997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:21:03 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-4e037d20-fb98-4f35-a8a0-6d172f9aa62b tempest-VolumesTransfersV357Test-2028358997 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:21:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1360817720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c99e85ff-4dc0-4e20-aacf-a76b5c97712e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06a9e2c8d65848e4b62590d66948c0c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:21:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:21:03Z,use_quota=True,user_id='31cdbaf2e78e48b782d94348010923b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:21:03 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-4e037d20-fb98-4f35-a8a0-6d172f9aa62b tempest-VolumesTransfersV357Test-2028358997 None] Creating volume c99e85ff-4dc0-4e20-aacf-a76b5c97712e {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:21:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-4e037d20-fb98-4f35-a8a0-6d172f9aa62b tempest-VolumesTransfersV357Test-2028358997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:21:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-4e037d20-fb98-4f35-a8a0-6d172f9aa62b tempest-VolumesTransfersV357Test-2028358997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:21:03 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-4e037d20-fb98-4f35-a8a0-6d172f9aa62b tempest-VolumesTransfersV357Test-2028358997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:21:03 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-4e037d20-fb98-4f35-a8a0-6d172f9aa62b tempest-VolumesTransfersV357Test-2028358997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:21:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-4e037d20-fb98-4f35-a8a0-6d172f9aa62b tempest-VolumesTransfersV357Test-2028358997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:21:03 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-4e037d20-fb98-4f35-a8a0-6d172f9aa62b tempest-VolumesTransfersV357Test-2028358997 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:21:03 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-4e037d20-fb98-4f35-a8a0-6d172f9aa62b tempest-VolumesTransfersV357Test-2028358997 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:21:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4e037d20-fb98-4f35-a8a0-6d172f9aa62b tempest-VolumesTransfersV357Test-2028358997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c99e85ff-4dc0-4e20-aacf-a76b5c97712e 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:21:03 devstack sudo[103662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c99e85ff-4dc0-4e20-aacf-a76b5c97712e 1073741824 Jul 10 10:21:03 devstack sudo[103662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:21:03 devstack sudo[103659]: pam_unix(sudo:session): session closed for user root Jul 10 10:21:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-558eedb1-f9ee-4782-8eb2-f37c24f6afff tempest-TestStampPattern-1267302871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7f87bb0f-5ab5-4897-939c-fa8c133c13e3" returned: 0 in 0.839s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:21:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-558eedb1-f9ee-4782-8eb2-f37c24f6afff tempest-TestStampPattern-1267302871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7f87bb0f-5ab5-4897-939c-fa8c133c13e3 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:21:03 devstack sudo[103666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7f87bb0f-5ab5-4897-939c-fa8c133c13e3 Jul 10 10:21:03 devstack sudo[103666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:21:04 devstack sudo[103666]: pam_unix(sudo:session): session closed for user root Jul 10 10:21:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-558eedb1-f9ee-4782-8eb2-f37c24f6afff tempest-TestStampPattern-1267302871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7f87bb0f-5ab5-4897-939c-fa8c133c13e3" returned: 0 in 0.701s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:21:04 devstack sudo[103662]: pam_unix(sudo:session): session closed for user root Jul 10 10:21:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4e037d20-fb98-4f35-a8a0-6d172f9aa62b tempest-VolumesTransfersV357Test-2028358997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c99e85ff-4dc0-4e20-aacf-a76b5c97712e 1073741824" returned: 0 in 0.888s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:21:04 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-558eedb1-f9ee-4782-8eb2-f37c24f6afff tempest-TestStampPattern-1267302871 None] Lock "cinder-quobyte-7f87bb0f-5ab5-4897-939c-fa8c133c13e3" released by "delete_volume" :: held 1.633s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:21:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4e037d20-fb98-4f35-a8a0-6d172f9aa62b tempest-VolumesTransfersV357Test-2028358997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c99e85ff-4dc0-4e20-aacf-a76b5c97712e {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:21:04 devstack sudo[103672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c99e85ff-4dc0-4e20-aacf-a76b5c97712e Jul 10 10:21:04 devstack sudo[103672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:21:04 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-558eedb1-f9ee-4782-8eb2-f37c24f6afff tempest-TestStampPattern-1267302871 None] Created reservations ['cbbb6d86-9ba9-4fbc-8d9e-10c2efa10bdc', '7fe8f125-86c6-48dd-bc5f-ed0ca83f570d', '3acb2dd2-4ddb-4aca-a8b7-9de1b4ba8fbf', '91d7fe40-0e25-4279-b977-275e82818697'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:21:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-558eedb1-f9ee-4782-8eb2-f37c24f6afff tempest-TestStampPattern-1267302871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:21:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-558eedb1-f9ee-4782-8eb2-f37c24f6afff tempest-TestStampPattern-1267302871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:21:04 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-558eedb1-f9ee-4782-8eb2-f37c24f6afff tempest-TestStampPattern-1267302871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:21:04 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-558eedb1-f9ee-4782-8eb2-f37c24f6afff tempest-TestStampPattern-1267302871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:21:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-558eedb1-f9ee-4782-8eb2-f37c24f6afff tempest-TestStampPattern-1267302871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:21:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-558eedb1-f9ee-4782-8eb2-f37c24f6afff tempest-TestStampPattern-1267302871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:21:04 devstack sudo[103674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:21:04 devstack sudo[103674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:21:05 devstack sudo[103672]: pam_unix(sudo:session): session closed for user root Jul 10 10:21:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4e037d20-fb98-4f35-a8a0-6d172f9aa62b tempest-VolumesTransfersV357Test-2028358997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c99e85ff-4dc0-4e20-aacf-a76b5c97712e" returned: 0 in 0.702s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:21:05 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-4e037d20-fb98-4f35-a8a0-6d172f9aa62b tempest-VolumesTransfersV357Test-2028358997 None] <== create_volume: return (1649ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:21:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-4e037d20-fb98-4f35-a8a0-6d172f9aa62b tempest-VolumesTransfersV357Test-2028358997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.651s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:21:05 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4e037d20-fb98-4f35-a8a0-6d172f9aa62b tempest-VolumesTransfersV357Test-2028358997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1ec13ad-2c67-455f-b92c-ae6af845e62a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c99e85ff-4dc0-4e20-aacf-a76b5c97712e', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:21:05 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4e037d20-fb98-4f35-a8a0-6d172f9aa62b tempest-VolumesTransfersV357Test-2028358997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9b822c1-6f42-4831-b06a-356045fc5b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:21:05 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-4e037d20-fb98-4f35-a8a0-6d172f9aa62b tempest-VolumesTransfersV357Test-2028358997 None] Volume volume-c99e85ff-4dc0-4e20-aacf-a76b5c97712e (c99e85ff-4dc0-4e20-aacf-a76b5c97712e): created successfully Jul 10 10:21:05 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4e037d20-fb98-4f35-a8a0-6d172f9aa62b tempest-VolumesTransfersV357Test-2028358997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9b822c1-6f42-4831-b06a-356045fc5b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:21:05 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4e037d20-fb98-4f35-a8a0-6d172f9aa62b tempest-VolumesTransfersV357Test-2028358997 None] Flow 'volume_create_manager' (2bf0ac38-9a91-4a7f-8c17-b9b2d8cfcd71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:21:05 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-4e037d20-fb98-4f35-a8a0-6d172f9aa62b tempest-VolumesTransfersV357Test-2028358997 None] Created volume successfully. Jul 10 10:21:05 devstack sudo[103674]: pam_unix(sudo:session): session closed for user root Jul 10 10:21:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-558eedb1-f9ee-4782-8eb2-f37c24f6afff tempest-TestStampPattern-1267302871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.710s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:21:05 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-558eedb1-f9ee-4782-8eb2-f37c24f6afff tempest-TestStampPattern-1267302871 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:21:05 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-558eedb1-f9ee-4782-8eb2-f37c24f6afff tempest-TestStampPattern-1267302871 None] Deleted volume successfully. Jul 10 10:21:05 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-558eedb1-f9ee-4782-8eb2-f37c24f6afff tempest-TestStampPattern-1267302871 None] Lock "cinder-7f87bb0f-5ab5-4897-939c-fa8c133c13e3-delete_volume" released by "delete_volume" :: held 2.588s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:21:05 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-3327d1e7-c392-4884-8310-47325bc9a249 tempest-VolumesTransfersV357Test-921460283 None] Acquiring lock "cinder-c99e85ff-4dc0-4e20-aacf-a76b5c97712e-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:21:05 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-3327d1e7-c392-4884-8310-47325bc9a249 tempest-VolumesTransfersV357Test-921460283 None] Lock "cinder-c99e85ff-4dc0-4e20-aacf-a76b5c97712e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:21:05 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-3327d1e7-c392-4884-8310-47325bc9a249 tempest-VolumesTransfersV357Test-921460283 None] Acquiring lock "cinder-quobyte-c99e85ff-4dc0-4e20-aacf-a76b5c97712e" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:21:05 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-3327d1e7-c392-4884-8310-47325bc9a249 tempest-VolumesTransfersV357Test-921460283 None] Lock "cinder-quobyte-c99e85ff-4dc0-4e20-aacf-a76b5c97712e" acquired by "delete_volume" :: waited 0.017s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:21:05 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae424a72-8b3b-4b73-b1dc-7ac1f4ac0600]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:21:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3327d1e7-c392-4884-8310-47325bc9a249 tempest-VolumesTransfersV357Test-921460283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c99e85ff-4dc0-4e20-aacf-a76b5c97712e {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:21:06 devstack sudo[103678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c99e85ff-4dc0-4e20-aacf-a76b5c97712e Jul 10 10:21:06 devstack sudo[103678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:21:06 devstack sudo[103678]: pam_unix(sudo:session): session closed for user root Jul 10 10:21:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3327d1e7-c392-4884-8310-47325bc9a249 tempest-VolumesTransfersV357Test-921460283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c99e85ff-4dc0-4e20-aacf-a76b5c97712e" returned: 0 in 0.792s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:21:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3327d1e7-c392-4884-8310-47325bc9a249 tempest-VolumesTransfersV357Test-921460283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c99e85ff-4dc0-4e20-aacf-a76b5c97712e {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:21:06 devstack sudo[103684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c99e85ff-4dc0-4e20-aacf-a76b5c97712e Jul 10 10:21:06 devstack sudo[103684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:21:07 devstack sudo[103684]: pam_unix(sudo:session): session closed for user root Jul 10 10:21:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3327d1e7-c392-4884-8310-47325bc9a249 tempest-VolumesTransfersV357Test-921460283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c99e85ff-4dc0-4e20-aacf-a76b5c97712e" returned: 0 in 0.738s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:21:07 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-3327d1e7-c392-4884-8310-47325bc9a249 tempest-VolumesTransfersV357Test-921460283 None] Lock "cinder-quobyte-c99e85ff-4dc0-4e20-aacf-a76b5c97712e" released by "delete_volume" :: held 1.583s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:21:07 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-3327d1e7-c392-4884-8310-47325bc9a249 tempest-VolumesTransfersV357Test-921460283 None] Created reservations ['e58ad4eb-fbe2-4d47-ac61-85f4c3c4205b', '844faa3e-1ca9-420d-924c-0fa00bec42b3', 'c4fbc349-e90d-45c6-936f-38bf4a7917d2', '202bcf89-7d4e-4a63-8c52-6a5f38d211e5'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:21:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-3327d1e7-c392-4884-8310-47325bc9a249 tempest-VolumesTransfersV357Test-921460283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:21:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-3327d1e7-c392-4884-8310-47325bc9a249 tempest-VolumesTransfersV357Test-921460283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:21:07 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-3327d1e7-c392-4884-8310-47325bc9a249 tempest-VolumesTransfersV357Test-921460283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:21:07 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-3327d1e7-c392-4884-8310-47325bc9a249 tempest-VolumesTransfersV357Test-921460283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:21:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-3327d1e7-c392-4884-8310-47325bc9a249 tempest-VolumesTransfersV357Test-921460283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:21:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3327d1e7-c392-4884-8310-47325bc9a249 tempest-VolumesTransfersV357Test-921460283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:21:07 devstack sudo[103688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:21:07 devstack sudo[103688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:21:08 devstack sudo[103688]: pam_unix(sudo:session): session closed for user root Jul 10 10:21:08 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3327d1e7-c392-4884-8310-47325bc9a249 tempest-VolumesTransfersV357Test-921460283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.740s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:21:08 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-3327d1e7-c392-4884-8310-47325bc9a249 tempest-VolumesTransfersV357Test-921460283 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:21:08 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-3327d1e7-c392-4884-8310-47325bc9a249 tempest-VolumesTransfersV357Test-921460283 None] Deleted volume successfully. Jul 10 10:21:08 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-3327d1e7-c392-4884-8310-47325bc9a249 tempest-VolumesTransfersV357Test-921460283 None] Lock "cinder-c99e85ff-4dc0-4e20-aacf-a76b5c97712e-delete_volume" released by "delete_volume" :: held 2.595s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:21:14 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba86d02f-5d20-43dd-8ee0-7a57147e6db3 tempest-VolumesExtendTest-1439417629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:21:14 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ba86d02f-5d20-43dd-8ee0-7a57147e6db3 tempest-VolumesExtendTest-1439417629 None] Flow 'volume_create_manager' (583f08cf-c009-4ba7-9415-48c963c8ade3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:21:14 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ba86d02f-5d20-43dd-8ee0-7a57147e6db3 tempest-VolumesExtendTest-1439417629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2223e3f-9048-4481-8262-c66da7e0fe08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:21:14 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ba86d02f-5d20-43dd-8ee0-7a57147e6db3 tempest-VolumesExtendTest-1439417629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2223e3f-9048-4481-8262-c66da7e0fe08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:21:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-519258600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ed580d5-34de-4a4c-b2b5-2be53f1a349a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3f33e86b0fd4d9b808d2e8a266f0aee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:21:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:21:14Z,use_quota=True,user_id='06b75b2ad1df42caa1ed96400a3f1ebf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:21:14 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ba86d02f-5d20-43dd-8ee0-7a57147e6db3 tempest-VolumesExtendTest-1439417629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc2efe38-5a86-4b85-92f7-94e0513d6c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:21:14 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ba86d02f-5d20-43dd-8ee0-7a57147e6db3 tempest-VolumesExtendTest-1439417629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc2efe38-5a86-4b85-92f7-94e0513d6c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:21:14 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ba86d02f-5d20-43dd-8ee0-7a57147e6db3 tempest-VolumesExtendTest-1439417629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5834821-ab70-463c-a73b-e040f4944351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:21:14 devstack cinder-volume[87234]: DEBUG cinder.image.glance [None req-ba86d02f-5d20-43dd-8ee0-7a57147e6db3 tempest-VolumesExtendTest-1439417629 None] Creating Keystone auth plugin from conf {{(pid=87234) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 10:21:14 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ba86d02f-5d20-43dd-8ee0-7a57147e6db3 tempest-VolumesExtendTest-1439417629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5834821-ab70-463c-a73b-e040f4944351) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2ed580d5-34de-4a4c-b2b5-2be53f1a349a', 'volume_name': 'volume-2ed580d5-34de-4a4c-b2b5-2be53f1a349a', 'volume_size': 1, 'image_id': '57b49355-8d23-4892-9d66-30ed6d4bc3c1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/57b49355-8d23-4892-9d66-30ed6d4bc3c1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd8e6341302c8449397efca0eea68956a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '57b49355-8d23-4892-9d66-30ed6d4bc3c1', 'created_at': datetime.datetime(2026, 7, 10, 7, 56, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 7, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/57b49355-8d23-4892-9d66-30ed6d4bc3c1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:21:14 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ba86d02f-5d20-43dd-8ee0-7a57147e6db3 tempest-VolumesExtendTest-1439417629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91de8e5e-cbd1-4613-b6f8-c213d43b2299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:21:14 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ba86d02f-5d20-43dd-8ee0-7a57147e6db3 tempest-VolumesExtendTest-1439417629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91de8e5e-cbd1-4613-b6f8-c213d43b2299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:21:14 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ba86d02f-5d20-43dd-8ee0-7a57147e6db3 tempest-VolumesExtendTest-1439417629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9acb76d-3558-4da2-bf34-e3da740adde1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:21:14 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-ba86d02f-5d20-43dd-8ee0-7a57147e6db3 tempest-VolumesExtendTest-1439417629 None] Volume 2ed580d5-34de-4a4c-b2b5-2be53f1a349a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2ed580d5-34de-4a4c-b2b5-2be53f1a349a', 'volume_size': 1, 'image_id': '57b49355-8d23-4892-9d66-30ed6d4bc3c1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/57b49355-8d23-4892-9d66-30ed6d4bc3c1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd8e6341302c8449397efca0eea68956a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '57b49355-8d23-4892-9d66-30ed6d4bc3c1', 'created_at': datetime.datetime(2026, 7, 10, 7, 56, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 7, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/57b49355-8d23-4892-9d66-30ed6d4bc3c1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 10 10:21:14 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba86d02f-5d20-43dd-8ee0-7a57147e6db3 tempest-VolumesExtendTest-1439417629 None] Trying to clone 2ed580d5-34de-4a4c-b2b5-2be53f1a349a from image 57b49355-8d23-4892-9d66-30ed6d4bc3c1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/57b49355-8d23-4892-9d66-30ed6d4bc3c1', 'metadata': {}}]). {{(pid=87234) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 10:21:15 devstack cinder-volume[87234]: DEBUG cinder.image.image_utils [None req-ba86d02f-5d20-43dd-8ee0-7a57147e6db3 tempest-VolumesExtendTest-1439417629 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_57b49355-8d23-4892-9d66-30ed6d4bc3c1_lfg48dkodevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87234) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 10:21:15 devstack cinder-volume[87234]: INFO cinder.image.image_utils [None req-ba86d02f-5d20-43dd-8ee0-7a57147e6db3 tempest-VolumesExtendTest-1439417629 None] Image download 20.69 MB at 20.69 MB/s Jul 10 10:21:15 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1d5fad-d862-4a76-9e1e-7d92a6338cff]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:21:15 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ba86d02f-5d20-43dd-8ee0-7a57147e6db3 tempest-VolumesExtendTest-1439417629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57b49355-8d23-4892-9d66-30ed6d4bc3c1_lfg48dkodevstack@QuobyteHD {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:21:15 devstack sudo[103696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57b49355-8d23-4892-9d66-30ed6d4bc3c1_lfg48dkodevstack@QuobyteHD Jul 10 10:21:15 devstack sudo[103696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:21:15 devstack sudo[103696]: pam_unix(sudo:session): session closed for user root Jul 10 10:21:15 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ba86d02f-5d20-43dd-8ee0-7a57147e6db3 tempest-VolumesExtendTest-1439417629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57b49355-8d23-4892-9d66-30ed6d4bc3c1_lfg48dkodevstack@QuobyteHD" returned: 0 in 0.769s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:21:15 devstack cinder-volume[87234]: DEBUG cinder.image.image_utils [None req-ba86d02f-5d20-43dd-8ee0-7a57147e6db3 tempest-VolumesExtendTest-1439417629 None] Temporary image 57b49355-8d23-4892-9d66-30ed6d4bc3c1 is fetched for user 06b75b2ad1df42caa1ed96400a3f1ebf. {{(pid=87234) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 10:21:15 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[d51e6a1b-45c0-4408-958d-224a0930c832]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:21:15 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ba86d02f-5d20-43dd-8ee0-7a57147e6db3 tempest-VolumesExtendTest-1439417629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57b49355-8d23-4892-9d66-30ed6d4bc3c1_lfg48dkodevstack@QuobyteHD {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:21:16 devstack sudo[103701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57b49355-8d23-4892-9d66-30ed6d4bc3c1_lfg48dkodevstack@QuobyteHD Jul 10 10:21:16 devstack sudo[103701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:21:16 devstack sudo[103701]: pam_unix(sudo:session): session closed for user root Jul 10 10:21:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ba86d02f-5d20-43dd-8ee0-7a57147e6db3 tempest-VolumesExtendTest-1439417629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57b49355-8d23-4892-9d66-30ed6d4bc3c1_lfg48dkodevstack@QuobyteHD" returned: 0 in 0.750s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:21:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-ba86d02f-5d20-43dd-8ee0-7a57147e6db3 tempest-VolumesExtendTest-1439417629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:21:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-ba86d02f-5d20-43dd-8ee0-7a57147e6db3 tempest-VolumesExtendTest-1439417629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:21:16 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-ba86d02f-5d20-43dd-8ee0-7a57147e6db3 tempest-VolumesExtendTest-1439417629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:21:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-519258600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ed580d5-34de-4a4c-b2b5-2be53f1a349a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3f33e86b0fd4d9b808d2e8a266f0aee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:21:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:21:14Z,use_quota=True,user_id='06b75b2ad1df42caa1ed96400a3f1ebf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:21:16 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-ba86d02f-5d20-43dd-8ee0-7a57147e6db3 tempest-VolumesExtendTest-1439417629 None] Creating volume 2ed580d5-34de-4a4c-b2b5-2be53f1a349a {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:21:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-ba86d02f-5d20-43dd-8ee0-7a57147e6db3 tempest-VolumesExtendTest-1439417629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:21:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-ba86d02f-5d20-43dd-8ee0-7a57147e6db3 tempest-VolumesExtendTest-1439417629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:21:16 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-ba86d02f-5d20-43dd-8ee0-7a57147e6db3 tempest-VolumesExtendTest-1439417629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:21:16 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-ba86d02f-5d20-43dd-8ee0-7a57147e6db3 tempest-VolumesExtendTest-1439417629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:21:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-ba86d02f-5d20-43dd-8ee0-7a57147e6db3 tempest-VolumesExtendTest-1439417629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:21:16 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-ba86d02f-5d20-43dd-8ee0-7a57147e6db3 tempest-VolumesExtendTest-1439417629 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:21:16 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-ba86d02f-5d20-43dd-8ee0-7a57147e6db3 tempest-VolumesExtendTest-1439417629 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:21:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ba86d02f-5d20-43dd-8ee0-7a57147e6db3 tempest-VolumesExtendTest-1439417629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2ed580d5-34de-4a4c-b2b5-2be53f1a349a 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:21:16 devstack sudo[103706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2ed580d5-34de-4a4c-b2b5-2be53f1a349a 1073741824 Jul 10 10:21:16 devstack sudo[103706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:21:17 devstack sudo[103706]: pam_unix(sudo:session): session closed for user root Jul 10 10:21:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ba86d02f-5d20-43dd-8ee0-7a57147e6db3 tempest-VolumesExtendTest-1439417629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2ed580d5-34de-4a4c-b2b5-2be53f1a349a 1073741824" returned: 0 in 0.895s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:21:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ba86d02f-5d20-43dd-8ee0-7a57147e6db3 tempest-VolumesExtendTest-1439417629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2ed580d5-34de-4a4c-b2b5-2be53f1a349a {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:21:17 devstack sudo[103713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2ed580d5-34de-4a4c-b2b5-2be53f1a349a Jul 10 10:21:17 devstack sudo[103713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:21:18 devstack sudo[103713]: pam_unix(sudo:session): session closed for user root Jul 10 10:21:18 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ba86d02f-5d20-43dd-8ee0-7a57147e6db3 tempest-VolumesExtendTest-1439417629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2ed580d5-34de-4a4c-b2b5-2be53f1a349a" returned: 0 in 0.693s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:21:18 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-ba86d02f-5d20-43dd-8ee0-7a57147e6db3 tempest-VolumesExtendTest-1439417629 None] <== create_volume: return (1629ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:21:18 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-ba86d02f-5d20-43dd-8ee0-7a57147e6db3 tempest-VolumesExtendTest-1439417629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.632s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:21:18 devstack cinder-volume[87234]: DEBUG cinder.volume.volume_utils [None req-ba86d02f-5d20-43dd-8ee0-7a57147e6db3 tempest-VolumesExtendTest-1439417629 None] Attempting download of 57b49355-8d23-4892-9d66-30ed6d4bc3c1 ((None, [{'url': 'file:///opt/stack/data/glance/images/57b49355-8d23-4892-9d66-30ed6d4bc3c1', 'metadata': {}}])) to volume 2ed580d5-34de-4a4c-b2b5-2be53f1a349a. {{(pid=87234) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 10:21:18 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[8101aab9-7611-40a2-a5cd-51bfd7f0a35f]: (4, 'raw') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:21:18 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ba86d02f-5d20-43dd-8ee0-7a57147e6db3 tempest-VolumesExtendTest-1439417629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_57b49355-8d23-4892-9d66-30ed6d4bc3c1_oio2g8v3 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:21:18 devstack sudo[103750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_57b49355-8d23-4892-9d66-30ed6d4bc3c1_oio2g8v3 Jul 10 10:21:18 devstack sudo[103750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:21:18 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-98f48cc6-f268-48dc-8d0c-0be827b7842f tempest-VolumeImageDependencyTests-2087726331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:21:18 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-98f48cc6-f268-48dc-8d0c-0be827b7842f tempest-VolumeImageDependencyTests-2087726331 None] Flow 'volume_create_manager' (83bf3200-b961-47e8-9097-4dc3614c2a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:21:18 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-98f48cc6-f268-48dc-8d0c-0be827b7842f tempest-VolumeImageDependencyTests-2087726331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (817ad55c-bd5d-41fd-9882-fd4d03816bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:21:18 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-98f48cc6-f268-48dc-8d0c-0be827b7842f tempest-VolumeImageDependencyTests-2087726331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (817ad55c-bd5d-41fd-9882-fd4d03816bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:21:19Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca2ad122-4e21-4311-aac8-0a3642360a0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6ce266cfe6a4893b2e39a222b23c43a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:21:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:21:19Z,use_quota=True,user_id='a265b69bf54a46569e59ddc2b43290a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:21:18 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-98f48cc6-f268-48dc-8d0c-0be827b7842f tempest-VolumeImageDependencyTests-2087726331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80678fdd-7819-4a70-b1fc-761c117418cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:21:18 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-98f48cc6-f268-48dc-8d0c-0be827b7842f tempest-VolumeImageDependencyTests-2087726331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80678fdd-7819-4a70-b1fc-761c117418cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:21:18 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-98f48cc6-f268-48dc-8d0c-0be827b7842f tempest-VolumeImageDependencyTests-2087726331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddeb4fb4-cd87-40d0-9af9-d94987fedad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:21:18 devstack cinder-volume[87234]: DEBUG cinder.image.glance [None req-98f48cc6-f268-48dc-8d0c-0be827b7842f tempest-VolumeImageDependencyTests-2087726331 None] Creating Keystone auth plugin from conf {{(pid=87234) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 10:21:19 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-98f48cc6-f268-48dc-8d0c-0be827b7842f tempest-VolumeImageDependencyTests-2087726331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddeb4fb4-cd87-40d0-9af9-d94987fedad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ca2ad122-4e21-4311-aac8-0a3642360a0b', 'volume_name': 'volume-ca2ad122-4e21-4311-aac8-0a3642360a0b', 'volume_size': 1, 'image_id': 'a9642140-4c53-4263-afff-bfe13bf82bce', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a9642140-4c53-4263-afff-bfe13bf82bce', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '85572279b374bedfd2df5de9ecfe26bb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e6ce266cfe6a4893b2e39a222b23c43a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '103a1efc5c91d213572a155754736a01239a0c6d4922b4dba24a56123acc6a981326120a58794e3ba589ffcd887d76f6e6e92e165e40fd2723afcfd66df40d43', 'id': 'a9642140-4c53-4263-afff-bfe13bf82bce', 'created_at': datetime.datetime(2026, 7, 10, 8, 21, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 8, 21, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a9642140-4c53-4263-afff-bfe13bf82bce/file', 'properties': {}}, 'image_service': }' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:21:19 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-98f48cc6-f268-48dc-8d0c-0be827b7842f tempest-VolumeImageDependencyTests-2087726331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c4b457d-2281-4616-96a9-56c71a0a6953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:21:19 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-98f48cc6-f268-48dc-8d0c-0be827b7842f tempest-VolumeImageDependencyTests-2087726331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c4b457d-2281-4616-96a9-56c71a0a6953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:21:19 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-98f48cc6-f268-48dc-8d0c-0be827b7842f tempest-VolumeImageDependencyTests-2087726331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (939333bb-4300-4c51-9cea-ef7cfd0f17c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:21:19 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-98f48cc6-f268-48dc-8d0c-0be827b7842f tempest-VolumeImageDependencyTests-2087726331 None] Volume ca2ad122-4e21-4311-aac8-0a3642360a0b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ca2ad122-4e21-4311-aac8-0a3642360a0b', 'volume_size': 1, 'image_id': 'a9642140-4c53-4263-afff-bfe13bf82bce', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a9642140-4c53-4263-afff-bfe13bf82bce', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '85572279b374bedfd2df5de9ecfe26bb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e6ce266cfe6a4893b2e39a222b23c43a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '103a1efc5c91d213572a155754736a01239a0c6d4922b4dba24a56123acc6a981326120a58794e3ba589ffcd887d76f6e6e92e165e40fd2723afcfd66df40d43', 'id': 'a9642140-4c53-4263-afff-bfe13bf82bce', 'created_at': datetime.datetime(2026, 7, 10, 8, 21, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 8, 21, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a9642140-4c53-4263-afff-bfe13bf82bce/file', 'properties': {}}, 'image_service': } Jul 10 10:21:19 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-98f48cc6-f268-48dc-8d0c-0be827b7842f tempest-VolumeImageDependencyTests-2087726331 None] Trying to clone ca2ad122-4e21-4311-aac8-0a3642360a0b from image a9642140-4c53-4263-afff-bfe13bf82bce at location (None, [{'url': 'file:///opt/stack/data/glance/images/a9642140-4c53-4263-afff-bfe13bf82bce', 'metadata': {}}]). {{(pid=87234) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 10:21:19 devstack sudo[103750]: pam_unix(sudo:session): session closed for user root Jul 10 10:21:19 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ba86d02f-5d20-43dd-8ee0-7a57147e6db3 tempest-VolumesExtendTest-1439417629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_57b49355-8d23-4892-9d66-30ed6d4bc3c1_oio2g8v3" returned: 0 in 0.818s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:21:19 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ba86d02f-5d20-43dd-8ee0-7a57147e6db3 tempest-VolumesExtendTest-1439417629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_57b49355-8d23-4892-9d66-30ed6d4bc3c1_oio2g8v3 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:21:19 devstack cinder-volume[87234]: DEBUG cinder.image.image_utils [None req-98f48cc6-f268-48dc-8d0c-0be827b7842f tempest-VolumeImageDependencyTests-2087726331 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a9642140-4c53-4263-afff-bfe13bf82bce_bh6t6clwdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87234) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 10:21:19 devstack cinder-volume[87234]: INFO cinder.image.image_utils [None req-98f48cc6-f268-48dc-8d0c-0be827b7842f tempest-VolumeImageDependencyTests-2087726331 None] Image download 0.00 MB at 0.00 MB/s Jul 10 10:21:19 devstack sudo[103756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_57b49355-8d23-4892-9d66-30ed6d4bc3c1_oio2g8v3 Jul 10 10:21:19 devstack sudo[103756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:21:19 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[55db05c1-b611-480a-b024-105e6e4c179f]: (4, 'raw') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:21:19 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-98f48cc6-f268-48dc-8d0c-0be827b7842f tempest-VolumeImageDependencyTests-2087726331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a9642140-4c53-4263-afff-bfe13bf82bce_bh6t6clwdevstack@QuobyteHD {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:21:19 devstack sudo[103758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a9642140-4c53-4263-afff-bfe13bf82bce_bh6t6clwdevstack@QuobyteHD Jul 10 10:21:19 devstack sudo[103758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:21:19 devstack sudo[103756]: pam_unix(sudo:session): session closed for user root Jul 10 10:21:19 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ba86d02f-5d20-43dd-8ee0-7a57147e6db3 tempest-VolumesExtendTest-1439417629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_57b49355-8d23-4892-9d66-30ed6d4bc3c1_oio2g8v3" returned: 1 in 0.754s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:21:19 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ba86d02f-5d20-43dd-8ee0-7a57147e6db3 tempest-VolumesExtendTest-1439417629 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_57b49355-8d23-4892-9d66-30ed6d4bc3c1_oio2g8v3' failed. Not Retrying. {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 10:21:19 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c9aa547-2e2f-481e-aa08-049705e9cc7f]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:21:19 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ba86d02f-5d20-43dd-8ee0-7a57147e6db3 tempest-VolumesExtendTest-1439417629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57b49355-8d23-4892-9d66-30ed6d4bc3c1_lfg48dkodevstack@QuobyteHD {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:21:20 devstack sudo[103763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57b49355-8d23-4892-9d66-30ed6d4bc3c1_lfg48dkodevstack@QuobyteHD Jul 10 10:21:20 devstack sudo[103763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:21:20 devstack sudo[103758]: pam_unix(sudo:session): session closed for user root Jul 10 10:21:20 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-98f48cc6-f268-48dc-8d0c-0be827b7842f tempest-VolumeImageDependencyTests-2087726331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a9642140-4c53-4263-afff-bfe13bf82bce_bh6t6clwdevstack@QuobyteHD" returned: 0 in 0.763s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:21:20 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-98f48cc6-f268-48dc-8d0c-0be827b7842f tempest-VolumeImageDependencyTests-2087726331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a9642140-4c53-4263-afff-bfe13bf82bce_bh6t6clwdevstack@QuobyteHD {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:21:20 devstack sudo[103767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a9642140-4c53-4263-afff-bfe13bf82bce_bh6t6clwdevstack@QuobyteHD Jul 10 10:21:20 devstack sudo[103767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:21:20 devstack sudo[103763]: pam_unix(sudo:session): session closed for user root Jul 10 10:21:20 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ba86d02f-5d20-43dd-8ee0-7a57147e6db3 tempest-VolumesExtendTest-1439417629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57b49355-8d23-4892-9d66-30ed6d4bc3c1_lfg48dkodevstack@QuobyteHD" returned: 0 in 0.739s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:21:20 devstack cinder-volume[87234]: DEBUG cinder.image.image_utils [None req-ba86d02f-5d20-43dd-8ee0-7a57147e6db3 tempest-VolumesExtendTest-1439417629 None] 57b49355-8d23-4892-9d66-30ed6d4bc3c1 was qcow2, converting to raw {{(pid=87234) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 10:21:20 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ba86d02f-5d20-43dd-8ee0-7a57147e6db3 tempest-VolumesExtendTest-1439417629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_57b49355-8d23-4892-9d66-30ed6d4bc3c1_lfg48dkodevstack@QuobyteHD /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2ed580d5-34de-4a4c-b2b5-2be53f1a349a {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:21:20 devstack sudo[103773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_57b49355-8d23-4892-9d66-30ed6d4bc3c1_lfg48dkodevstack@QuobyteHD /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2ed580d5-34de-4a4c-b2b5-2be53f1a349a Jul 10 10:21:20 devstack sudo[103773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:21:20 devstack sudo[103767]: pam_unix(sudo:session): session closed for user root Jul 10 10:21:20 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-98f48cc6-f268-48dc-8d0c-0be827b7842f tempest-VolumeImageDependencyTests-2087726331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a9642140-4c53-4263-afff-bfe13bf82bce_bh6t6clwdevstack@QuobyteHD" returned: 1 in 0.741s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:21:20 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-98f48cc6-f268-48dc-8d0c-0be827b7842f tempest-VolumeImageDependencyTests-2087726331 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a9642140-4c53-4263-afff-bfe13bf82bce_bh6t6clwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 10:21:20 devstack cinder-volume[87234]: DEBUG cinder.image.image_utils [None req-98f48cc6-f268-48dc-8d0c-0be827b7842f tempest-VolumeImageDependencyTests-2087726331 None] Temporary image a9642140-4c53-4263-afff-bfe13bf82bce is fetched for user a265b69bf54a46569e59ddc2b43290a5. {{(pid=87234) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 10:21:20 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[22eb54db-dae8-4048-b3cb-94bbc22d8696]: (4, 'raw') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:21:20 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-98f48cc6-f268-48dc-8d0c-0be827b7842f tempest-VolumeImageDependencyTests-2087726331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a9642140-4c53-4263-afff-bfe13bf82bce_bh6t6clwdevstack@QuobyteHD {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:21:21 devstack sudo[103777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a9642140-4c53-4263-afff-bfe13bf82bce_bh6t6clwdevstack@QuobyteHD Jul 10 10:21:21 devstack sudo[103777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:21:21 devstack sudo[103777]: pam_unix(sudo:session): session closed for user root Jul 10 10:21:21 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-98f48cc6-f268-48dc-8d0c-0be827b7842f tempest-VolumeImageDependencyTests-2087726331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a9642140-4c53-4263-afff-bfe13bf82bce_bh6t6clwdevstack@QuobyteHD" returned: 0 in 0.829s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:21:21 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-98f48cc6-f268-48dc-8d0c-0be827b7842f tempest-VolumeImageDependencyTests-2087726331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a9642140-4c53-4263-afff-bfe13bf82bce_bh6t6clwdevstack@QuobyteHD {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:21:21 devstack sudo[103789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a9642140-4c53-4263-afff-bfe13bf82bce_bh6t6clwdevstack@QuobyteHD Jul 10 10:21:21 devstack sudo[103789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:21:22 devstack sudo[103789]: pam_unix(sudo:session): session closed for user root Jul 10 10:21:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-98f48cc6-f268-48dc-8d0c-0be827b7842f tempest-VolumeImageDependencyTests-2087726331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a9642140-4c53-4263-afff-bfe13bf82bce_bh6t6clwdevstack@QuobyteHD" returned: 1 in 0.768s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:21:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-98f48cc6-f268-48dc-8d0c-0be827b7842f tempest-VolumeImageDependencyTests-2087726331 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a9642140-4c53-4263-afff-bfe13bf82bce_bh6t6clwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 10:21:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-98f48cc6-f268-48dc-8d0c-0be827b7842f tempest-VolumeImageDependencyTests-2087726331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:21:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-98f48cc6-f268-48dc-8d0c-0be827b7842f tempest-VolumeImageDependencyTests-2087726331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:21:22 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-98f48cc6-f268-48dc-8d0c-0be827b7842f tempest-VolumeImageDependencyTests-2087726331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:21:19Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca2ad122-4e21-4311-aac8-0a3642360a0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6ce266cfe6a4893b2e39a222b23c43a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:21:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:21:19Z,use_quota=True,user_id='a265b69bf54a46569e59ddc2b43290a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:21:22 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-98f48cc6-f268-48dc-8d0c-0be827b7842f tempest-VolumeImageDependencyTests-2087726331 None] Creating volume ca2ad122-4e21-4311-aac8-0a3642360a0b {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:21:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-98f48cc6-f268-48dc-8d0c-0be827b7842f tempest-VolumeImageDependencyTests-2087726331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:21:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-98f48cc6-f268-48dc-8d0c-0be827b7842f tempest-VolumeImageDependencyTests-2087726331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:21:22 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-98f48cc6-f268-48dc-8d0c-0be827b7842f tempest-VolumeImageDependencyTests-2087726331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:21:22 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-98f48cc6-f268-48dc-8d0c-0be827b7842f tempest-VolumeImageDependencyTests-2087726331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:21:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-98f48cc6-f268-48dc-8d0c-0be827b7842f tempest-VolumeImageDependencyTests-2087726331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:21:22 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-98f48cc6-f268-48dc-8d0c-0be827b7842f tempest-VolumeImageDependencyTests-2087726331 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:21:22 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-98f48cc6-f268-48dc-8d0c-0be827b7842f tempest-VolumeImageDependencyTests-2087726331 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:21:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-98f48cc6-f268-48dc-8d0c-0be827b7842f tempest-VolumeImageDependencyTests-2087726331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ca2ad122-4e21-4311-aac8-0a3642360a0b 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:21:22 devstack sudo[103796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ca2ad122-4e21-4311-aac8-0a3642360a0b 1073741824 Jul 10 10:21:22 devstack sudo[103796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:21:22 devstack sudo[103773]: pam_unix(sudo:session): session closed for user root Jul 10 10:21:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ba86d02f-5d20-43dd-8ee0-7a57147e6db3 tempest-VolumesExtendTest-1439417629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_57b49355-8d23-4892-9d66-30ed6d4bc3c1_lfg48dkodevstack@QuobyteHD /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2ed580d5-34de-4a4c-b2b5-2be53f1a349a" returned: 0 in 1.892s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:21:22 devstack cinder-volume[87234]: DEBUG cinder.image.image_utils [None req-ba86d02f-5d20-43dd-8ee0-7a57147e6db3 tempest-VolumesExtendTest-1439417629 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_57b49355-8d23-4892-9d66-30ed6d4bc3c1_lfg48dkodevstack@QuobyteHD, size 112.00 MB, duration 1.89 sec, destination /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2ed580d5-34de-4a4c-b2b5-2be53f1a349a {{(pid=87234) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 10:21:22 devstack cinder-volume[87234]: INFO cinder.image.image_utils [None req-ba86d02f-5d20-43dd-8ee0-7a57147e6db3 tempest-VolumesExtendTest-1439417629 None] Converted 112.00 MB image at 59.15 MB/s Jul 10 10:21:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ba86d02f-5d20-43dd-8ee0-7a57147e6db3 tempest-VolumesExtendTest-1439417629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2ed580d5-34de-4a4c-b2b5-2be53f1a349a 1G {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:21:22 devstack sudo[103798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2ed580d5-34de-4a4c-b2b5-2be53f1a349a 1G Jul 10 10:21:22 devstack sudo[103798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:21:23 devstack sudo[103796]: pam_unix(sudo:session): session closed for user root Jul 10 10:21:23 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-98f48cc6-f268-48dc-8d0c-0be827b7842f tempest-VolumeImageDependencyTests-2087726331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ca2ad122-4e21-4311-aac8-0a3642360a0b 1073741824" returned: 0 in 0.831s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:21:23 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-98f48cc6-f268-48dc-8d0c-0be827b7842f tempest-VolumeImageDependencyTests-2087726331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ca2ad122-4e21-4311-aac8-0a3642360a0b {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:21:23 devstack sudo[103798]: pam_unix(sudo:session): session closed for user root Jul 10 10:21:23 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ba86d02f-5d20-43dd-8ee0-7a57147e6db3 tempest-VolumesExtendTest-1439417629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2ed580d5-34de-4a4c-b2b5-2be53f1a349a 1G" returned: 0 in 0.819s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:21:23 devstack sudo[103806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ca2ad122-4e21-4311-aac8-0a3642360a0b Jul 10 10:21:23 devstack sudo[103806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:21:23 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[c414e98f-9e1f-43e6-927a-2e44ba88984d]: (4, 'raw') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:21:23 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ba86d02f-5d20-43dd-8ee0-7a57147e6db3 tempest-VolumesExtendTest-1439417629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2ed580d5-34de-4a4c-b2b5-2be53f1a349a {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:21:23 devstack sudo[103808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2ed580d5-34de-4a4c-b2b5-2be53f1a349a Jul 10 10:21:23 devstack sudo[103808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:21:24 devstack sudo[103806]: pam_unix(sudo:session): session closed for user root Jul 10 10:21:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-98f48cc6-f268-48dc-8d0c-0be827b7842f tempest-VolumeImageDependencyTests-2087726331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ca2ad122-4e21-4311-aac8-0a3642360a0b" returned: 0 in 0.674s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:21:24 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-98f48cc6-f268-48dc-8d0c-0be827b7842f tempest-VolumeImageDependencyTests-2087726331 None] <== create_volume: return (1552ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:21:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-98f48cc6-f268-48dc-8d0c-0be827b7842f tempest-VolumeImageDependencyTests-2087726331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.557s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:21:24 devstack cinder-volume[87234]: DEBUG cinder.volume.volume_utils [None req-98f48cc6-f268-48dc-8d0c-0be827b7842f tempest-VolumeImageDependencyTests-2087726331 None] Attempting download of a9642140-4c53-4263-afff-bfe13bf82bce ((None, [{'url': 'file:///opt/stack/data/glance/images/a9642140-4c53-4263-afff-bfe13bf82bce', 'metadata': {}}])) to volume ca2ad122-4e21-4311-aac8-0a3642360a0b. {{(pid=87234) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 10:21:24 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec15b6af-8fb7-4a66-88db-86344641c2ad]: (4, 'raw') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:21:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-98f48cc6-f268-48dc-8d0c-0be827b7842f tempest-VolumeImageDependencyTests-2087726331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a9642140-4c53-4263-afff-bfe13bf82bce_f1_6poik {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:21:24 devstack sudo[103813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a9642140-4c53-4263-afff-bfe13bf82bce_f1_6poik Jul 10 10:21:24 devstack sudo[103813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:21:24 devstack sudo[103808]: pam_unix(sudo:session): session closed for user root Jul 10 10:21:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ba86d02f-5d20-43dd-8ee0-7a57147e6db3 tempest-VolumesExtendTest-1439417629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2ed580d5-34de-4a4c-b2b5-2be53f1a349a" returned: 0 in 0.824s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:21:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ba86d02f-5d20-43dd-8ee0-7a57147e6db3 tempest-VolumesExtendTest-1439417629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2ed580d5-34de-4a4c-b2b5-2be53f1a349a {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:21:24 devstack sudo[103815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2ed580d5-34de-4a4c-b2b5-2be53f1a349a Jul 10 10:21:24 devstack sudo[103815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:21:24 devstack sudo[103813]: pam_unix(sudo:session): session closed for user root Jul 10 10:21:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-98f48cc6-f268-48dc-8d0c-0be827b7842f tempest-VolumeImageDependencyTests-2087726331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a9642140-4c53-4263-afff-bfe13bf82bce_f1_6poik" returned: 0 in 0.765s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:21:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-98f48cc6-f268-48dc-8d0c-0be827b7842f tempest-VolumeImageDependencyTests-2087726331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a9642140-4c53-4263-afff-bfe13bf82bce_f1_6poik {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:21:25 devstack sudo[103820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a9642140-4c53-4263-afff-bfe13bf82bce_f1_6poik Jul 10 10:21:25 devstack sudo[103820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:21:25 devstack sudo[103815]: pam_unix(sudo:session): session closed for user root Jul 10 10:21:25 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ba86d02f-5d20-43dd-8ee0-7a57147e6db3 tempest-VolumesExtendTest-1439417629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2ed580d5-34de-4a4c-b2b5-2be53f1a349a" returned: 1 in 0.783s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:21:25 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ba86d02f-5d20-43dd-8ee0-7a57147e6db3 tempest-VolumesExtendTest-1439417629 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2ed580d5-34de-4a4c-b2b5-2be53f1a349a' failed. Not Retrying. {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 10:21:25 devstack cinder-volume[87234]: DEBUG cinder.volume.volume_utils [None req-ba86d02f-5d20-43dd-8ee0-7a57147e6db3 tempest-VolumesExtendTest-1439417629 None] Downloaded image 57b49355-8d23-4892-9d66-30ed6d4bc3c1 ((None, [{'url': 'file:///opt/stack/data/glance/images/57b49355-8d23-4892-9d66-30ed6d4bc3c1', 'metadata': {}}])) to volume 2ed580d5-34de-4a4c-b2b5-2be53f1a349a successfully. {{(pid=87234) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 10:21:25 devstack cinder-volume[87234]: DEBUG cinder.image.image_utils [None req-ba86d02f-5d20-43dd-8ee0-7a57147e6db3 tempest-VolumesExtendTest-1439417629 None] Temporary image 57b49355-8d23-4892-9d66-30ed6d4bc3c1 for user 06b75b2ad1df42caa1ed96400a3f1ebf is deleted. {{(pid=87234) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 10:21:25 devstack cinder-volume[87234]: DEBUG cinder.volume.volume_utils [None req-ba86d02f-5d20-43dd-8ee0-7a57147e6db3 tempest-VolumesExtendTest-1439417629 None] Marking volume 2ed580d5-34de-4a4c-b2b5-2be53f1a349a as bootable. {{(pid=87234) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 10:21:25 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba86d02f-5d20-43dd-8ee0-7a57147e6db3 tempest-VolumesExtendTest-1439417629 None] Copying metadata from image 57b49355-8d23-4892-9d66-30ed6d4bc3c1 to 2ed580d5-34de-4a4c-b2b5-2be53f1a349a. {{(pid=87234) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 10:21:25 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba86d02f-5d20-43dd-8ee0-7a57147e6db3 tempest-VolumesExtendTest-1439417629 None] Creating volume glance metadata for volume 2ed580d5-34de-4a4c-b2b5-2be53f1a349a backed by image 57b49355-8d23-4892-9d66-30ed6d4bc3c1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '57b49355-8d23-4892-9d66-30ed6d4bc3c1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87234) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 10:21:25 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ba86d02f-5d20-43dd-8ee0-7a57147e6db3 tempest-VolumesExtendTest-1439417629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9acb76d-3558-4da2-bf34-e3da740adde1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ed580d5-34de-4a4c-b2b5-2be53f1a349a', 'volume_size': 1, 'image_id': '57b49355-8d23-4892-9d66-30ed6d4bc3c1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/57b49355-8d23-4892-9d66-30ed6d4bc3c1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd8e6341302c8449397efca0eea68956a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '57b49355-8d23-4892-9d66-30ed6d4bc3c1', 'created_at': datetime.datetime(2026, 7, 10, 7, 56, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 7, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/57b49355-8d23-4892-9d66-30ed6d4bc3c1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:21:25 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ba86d02f-5d20-43dd-8ee0-7a57147e6db3 tempest-VolumesExtendTest-1439417629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (749132cb-0b1b-48ea-a58d-72caf34ed2c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:21:25 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-ba86d02f-5d20-43dd-8ee0-7a57147e6db3 tempest-VolumesExtendTest-1439417629 None] Volume volume-2ed580d5-34de-4a4c-b2b5-2be53f1a349a (2ed580d5-34de-4a4c-b2b5-2be53f1a349a): created successfully Jul 10 10:21:25 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ba86d02f-5d20-43dd-8ee0-7a57147e6db3 tempest-VolumesExtendTest-1439417629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (749132cb-0b1b-48ea-a58d-72caf34ed2c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:21:25 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ba86d02f-5d20-43dd-8ee0-7a57147e6db3 tempest-VolumesExtendTest-1439417629 None] Flow 'volume_create_manager' (583f08cf-c009-4ba7-9415-48c963c8ade3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:21:25 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-ba86d02f-5d20-43dd-8ee0-7a57147e6db3 tempest-VolumesExtendTest-1439417629 None] Created volume successfully. Jul 10 10:21:25 devstack sudo[103820]: pam_unix(sudo:session): session closed for user root Jul 10 10:21:25 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-98f48cc6-f268-48dc-8d0c-0be827b7842f tempest-VolumeImageDependencyTests-2087726331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a9642140-4c53-4263-afff-bfe13bf82bce_f1_6poik" returned: 1 in 0.775s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:21:25 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-98f48cc6-f268-48dc-8d0c-0be827b7842f tempest-VolumeImageDependencyTests-2087726331 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a9642140-4c53-4263-afff-bfe13bf82bce_f1_6poik' failed. Not Retrying. {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 10:21:25 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[d50a3751-7748-4b30-8f0d-c4c2f1b3daa4]: (4, 'raw') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:21:25 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-98f48cc6-f268-48dc-8d0c-0be827b7842f tempest-VolumeImageDependencyTests-2087726331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a9642140-4c53-4263-afff-bfe13bf82bce_bh6t6clwdevstack@QuobyteHD {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:21:25 devstack sudo[103826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a9642140-4c53-4263-afff-bfe13bf82bce_bh6t6clwdevstack@QuobyteHD Jul 10 10:21:25 devstack sudo[103826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:21:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-52783741-8c6b-4bc9-8a51-1f0260d83a38 tempest-VolumesExtendTest-1439417629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:21:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-52783741-8c6b-4bc9-8a51-1f0260d83a38 tempest-VolumesExtendTest-1439417629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.005s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:21:26 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d62389a-b2cc-41d1-8e5d-d1b6f39fcac2]: (4, 'raw') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:21:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-52783741-8c6b-4bc9-8a51-1f0260d83a38 tempest-VolumesExtendTest-1439417629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2ed580d5-34de-4a4c-b2b5-2be53f1a349a {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:21:26 devstack sudo[103828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2ed580d5-34de-4a4c-b2b5-2be53f1a349a Jul 10 10:21:26 devstack sudo[103828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:21:26 devstack sudo[103826]: pam_unix(sudo:session): session closed for user root Jul 10 10:21:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-98f48cc6-f268-48dc-8d0c-0be827b7842f tempest-VolumeImageDependencyTests-2087726331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a9642140-4c53-4263-afff-bfe13bf82bce_bh6t6clwdevstack@QuobyteHD" returned: 0 in 0.750s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:21:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-98f48cc6-f268-48dc-8d0c-0be827b7842f tempest-VolumeImageDependencyTests-2087726331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a9642140-4c53-4263-afff-bfe13bf82bce_bh6t6clwdevstack@QuobyteHD {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:21:26 devstack sudo[103832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a9642140-4c53-4263-afff-bfe13bf82bce_bh6t6clwdevstack@QuobyteHD Jul 10 10:21:26 devstack sudo[103832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:21:26 devstack sudo[103828]: pam_unix(sudo:session): session closed for user root Jul 10 10:21:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-52783741-8c6b-4bc9-8a51-1f0260d83a38 tempest-VolumesExtendTest-1439417629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2ed580d5-34de-4a4c-b2b5-2be53f1a349a" returned: 0 in 0.767s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:21:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-52783741-8c6b-4bc9-8a51-1f0260d83a38 tempest-VolumesExtendTest-1439417629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2ed580d5-34de-4a4c-b2b5-2be53f1a349a {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:21:27 devstack sudo[103836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2ed580d5-34de-4a4c-b2b5-2be53f1a349a Jul 10 10:21:27 devstack sudo[103836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:21:27 devstack sudo[103832]: pam_unix(sudo:session): session closed for user root Jul 10 10:21:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-98f48cc6-f268-48dc-8d0c-0be827b7842f tempest-VolumeImageDependencyTests-2087726331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a9642140-4c53-4263-afff-bfe13bf82bce_bh6t6clwdevstack@QuobyteHD" returned: 1 in 0.738s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:21:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-98f48cc6-f268-48dc-8d0c-0be827b7842f tempest-VolumeImageDependencyTests-2087726331 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a9642140-4c53-4263-afff-bfe13bf82bce_bh6t6clwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 10:21:27 devstack cinder-volume[87234]: DEBUG cinder.image.image_utils [None req-98f48cc6-f268-48dc-8d0c-0be827b7842f tempest-VolumeImageDependencyTests-2087726331 None] a9642140-4c53-4263-afff-bfe13bf82bce was raw, converting to raw {{(pid=87234) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 10:21:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-98f48cc6-f268-48dc-8d0c-0be827b7842f tempest-VolumeImageDependencyTests-2087726331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_a9642140-4c53-4263-afff-bfe13bf82bce_bh6t6clwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ca2ad122-4e21-4311-aac8-0a3642360a0b {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:21:27 devstack sudo[103841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_a9642140-4c53-4263-afff-bfe13bf82bce_bh6t6clwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ca2ad122-4e21-4311-aac8-0a3642360a0b Jul 10 10:21:27 devstack sudo[103841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:21:27 devstack sudo[103836]: pam_unix(sudo:session): session closed for user root Jul 10 10:21:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-52783741-8c6b-4bc9-8a51-1f0260d83a38 tempest-VolumesExtendTest-1439417629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2ed580d5-34de-4a4c-b2b5-2be53f1a349a" returned: 1 in 0.821s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:21:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-52783741-8c6b-4bc9-8a51-1f0260d83a38 tempest-VolumesExtendTest-1439417629 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2ed580d5-34de-4a4c-b2b5-2be53f1a349a' failed. Not Retrying. {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 10:21:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-52783741-8c6b-4bc9-8a51-1f0260d83a38 tempest-VolumesExtendTest-1439417629 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2ed580d5-34de-4a4c-b2b5-2be53f1a349a 2G {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:21:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-52783741-8c6b-4bc9-8a51-1f0260d83a38 tempest-VolumesExtendTest-1439417629 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2ed580d5-34de-4a4c-b2b5-2be53f1a349a 2G" returned: 0 in 0.073s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:21:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-52783741-8c6b-4bc9-8a51-1f0260d83a38 tempest-VolumesExtendTest-1439417629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.710s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:21:27 devstack cinder-volume[87234]: DEBUG dbcounter [-] [87234] Writing DB stats cinder:SELECT=74,cinder:UPDATE=81,cinder:INSERT=30,cinder:DELETE=3 {{(pid=87234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 10:21:27 devstack cinder-volume[87234]: DEBUG dbcounter [-] [87234] Writing DB stats cinder:SELECT=68,cinder:INSERT=31,cinder:UPDATE=69,cinder:DELETE=8 {{(pid=87234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 10:21:27 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-52783741-8c6b-4bc9-8a51-1f0260d83a38 tempest-VolumesExtendTest-1439417629 None] Extend volume completed successfully. Jul 10 10:21:27 devstack sudo[103841]: pam_unix(sudo:session): session closed for user root Jul 10 10:21:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-98f48cc6-f268-48dc-8d0c-0be827b7842f tempest-VolumeImageDependencyTests-2087726331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_a9642140-4c53-4263-afff-bfe13bf82bce_bh6t6clwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ca2ad122-4e21-4311-aac8-0a3642360a0b" returned: 0 in 0.761s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:21:27 devstack cinder-volume[87234]: DEBUG cinder.image.image_utils [None req-98f48cc6-f268-48dc-8d0c-0be827b7842f tempest-VolumeImageDependencyTests-2087726331 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a9642140-4c53-4263-afff-bfe13bf82bce_bh6t6clwdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ca2ad122-4e21-4311-aac8-0a3642360a0b {{(pid=87234) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 10:21:27 devstack cinder-volume[87234]: INFO cinder.image.image_utils [None req-98f48cc6-f268-48dc-8d0c-0be827b7842f tempest-VolumeImageDependencyTests-2087726331 None] Converted 0.00 MB image at 0.00 MB/s Jul 10 10:21:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-98f48cc6-f268-48dc-8d0c-0be827b7842f tempest-VolumeImageDependencyTests-2087726331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ca2ad122-4e21-4311-aac8-0a3642360a0b 1G {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:21:28 devstack sudo[103853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ca2ad122-4e21-4311-aac8-0a3642360a0b 1G Jul 10 10:21:28 devstack sudo[103853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:21:28 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-c1657a36-52ef-42a1-925b-59f20fc42aa1 tempest-VolumesExtendTest-1439417629 None] Acquiring lock "cinder-2ed580d5-34de-4a4c-b2b5-2be53f1a349a-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:21:28 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-c1657a36-52ef-42a1-925b-59f20fc42aa1 tempest-VolumesExtendTest-1439417629 None] Lock "cinder-2ed580d5-34de-4a4c-b2b5-2be53f1a349a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:21:28 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-c1657a36-52ef-42a1-925b-59f20fc42aa1 tempest-VolumesExtendTest-1439417629 None] Acquiring lock "cinder-quobyte-2ed580d5-34de-4a4c-b2b5-2be53f1a349a" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:21:28 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-c1657a36-52ef-42a1-925b-59f20fc42aa1 tempest-VolumesExtendTest-1439417629 None] Lock "cinder-quobyte-2ed580d5-34de-4a4c-b2b5-2be53f1a349a" acquired by "delete_volume" :: waited 0.018s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:21:28 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d73863-cf67-4a36-840a-898561e8069a]: (4, 'raw') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:21:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c1657a36-52ef-42a1-925b-59f20fc42aa1 tempest-VolumesExtendTest-1439417629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2ed580d5-34de-4a4c-b2b5-2be53f1a349a {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:21:28 devstack sudo[103853]: pam_unix(sudo:session): session closed for user root Jul 10 10:21:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-98f48cc6-f268-48dc-8d0c-0be827b7842f tempest-VolumeImageDependencyTests-2087726331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ca2ad122-4e21-4311-aac8-0a3642360a0b 1G" returned: 0 in 0.718s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:21:28 devstack sudo[103858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2ed580d5-34de-4a4c-b2b5-2be53f1a349a Jul 10 10:21:28 devstack sudo[103858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:21:28 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[3024de52-ddc6-4753-b636-a528c0d15715]: (4, 'raw') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:21:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-98f48cc6-f268-48dc-8d0c-0be827b7842f tempest-VolumeImageDependencyTests-2087726331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ca2ad122-4e21-4311-aac8-0a3642360a0b {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:21:28 devstack sudo[103860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ca2ad122-4e21-4311-aac8-0a3642360a0b Jul 10 10:21:28 devstack sudo[103860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:21:29 devstack sudo[103858]: pam_unix(sudo:session): session closed for user root Jul 10 10:21:29 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c1657a36-52ef-42a1-925b-59f20fc42aa1 tempest-VolumesExtendTest-1439417629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2ed580d5-34de-4a4c-b2b5-2be53f1a349a" returned: 0 in 0.832s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:21:29 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c1657a36-52ef-42a1-925b-59f20fc42aa1 tempest-VolumesExtendTest-1439417629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2ed580d5-34de-4a4c-b2b5-2be53f1a349a {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:21:29 devstack sudo[103860]: pam_unix(sudo:session): session closed for user root Jul 10 10:21:29 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-98f48cc6-f268-48dc-8d0c-0be827b7842f tempest-VolumeImageDependencyTests-2087726331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ca2ad122-4e21-4311-aac8-0a3642360a0b" returned: 0 in 0.748s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:21:29 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-98f48cc6-f268-48dc-8d0c-0be827b7842f tempest-VolumeImageDependencyTests-2087726331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ca2ad122-4e21-4311-aac8-0a3642360a0b {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:21:29 devstack sudo[103866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2ed580d5-34de-4a4c-b2b5-2be53f1a349a Jul 10 10:21:29 devstack sudo[103866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:21:29 devstack sudo[103867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ca2ad122-4e21-4311-aac8-0a3642360a0b Jul 10 10:21:29 devstack sudo[103867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:21:30 devstack sudo[103866]: pam_unix(sudo:session): session closed for user root Jul 10 10:21:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c1657a36-52ef-42a1-925b-59f20fc42aa1 tempest-VolumesExtendTest-1439417629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2ed580d5-34de-4a4c-b2b5-2be53f1a349a" returned: 1 in 0.786s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:21:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c1657a36-52ef-42a1-925b-59f20fc42aa1 tempest-VolumesExtendTest-1439417629 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2ed580d5-34de-4a4c-b2b5-2be53f1a349a' failed. Not Retrying. {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 10:21:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c1657a36-52ef-42a1-925b-59f20fc42aa1 tempest-VolumesExtendTest-1439417629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2ed580d5-34de-4a4c-b2b5-2be53f1a349a {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:21:30 devstack sudo[103867]: pam_unix(sudo:session): session closed for user root Jul 10 10:21:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-98f48cc6-f268-48dc-8d0c-0be827b7842f tempest-VolumeImageDependencyTests-2087726331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ca2ad122-4e21-4311-aac8-0a3642360a0b" returned: 1 in 0.752s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:21:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-98f48cc6-f268-48dc-8d0c-0be827b7842f tempest-VolumeImageDependencyTests-2087726331 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ca2ad122-4e21-4311-aac8-0a3642360a0b' failed. Not Retrying. {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 10:21:30 devstack cinder-volume[87234]: DEBUG cinder.volume.volume_utils [None req-98f48cc6-f268-48dc-8d0c-0be827b7842f tempest-VolumeImageDependencyTests-2087726331 None] Downloaded image a9642140-4c53-4263-afff-bfe13bf82bce ((None, [{'url': 'file:///opt/stack/data/glance/images/a9642140-4c53-4263-afff-bfe13bf82bce', 'metadata': {}}])) to volume ca2ad122-4e21-4311-aac8-0a3642360a0b successfully. {{(pid=87234) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 10:21:30 devstack cinder-volume[87234]: DEBUG cinder.image.image_utils [None req-98f48cc6-f268-48dc-8d0c-0be827b7842f tempest-VolumeImageDependencyTests-2087726331 None] Temporary image a9642140-4c53-4263-afff-bfe13bf82bce for user a265b69bf54a46569e59ddc2b43290a5 is deleted. {{(pid=87234) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 10:21:30 devstack cinder-volume[87234]: DEBUG cinder.volume.volume_utils [None req-98f48cc6-f268-48dc-8d0c-0be827b7842f tempest-VolumeImageDependencyTests-2087726331 None] Marking volume ca2ad122-4e21-4311-aac8-0a3642360a0b as bootable. {{(pid=87234) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 10:21:30 devstack sudo[103879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2ed580d5-34de-4a4c-b2b5-2be53f1a349a Jul 10 10:21:30 devstack sudo[103879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:21:30 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-98f48cc6-f268-48dc-8d0c-0be827b7842f tempest-VolumeImageDependencyTests-2087726331 None] Copying metadata from image a9642140-4c53-4263-afff-bfe13bf82bce to ca2ad122-4e21-4311-aac8-0a3642360a0b. {{(pid=87234) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 10:21:30 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-98f48cc6-f268-48dc-8d0c-0be827b7842f tempest-VolumeImageDependencyTests-2087726331 None] Creating volume glance metadata for volume ca2ad122-4e21-4311-aac8-0a3642360a0b backed by image a9642140-4c53-4263-afff-bfe13bf82bce with: {'image_id': 'a9642140-4c53-4263-afff-bfe13bf82bce', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '85572279b374bedfd2df5de9ecfe26bb', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87234) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 10:21:30 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-98f48cc6-f268-48dc-8d0c-0be827b7842f tempest-VolumeImageDependencyTests-2087726331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (939333bb-4300-4c51-9cea-ef7cfd0f17c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca2ad122-4e21-4311-aac8-0a3642360a0b', 'volume_size': 1, 'image_id': 'a9642140-4c53-4263-afff-bfe13bf82bce', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a9642140-4c53-4263-afff-bfe13bf82bce', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '85572279b374bedfd2df5de9ecfe26bb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e6ce266cfe6a4893b2e39a222b23c43a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '103a1efc5c91d213572a155754736a01239a0c6d4922b4dba24a56123acc6a981326120a58794e3ba589ffcd887d76f6e6e92e165e40fd2723afcfd66df40d43', 'id': 'a9642140-4c53-4263-afff-bfe13bf82bce', 'created_at': datetime.datetime(2026, 7, 10, 8, 21, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 8, 21, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a9642140-4c53-4263-afff-bfe13bf82bce/file', 'properties': {}}, 'image_service': }' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:21:30 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-98f48cc6-f268-48dc-8d0c-0be827b7842f tempest-VolumeImageDependencyTests-2087726331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a6edad9-14be-4bf2-91dc-9a1a72df4c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:21:30 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-98f48cc6-f268-48dc-8d0c-0be827b7842f tempest-VolumeImageDependencyTests-2087726331 None] Volume volume-ca2ad122-4e21-4311-aac8-0a3642360a0b (ca2ad122-4e21-4311-aac8-0a3642360a0b): created successfully Jul 10 10:21:30 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-98f48cc6-f268-48dc-8d0c-0be827b7842f tempest-VolumeImageDependencyTests-2087726331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a6edad9-14be-4bf2-91dc-9a1a72df4c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:21:30 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-98f48cc6-f268-48dc-8d0c-0be827b7842f tempest-VolumeImageDependencyTests-2087726331 None] Flow 'volume_create_manager' (83bf3200-b961-47e8-9097-4dc3614c2a30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:21:30 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-98f48cc6-f268-48dc-8d0c-0be827b7842f tempest-VolumeImageDependencyTests-2087726331 None] Created volume successfully. Jul 10 10:21:30 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-d859cf0a-4dd4-44c4-a746-f77635f82139 tempest-VolumeImageDependencyTests-2087726331 None] Acquiring lock "cinder-ca2ad122-4e21-4311-aac8-0a3642360a0b-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:21:30 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-d859cf0a-4dd4-44c4-a746-f77635f82139 tempest-VolumeImageDependencyTests-2087726331 None] Lock "cinder-ca2ad122-4e21-4311-aac8-0a3642360a0b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:21:30 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-d859cf0a-4dd4-44c4-a746-f77635f82139 tempest-VolumeImageDependencyTests-2087726331 None] Acquiring lock "cinder-quobyte-ca2ad122-4e21-4311-aac8-0a3642360a0b" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:21:30 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-d859cf0a-4dd4-44c4-a746-f77635f82139 tempest-VolumeImageDependencyTests-2087726331 None] Lock "cinder-quobyte-ca2ad122-4e21-4311-aac8-0a3642360a0b" acquired by "delete_volume" :: waited 0.017s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:21:30 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fca9e5e-ccaa-442a-8f13-3f2bfb8fa62b]: (4, 'raw') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:21:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-d859cf0a-4dd4-44c4-a746-f77635f82139 tempest-VolumeImageDependencyTests-2087726331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ca2ad122-4e21-4311-aac8-0a3642360a0b {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:21:30 devstack sudo[103879]: pam_unix(sudo:session): session closed for user root Jul 10 10:21:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c1657a36-52ef-42a1-925b-59f20fc42aa1 tempest-VolumesExtendTest-1439417629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2ed580d5-34de-4a4c-b2b5-2be53f1a349a" returned: 0 in 0.673s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:21:30 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-c1657a36-52ef-42a1-925b-59f20fc42aa1 tempest-VolumesExtendTest-1439417629 None] Lock "cinder-quobyte-2ed580d5-34de-4a4c-b2b5-2be53f1a349a" released by "delete_volume" :: held 2.365s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:21:30 devstack sudo[103885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ca2ad122-4e21-4311-aac8-0a3642360a0b Jul 10 10:21:30 devstack sudo[103885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:21:30 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-c1657a36-52ef-42a1-925b-59f20fc42aa1 tempest-VolumesExtendTest-1439417629 None] Created reservations ['c392bcae-2546-45e2-be17-93dc6dbdab24', 'af30ccb5-0d10-4043-98b8-b0af7cab3d6c', '82110bc4-66e9-4108-b741-89968fb04422', '66ec0c82-4261-43a3-9d28-d17934f3d9fc'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:21:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-c1657a36-52ef-42a1-925b-59f20fc42aa1 tempest-VolumesExtendTest-1439417629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:21:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-c1657a36-52ef-42a1-925b-59f20fc42aa1 tempest-VolumesExtendTest-1439417629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:21:31 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-c1657a36-52ef-42a1-925b-59f20fc42aa1 tempest-VolumesExtendTest-1439417629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:21:31 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-c1657a36-52ef-42a1-925b-59f20fc42aa1 tempest-VolumesExtendTest-1439417629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:21:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-c1657a36-52ef-42a1-925b-59f20fc42aa1 tempest-VolumesExtendTest-1439417629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:21:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c1657a36-52ef-42a1-925b-59f20fc42aa1 tempest-VolumesExtendTest-1439417629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:21:31 devstack sudo[103887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:21:31 devstack sudo[103887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:21:31 devstack sudo[103885]: pam_unix(sudo:session): session closed for user root Jul 10 10:21:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-d859cf0a-4dd4-44c4-a746-f77635f82139 tempest-VolumeImageDependencyTests-2087726331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ca2ad122-4e21-4311-aac8-0a3642360a0b" returned: 0 in 0.770s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:21:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-d859cf0a-4dd4-44c4-a746-f77635f82139 tempest-VolumeImageDependencyTests-2087726331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ca2ad122-4e21-4311-aac8-0a3642360a0b {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:21:31 devstack sudo[103891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ca2ad122-4e21-4311-aac8-0a3642360a0b Jul 10 10:21:31 devstack sudo[103891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:21:31 devstack sudo[103887]: pam_unix(sudo:session): session closed for user root Jul 10 10:21:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c1657a36-52ef-42a1-925b-59f20fc42aa1 tempest-VolumesExtendTest-1439417629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.703s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:21:31 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-c1657a36-52ef-42a1-925b-59f20fc42aa1 tempest-VolumesExtendTest-1439417629 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:21:31 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-c1657a36-52ef-42a1-925b-59f20fc42aa1 tempest-VolumesExtendTest-1439417629 None] Deleted volume successfully. Jul 10 10:21:31 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-c1657a36-52ef-42a1-925b-59f20fc42aa1 tempest-VolumesExtendTest-1439417629 None] Lock "cinder-2ed580d5-34de-4a4c-b2b5-2be53f1a349a-delete_volume" released by "delete_volume" :: held 3.294s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:21:32 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c4e94d3-2a47-4672-945c-07bf0dcf6572 tempest-VolumesExtendTest-1439417629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:21:32 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-6c4e94d3-2a47-4672-945c-07bf0dcf6572 tempest-VolumesExtendTest-1439417629 None] Flow 'volume_create_manager' (ab13331d-3096-48cf-8faa-a793b7f1d894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:21:32 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-6c4e94d3-2a47-4672-945c-07bf0dcf6572 tempest-VolumesExtendTest-1439417629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b82c24f5-4f98-4520-ae21-bbfc1d72fa86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:21:32 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-6c4e94d3-2a47-4672-945c-07bf0dcf6572 tempest-VolumesExtendTest-1439417629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b82c24f5-4f98-4520-ae21-bbfc1d72fa86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:21:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1414855214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b36a0d77-e214-47e8-bddb-e98b07a96ec5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3f33e86b0fd4d9b808d2e8a266f0aee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:21:32Z,use_quota=True,user_id='06b75b2ad1df42caa1ed96400a3f1ebf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:21:32 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-6c4e94d3-2a47-4672-945c-07bf0dcf6572 tempest-VolumesExtendTest-1439417629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5da4761d-d077-4497-a769-be6225059c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:21:32 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-6c4e94d3-2a47-4672-945c-07bf0dcf6572 tempest-VolumesExtendTest-1439417629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5da4761d-d077-4497-a769-be6225059c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:21:32 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-6c4e94d3-2a47-4672-945c-07bf0dcf6572 tempest-VolumesExtendTest-1439417629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13caf321-f49c-4cb5-a991-c44b998a370e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:21:32 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-6c4e94d3-2a47-4672-945c-07bf0dcf6572 tempest-VolumesExtendTest-1439417629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13caf321-f49c-4cb5-a991-c44b998a370e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b36a0d77-e214-47e8-bddb-e98b07a96ec5', 'volume_name': 'volume-b36a0d77-e214-47e8-bddb-e98b07a96ec5', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:21:32 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-6c4e94d3-2a47-4672-945c-07bf0dcf6572 tempest-VolumesExtendTest-1439417629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b34475dc-fd57-4909-95e0-97a0ab238c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:21:32 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-6c4e94d3-2a47-4672-945c-07bf0dcf6572 tempest-VolumesExtendTest-1439417629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b34475dc-fd57-4909-95e0-97a0ab238c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:21:32 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-6c4e94d3-2a47-4672-945c-07bf0dcf6572 tempest-VolumesExtendTest-1439417629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aeb3ac4e-4f6f-43fb-beea-2a5665eca72a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:21:32 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-6c4e94d3-2a47-4672-945c-07bf0dcf6572 tempest-VolumesExtendTest-1439417629 None] Volume b36a0d77-e214-47e8-bddb-e98b07a96ec5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b36a0d77-e214-47e8-bddb-e98b07a96ec5', 'volume_size': 1} Jul 10 10:21:32 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-6c4e94d3-2a47-4672-945c-07bf0dcf6572 tempest-VolumesExtendTest-1439417629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:21:32 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-6c4e94d3-2a47-4672-945c-07bf0dcf6572 tempest-VolumesExtendTest-1439417629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:21:32 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-6c4e94d3-2a47-4672-945c-07bf0dcf6572 tempest-VolumesExtendTest-1439417629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:21:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1414855214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b36a0d77-e214-47e8-bddb-e98b07a96ec5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3f33e86b0fd4d9b808d2e8a266f0aee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:21:32Z,use_quota=True,user_id='06b75b2ad1df42caa1ed96400a3f1ebf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:21:32 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-6c4e94d3-2a47-4672-945c-07bf0dcf6572 tempest-VolumesExtendTest-1439417629 None] Creating volume b36a0d77-e214-47e8-bddb-e98b07a96ec5 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:21:32 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-6c4e94d3-2a47-4672-945c-07bf0dcf6572 tempest-VolumesExtendTest-1439417629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:21:32 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-6c4e94d3-2a47-4672-945c-07bf0dcf6572 tempest-VolumesExtendTest-1439417629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:21:32 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-6c4e94d3-2a47-4672-945c-07bf0dcf6572 tempest-VolumesExtendTest-1439417629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:21:32 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-6c4e94d3-2a47-4672-945c-07bf0dcf6572 tempest-VolumesExtendTest-1439417629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:21:32 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-6c4e94d3-2a47-4672-945c-07bf0dcf6572 tempest-VolumesExtendTest-1439417629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:21:32 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-6c4e94d3-2a47-4672-945c-07bf0dcf6572 tempest-VolumesExtendTest-1439417629 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:21:32 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-6c4e94d3-2a47-4672-945c-07bf0dcf6572 tempest-VolumesExtendTest-1439417629 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:21:32 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-6c4e94d3-2a47-4672-945c-07bf0dcf6572 tempest-VolumesExtendTest-1439417629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b36a0d77-e214-47e8-bddb-e98b07a96ec5 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:21:32 devstack sudo[103897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b36a0d77-e214-47e8-bddb-e98b07a96ec5 1073741824 Jul 10 10:21:32 devstack sudo[103897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:21:32 devstack sudo[103891]: pam_unix(sudo:session): session closed for user root Jul 10 10:21:32 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-d859cf0a-4dd4-44c4-a746-f77635f82139 tempest-VolumeImageDependencyTests-2087726331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ca2ad122-4e21-4311-aac8-0a3642360a0b" returned: 1 in 0.813s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:21:32 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-d859cf0a-4dd4-44c4-a746-f77635f82139 tempest-VolumeImageDependencyTests-2087726331 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ca2ad122-4e21-4311-aac8-0a3642360a0b' failed. Not Retrying. {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 10:21:32 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-d859cf0a-4dd4-44c4-a746-f77635f82139 tempest-VolumeImageDependencyTests-2087726331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ca2ad122-4e21-4311-aac8-0a3642360a0b {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:21:32 devstack sudo[103899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ca2ad122-4e21-4311-aac8-0a3642360a0b Jul 10 10:21:32 devstack sudo[103899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:21:33 devstack sudo[103899]: pam_unix(sudo:session): session closed for user root Jul 10 10:21:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-d859cf0a-4dd4-44c4-a746-f77635f82139 tempest-VolumeImageDependencyTests-2087726331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ca2ad122-4e21-4311-aac8-0a3642360a0b" returned: 0 in 0.645s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:21:33 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-d859cf0a-4dd4-44c4-a746-f77635f82139 tempest-VolumeImageDependencyTests-2087726331 None] Lock "cinder-quobyte-ca2ad122-4e21-4311-aac8-0a3642360a0b" released by "delete_volume" :: held 2.300s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:21:33 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-d859cf0a-4dd4-44c4-a746-f77635f82139 tempest-VolumeImageDependencyTests-2087726331 None] Created reservations ['551618e9-16cf-407f-9ac5-23b47f0adaae', '5a2eb18c-ebc5-4b9d-b15b-f9e6d541fcdd', '17db1fc2-2568-409d-8fe0-7aa42b977d57', '5af4a8e3-9731-4a0e-85f9-46b2b404b646'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:21:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-d859cf0a-4dd4-44c4-a746-f77635f82139 tempest-VolumeImageDependencyTests-2087726331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:21:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-d859cf0a-4dd4-44c4-a746-f77635f82139 tempest-VolumeImageDependencyTests-2087726331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:21:33 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-d859cf0a-4dd4-44c4-a746-f77635f82139 tempest-VolumeImageDependencyTests-2087726331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:21:33 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-d859cf0a-4dd4-44c4-a746-f77635f82139 tempest-VolumeImageDependencyTests-2087726331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:21:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-d859cf0a-4dd4-44c4-a746-f77635f82139 tempest-VolumeImageDependencyTests-2087726331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:21:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-d859cf0a-4dd4-44c4-a746-f77635f82139 tempest-VolumeImageDependencyTests-2087726331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:21:33 devstack sudo[103906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:21:33 devstack sudo[103906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:21:33 devstack sudo[103897]: pam_unix(sudo:session): session closed for user root Jul 10 10:21:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-6c4e94d3-2a47-4672-945c-07bf0dcf6572 tempest-VolumesExtendTest-1439417629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b36a0d77-e214-47e8-bddb-e98b07a96ec5 1073741824" returned: 0 in 0.893s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:21:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-6c4e94d3-2a47-4672-945c-07bf0dcf6572 tempest-VolumesExtendTest-1439417629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b36a0d77-e214-47e8-bddb-e98b07a96ec5 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:21:33 devstack sudo[103908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b36a0d77-e214-47e8-bddb-e98b07a96ec5 Jul 10 10:21:33 devstack sudo[103908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:21:33 devstack sudo[103906]: pam_unix(sudo:session): session closed for user root Jul 10 10:21:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-d859cf0a-4dd4-44c4-a746-f77635f82139 tempest-VolumeImageDependencyTests-2087726331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.652s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:21:33 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-d859cf0a-4dd4-44c4-a746-f77635f82139 tempest-VolumeImageDependencyTests-2087726331 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:21:33 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-d859cf0a-4dd4-44c4-a746-f77635f82139 tempest-VolumeImageDependencyTests-2087726331 None] Deleted volume successfully. Jul 10 10:21:33 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-d859cf0a-4dd4-44c4-a746-f77635f82139 tempest-VolumeImageDependencyTests-2087726331 None] Lock "cinder-ca2ad122-4e21-4311-aac8-0a3642360a0b-delete_volume" released by "delete_volume" :: held 3.179s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:21:33 devstack sudo[103908]: pam_unix(sudo:session): session closed for user root Jul 10 10:21:34 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-6c4e94d3-2a47-4672-945c-07bf0dcf6572 tempest-VolumesExtendTest-1439417629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b36a0d77-e214-47e8-bddb-e98b07a96ec5" returned: 0 in 0.691s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:21:34 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-6c4e94d3-2a47-4672-945c-07bf0dcf6572 tempest-VolumesExtendTest-1439417629 None] <== create_volume: return (1627ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:21:34 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-6c4e94d3-2a47-4672-945c-07bf0dcf6572 tempest-VolumesExtendTest-1439417629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.629s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:21:34 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-6c4e94d3-2a47-4672-945c-07bf0dcf6572 tempest-VolumesExtendTest-1439417629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aeb3ac4e-4f6f-43fb-beea-2a5665eca72a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b36a0d77-e214-47e8-bddb-e98b07a96ec5', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:21:34 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-6c4e94d3-2a47-4672-945c-07bf0dcf6572 tempest-VolumesExtendTest-1439417629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b367dab5-b298-4492-93e2-ebc57e5bf573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:21:34 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-6c4e94d3-2a47-4672-945c-07bf0dcf6572 tempest-VolumesExtendTest-1439417629 None] Volume volume-b36a0d77-e214-47e8-bddb-e98b07a96ec5 (b36a0d77-e214-47e8-bddb-e98b07a96ec5): created successfully Jul 10 10:21:34 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-6c4e94d3-2a47-4672-945c-07bf0dcf6572 tempest-VolumesExtendTest-1439417629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b367dab5-b298-4492-93e2-ebc57e5bf573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:21:34 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-6c4e94d3-2a47-4672-945c-07bf0dcf6572 tempest-VolumesExtendTest-1439417629 None] Flow 'volume_create_manager' (ab13331d-3096-48cf-8faa-a793b7f1d894) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:21:34 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-6c4e94d3-2a47-4672-945c-07bf0dcf6572 tempest-VolumesExtendTest-1439417629 None] Created volume successfully. Jul 10 10:21:34 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-3c8929a3-da77-46c3-ab01-bcd51ecde960 tempest-VolumesExtendTest-1439417629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:21:34 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-3c8929a3-da77-46c3-ab01-bcd51ecde960 tempest-VolumesExtendTest-1439417629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:21:34 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-3c8929a3-da77-46c3-ab01-bcd51ecde960 tempest-VolumesExtendTest-1439417629 None] Creating offline snapshot b37ec28f-8dbb-49af-b03e-3dd0431ad2cc of volume b36a0d77-e214-47e8-bddb-e98b07a96ec5 {{(pid=87234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 10:21:34 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe3c8c5-95e1-43c2-a86f-fe697e448e04]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:21:34 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3c8929a3-da77-46c3-ab01-bcd51ecde960 tempest-VolumesExtendTest-1439417629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b36a0d77-e214-47e8-bddb-e98b07a96ec5 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:21:34 devstack sudo[103912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b36a0d77-e214-47e8-bddb-e98b07a96ec5 Jul 10 10:21:34 devstack sudo[103912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:21:35 devstack sudo[103912]: pam_unix(sudo:session): session closed for user root Jul 10 10:21:35 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3c8929a3-da77-46c3-ab01-bcd51ecde960 tempest-VolumesExtendTest-1439417629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b36a0d77-e214-47e8-bddb-e98b07a96ec5" returned: 0 in 0.796s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:21:35 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3c8929a3-da77-46c3-ab01-bcd51ecde960 tempest-VolumesExtendTest-1439417629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b36a0d77-e214-47e8-bddb-e98b07a96ec5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b36a0d77-e214-47e8-bddb-e98b07a96ec5.b37ec28f-8dbb-49af-b03e-3dd0431ad2cc 1G {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:21:35 devstack sudo[103917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b36a0d77-e214-47e8-bddb-e98b07a96ec5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b36a0d77-e214-47e8-bddb-e98b07a96ec5.b37ec28f-8dbb-49af-b03e-3dd0431ad2cc 1G Jul 10 10:21:35 devstack sudo[103917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:21:36 devstack sudo[103917]: pam_unix(sudo:session): session closed for user root Jul 10 10:21:36 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3c8929a3-da77-46c3-ab01-bcd51ecde960 tempest-VolumesExtendTest-1439417629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b36a0d77-e214-47e8-bddb-e98b07a96ec5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b36a0d77-e214-47e8-bddb-e98b07a96ec5.b37ec28f-8dbb-49af-b03e-3dd0431ad2cc 1G" returned: 0 in 0.852s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:21:36 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3c8929a3-da77-46c3-ab01-bcd51ecde960 tempest-VolumesExtendTest-1439417629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b36a0d77-e214-47e8-bddb-e98b07a96ec5 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b36a0d77-e214-47e8-bddb-e98b07a96ec5.b37ec28f-8dbb-49af-b03e-3dd0431ad2cc {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:21:36 devstack sudo[103923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b36a0d77-e214-47e8-bddb-e98b07a96ec5 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b36a0d77-e214-47e8-bddb-e98b07a96ec5.b37ec28f-8dbb-49af-b03e-3dd0431ad2cc Jul 10 10:21:36 devstack sudo[103923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:21:36 devstack sudo[103923]: pam_unix(sudo:session): session closed for user root Jul 10 10:21:36 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3c8929a3-da77-46c3-ab01-bcd51ecde960 tempest-VolumesExtendTest-1439417629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b36a0d77-e214-47e8-bddb-e98b07a96ec5 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b36a0d77-e214-47e8-bddb-e98b07a96ec5.b37ec28f-8dbb-49af-b03e-3dd0431ad2cc" returned: 0 in 0.724s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:21:36 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-3c8929a3-da77-46c3-ab01-bcd51ecde960 tempest-VolumesExtendTest-1439417629 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b36a0d77-e214-47e8-bddb-e98b07a96ec5.b37ec28f-8dbb-49af-b03e-3dd0431ad2cc is being set with open permissions: ugo+rw Jul 10 10:21:36 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3c8929a3-da77-46c3-ab01-bcd51ecde960 tempest-VolumesExtendTest-1439417629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b36a0d77-e214-47e8-bddb-e98b07a96ec5.b37ec28f-8dbb-49af-b03e-3dd0431ad2cc {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:21:36 devstack sudo[103929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b36a0d77-e214-47e8-bddb-e98b07a96ec5.b37ec28f-8dbb-49af-b03e-3dd0431ad2cc Jul 10 10:21:36 devstack sudo[103929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:21:37 devstack sudo[103929]: pam_unix(sudo:session): session closed for user root Jul 10 10:21:37 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3c8929a3-da77-46c3-ab01-bcd51ecde960 tempest-VolumesExtendTest-1439417629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b36a0d77-e214-47e8-bddb-e98b07a96ec5.b37ec28f-8dbb-49af-b03e-3dd0431ad2cc" returned: 0 in 0.670s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:21:37 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3c8929a3-da77-46c3-ab01-bcd51ecde960 tempest-VolumesExtendTest-1439417629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b36a0d77-e214-47e8-bddb-e98b07a96ec5.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:21:37 devstack sudo[103933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b36a0d77-e214-47e8-bddb-e98b07a96ec5.info Jul 10 10:21:37 devstack sudo[103933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:21:38 devstack sudo[103933]: pam_unix(sudo:session): session closed for user root Jul 10 10:21:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3c8929a3-da77-46c3-ab01-bcd51ecde960 tempest-VolumesExtendTest-1439417629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b36a0d77-e214-47e8-bddb-e98b07a96ec5.info" returned: 0 in 0.685s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:21:38 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-3c8929a3-da77-46c3-ab01-bcd51ecde960 tempest-VolumesExtendTest-1439417629 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b36a0d77-e214-47e8-bddb-e98b07a96ec5.info is being set with open permissions: ugo+rw Jul 10 10:21:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3c8929a3-da77-46c3-ab01-bcd51ecde960 tempest-VolumesExtendTest-1439417629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b36a0d77-e214-47e8-bddb-e98b07a96ec5.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:21:38 devstack sudo[103936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b36a0d77-e214-47e8-bddb-e98b07a96ec5.info Jul 10 10:21:38 devstack sudo[103936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:21:39 devstack sudo[103936]: pam_unix(sudo:session): session closed for user root Jul 10 10:21:39 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3c8929a3-da77-46c3-ab01-bcd51ecde960 tempest-VolumesExtendTest-1439417629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b36a0d77-e214-47e8-bddb-e98b07a96ec5.info" returned: 0 in 0.718s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:21:39 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-3c8929a3-da77-46c3-ab01-bcd51ecde960 tempest-VolumesExtendTest-1439417629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.544s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:21:39 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-3c8929a3-da77-46c3-ab01-bcd51ecde960 tempest-VolumesExtendTest-1439417629 None] Create snapshot completed successfully Jul 10 10:21:39 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-10143ec8-a3ec-4957-920b-eb68bf2b53fb tempest-VolumesExtendTest-1439417629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:21:39 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-10143ec8-a3ec-4957-920b-eb68bf2b53fb tempest-VolumesExtendTest-1439417629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:21:39 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d5e5af-a2b3-44e4-89ef-5787821b5c14]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:21:39 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-10143ec8-a3ec-4957-920b-eb68bf2b53fb tempest-VolumesExtendTest-1439417629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b36a0d77-e214-47e8-bddb-e98b07a96ec5 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:21:39 devstack sudo[103939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b36a0d77-e214-47e8-bddb-e98b07a96ec5 Jul 10 10:21:39 devstack sudo[103939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:21:40 devstack sudo[103939]: pam_unix(sudo:session): session closed for user root Jul 10 10:21:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-10143ec8-a3ec-4957-920b-eb68bf2b53fb tempest-VolumesExtendTest-1439417629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b36a0d77-e214-47e8-bddb-e98b07a96ec5" returned: 0 in 0.800s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:21:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-10143ec8-a3ec-4957-920b-eb68bf2b53fb tempest-VolumesExtendTest-1439417629 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b36a0d77-e214-47e8-bddb-e98b07a96ec5.b37ec28f-8dbb-49af-b03e-3dd0431ad2cc 2G {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:21:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-10143ec8-a3ec-4957-920b-eb68bf2b53fb tempest-VolumesExtendTest-1439417629 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b36a0d77-e214-47e8-bddb-e98b07a96ec5.b37ec28f-8dbb-49af-b03e-3dd0431ad2cc 2G" returned: 0 in 0.113s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:21:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-10143ec8-a3ec-4957-920b-eb68bf2b53fb tempest-VolumesExtendTest-1439417629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.949s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:21:40 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-10143ec8-a3ec-4957-920b-eb68bf2b53fb tempest-VolumesExtendTest-1439417629 None] Extend volume completed successfully. Jul 10 10:21:41 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-51a0121b-a58e-4144-b2e8-8f5d8039fdbd tempest-VolumesExtendTest-1439417629 None] Acquiring lock "cinder-b37ec28f-8dbb-49af-b03e-3dd0431ad2cc-delete_snapshot" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:21:41 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-51a0121b-a58e-4144-b2e8-8f5d8039fdbd tempest-VolumesExtendTest-1439417629 None] Lock "cinder-b37ec28f-8dbb-49af-b03e-3dd0431ad2cc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:21:41 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-51a0121b-a58e-4144-b2e8-8f5d8039fdbd tempest-VolumesExtendTest-1439417629 None] Acquiring lock "cinder-quobyte-b36a0d77-e214-47e8-bddb-e98b07a96ec5" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:21:41 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-51a0121b-a58e-4144-b2e8-8f5d8039fdbd tempest-VolumesExtendTest-1439417629 None] Lock "cinder-quobyte-b36a0d77-e214-47e8-bddb-e98b07a96ec5" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:21:41 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-51a0121b-a58e-4144-b2e8-8f5d8039fdbd tempest-VolumesExtendTest-1439417629 None] Acquiring lock "cinder-quobyte-b37ec28f-8dbb-49af-b03e-3dd0431ad2cc" by "_delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:21:41 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-51a0121b-a58e-4144-b2e8-8f5d8039fdbd tempest-VolumesExtendTest-1439417629 None] Lock "cinder-quobyte-b37ec28f-8dbb-49af-b03e-3dd0431ad2cc" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:21:41 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-51a0121b-a58e-4144-b2e8-8f5d8039fdbd tempest-VolumesExtendTest-1439417629 None] Deleting offline snapshot b37ec28f-8dbb-49af-b03e-3dd0431ad2cc of volume b36a0d77-e214-47e8-bddb-e98b07a96ec5 {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 10:21:41 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-51a0121b-a58e-4144-b2e8-8f5d8039fdbd tempest-VolumesExtendTest-1439417629 None] snapshot_file for this snap is: volume-b36a0d77-e214-47e8-bddb-e98b07a96ec5.b37ec28f-8dbb-49af-b03e-3dd0431ad2cc {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 10:21:41 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5beb08-6ef0-4452-b01e-6682690ed166]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:21:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-51a0121b-a58e-4144-b2e8-8f5d8039fdbd tempest-VolumesExtendTest-1439417629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b36a0d77-e214-47e8-bddb-e98b07a96ec5.b37ec28f-8dbb-49af-b03e-3dd0431ad2cc {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:21:41 devstack sudo[103947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b36a0d77-e214-47e8-bddb-e98b07a96ec5.b37ec28f-8dbb-49af-b03e-3dd0431ad2cc Jul 10 10:21:41 devstack sudo[103947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:21:41 devstack sudo[103947]: pam_unix(sudo:session): session closed for user root Jul 10 10:21:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-51a0121b-a58e-4144-b2e8-8f5d8039fdbd tempest-VolumesExtendTest-1439417629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b36a0d77-e214-47e8-bddb-e98b07a96ec5.b37ec28f-8dbb-49af-b03e-3dd0431ad2cc" returned: 0 in 0.754s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:21:41 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-51a0121b-a58e-4144-b2e8-8f5d8039fdbd tempest-VolumesExtendTest-1439417629 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b36a0d77-e214-47e8-bddb-e98b07a96ec5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 10:21:41 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f45196-18d4-4839-9048-1f3024b4b44e]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:21:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-51a0121b-a58e-4144-b2e8-8f5d8039fdbd tempest-VolumesExtendTest-1439417629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b36a0d77-e214-47e8-bddb-e98b07a96ec5 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:21:42 devstack sudo[103952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b36a0d77-e214-47e8-bddb-e98b07a96ec5 Jul 10 10:21:42 devstack sudo[103952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:21:42 devstack cinder-volume[87234]: DEBUG oslo_service.periodic_task [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 10:21:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:21:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:21:42 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:21:42 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:21:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:21:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:21:42 devstack sudo[103954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:21:42 devstack sudo[103954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:21:42 devstack sudo[103952]: pam_unix(sudo:session): session closed for user root Jul 10 10:21:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-51a0121b-a58e-4144-b2e8-8f5d8039fdbd tempest-VolumesExtendTest-1439417629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b36a0d77-e214-47e8-bddb-e98b07a96ec5" returned: 0 in 0.765s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:21:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-51a0121b-a58e-4144-b2e8-8f5d8039fdbd tempest-VolumesExtendTest-1439417629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b36a0d77-e214-47e8-bddb-e98b07a96ec5.b37ec28f-8dbb-49af-b03e-3dd0431ad2cc {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:21:42 devstack sudo[103960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b36a0d77-e214-47e8-bddb-e98b07a96ec5.b37ec28f-8dbb-49af-b03e-3dd0431ad2cc Jul 10 10:21:42 devstack sudo[103960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:21:42 devstack sudo[103954]: pam_unix(sudo:session): session closed for user root Jul 10 10:21:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.657s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:21:42 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:21:42 devstack cinder-volume[87234]: DEBUG oslo_service.periodic_task [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Running periodic task VolumeManager._thread_info {{(pid=87234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 10:21:42 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] thread count: 28 {{(pid=87234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 10:21:42 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] thread info: [<_MainThread(MainThread, started 131600773742720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 10:21:43 devstack sudo[103960]: pam_unix(sudo:session): session closed for user root Jul 10 10:21:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-51a0121b-a58e-4144-b2e8-8f5d8039fdbd tempest-VolumesExtendTest-1439417629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b36a0d77-e214-47e8-bddb-e98b07a96ec5.b37ec28f-8dbb-49af-b03e-3dd0431ad2cc" returned: 0 in 0.758s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:21:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-51a0121b-a58e-4144-b2e8-8f5d8039fdbd tempest-VolumesExtendTest-1439417629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b36a0d77-e214-47e8-bddb-e98b07a96ec5.b37ec28f-8dbb-49af-b03e-3dd0431ad2cc {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:21:43 devstack sudo[103966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b36a0d77-e214-47e8-bddb-e98b07a96ec5.b37ec28f-8dbb-49af-b03e-3dd0431ad2cc Jul 10 10:21:43 devstack sudo[103966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:21:44 devstack sudo[103966]: pam_unix(sudo:session): session closed for user root Jul 10 10:21:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-51a0121b-a58e-4144-b2e8-8f5d8039fdbd tempest-VolumesExtendTest-1439417629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b36a0d77-e214-47e8-bddb-e98b07a96ec5.b37ec28f-8dbb-49af-b03e-3dd0431ad2cc" returned: 0 in 0.654s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:21:44 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-51a0121b-a58e-4144-b2e8-8f5d8039fdbd tempest-VolumesExtendTest-1439417629 None] Lock "cinder-quobyte-b37ec28f-8dbb-49af-b03e-3dd0431ad2cc" released by "_delete_snapshot" :: held 3.035s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:21:44 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-51a0121b-a58e-4144-b2e8-8f5d8039fdbd tempest-VolumesExtendTest-1439417629 None] Lock "cinder-quobyte-b36a0d77-e214-47e8-bddb-e98b07a96ec5" released by "delete_snapshot" :: held 3.060s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:21:44 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-51a0121b-a58e-4144-b2e8-8f5d8039fdbd tempest-VolumesExtendTest-1439417629 None] Created reservations ['d3a2cd1f-206d-4b10-b6fb-b91135fc7976', '81ff4b7e-33e6-48e0-8417-4db486c51368', '42c84e76-8579-4493-81f4-0c382a2d7ea8', 'd236165d-b137-4749-b382-0d1af2b9056b'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:21:44 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-51a0121b-a58e-4144-b2e8-8f5d8039fdbd tempest-VolumesExtendTest-1439417629 None] Delete snapshot completed successfully. Jul 10 10:21:44 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-51a0121b-a58e-4144-b2e8-8f5d8039fdbd tempest-VolumesExtendTest-1439417629 None] Lock "cinder-b37ec28f-8dbb-49af-b03e-3dd0431ad2cc-delete_snapshot" released by "delete_snapshot" :: held 3.193s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:21:45 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-90e9ed82-682e-4ffd-a24c-fba415d9546b tempest-VolumesExtendTest-1439417629 None] Acquiring lock "cinder-b36a0d77-e214-47e8-bddb-e98b07a96ec5-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:21:45 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-90e9ed82-682e-4ffd-a24c-fba415d9546b tempest-VolumesExtendTest-1439417629 None] Lock "cinder-b36a0d77-e214-47e8-bddb-e98b07a96ec5-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:21:45 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-90e9ed82-682e-4ffd-a24c-fba415d9546b tempest-VolumesExtendTest-1439417629 None] Acquiring lock "cinder-quobyte-b36a0d77-e214-47e8-bddb-e98b07a96ec5" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:21:45 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-90e9ed82-682e-4ffd-a24c-fba415d9546b tempest-VolumesExtendTest-1439417629 None] Lock "cinder-quobyte-b36a0d77-e214-47e8-bddb-e98b07a96ec5" acquired by "delete_volume" :: waited 0.015s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:21:45 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[a171456e-3286-4439-a668-ee7795b31d4a]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:21:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-90e9ed82-682e-4ffd-a24c-fba415d9546b tempest-VolumesExtendTest-1439417629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b36a0d77-e214-47e8-bddb-e98b07a96ec5 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:21:45 devstack sudo[103969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b36a0d77-e214-47e8-bddb-e98b07a96ec5 Jul 10 10:21:45 devstack sudo[103969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:21:46 devstack sudo[103969]: pam_unix(sudo:session): session closed for user root Jul 10 10:21:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-90e9ed82-682e-4ffd-a24c-fba415d9546b tempest-VolumesExtendTest-1439417629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b36a0d77-e214-47e8-bddb-e98b07a96ec5" returned: 0 in 0.761s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:21:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-90e9ed82-682e-4ffd-a24c-fba415d9546b tempest-VolumesExtendTest-1439417629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b36a0d77-e214-47e8-bddb-e98b07a96ec5 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:21:46 devstack sudo[103974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b36a0d77-e214-47e8-bddb-e98b07a96ec5 Jul 10 10:21:46 devstack sudo[103974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:21:46 devstack sudo[103974]: pam_unix(sudo:session): session closed for user root Jul 10 10:21:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-90e9ed82-682e-4ffd-a24c-fba415d9546b tempest-VolumesExtendTest-1439417629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b36a0d77-e214-47e8-bddb-e98b07a96ec5" returned: 0 in 0.645s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:21:46 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-90e9ed82-682e-4ffd-a24c-fba415d9546b tempest-VolumesExtendTest-1439417629 None] Lock "cinder-quobyte-b36a0d77-e214-47e8-bddb-e98b07a96ec5" released by "delete_volume" :: held 1.465s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:21:46 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-90e9ed82-682e-4ffd-a24c-fba415d9546b tempest-VolumesExtendTest-1439417629 None] Created reservations ['b260daa3-7883-4ebf-82d2-b0ea1a44392e', '6eba2687-96fc-4ad1-8706-cdcd975cdb58', 'e95f2376-c590-4d23-9a9f-03396d3fcea4', '73d72d84-03b6-47a2-bcfe-4b5b2ee52fc8'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:21:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-90e9ed82-682e-4ffd-a24c-fba415d9546b tempest-VolumesExtendTest-1439417629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:21:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-90e9ed82-682e-4ffd-a24c-fba415d9546b tempest-VolumesExtendTest-1439417629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:21:46 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-90e9ed82-682e-4ffd-a24c-fba415d9546b tempest-VolumesExtendTest-1439417629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:21:46 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-90e9ed82-682e-4ffd-a24c-fba415d9546b tempest-VolumesExtendTest-1439417629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:21:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-90e9ed82-682e-4ffd-a24c-fba415d9546b tempest-VolumesExtendTest-1439417629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:21:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-90e9ed82-682e-4ffd-a24c-fba415d9546b tempest-VolumesExtendTest-1439417629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:21:47 devstack sudo[103977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:21:47 devstack sudo[103977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:21:47 devstack sudo[103977]: pam_unix(sudo:session): session closed for user root Jul 10 10:21:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-90e9ed82-682e-4ffd-a24c-fba415d9546b tempest-VolumesExtendTest-1439417629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.662s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:21:47 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-90e9ed82-682e-4ffd-a24c-fba415d9546b tempest-VolumesExtendTest-1439417629 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:21:47 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-90e9ed82-682e-4ffd-a24c-fba415d9546b tempest-VolumesExtendTest-1439417629 None] Deleted volume successfully. Jul 10 10:21:47 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-90e9ed82-682e-4ffd-a24c-fba415d9546b tempest-VolumesExtendTest-1439417629 None] Lock "cinder-b36a0d77-e214-47e8-bddb-e98b07a96ec5-delete_volume" released by "delete_volume" :: held 2.315s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:21:50 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-630b54cc-58f3-4862-93ab-0c594de5c242 tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:21:50 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-630b54cc-58f3-4862-93ab-0c594de5c242 tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] Flow 'volume_create_manager' (23b8a5bf-8c80-4abb-bf1d-73ebac3e6edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:21:50 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-630b54cc-58f3-4862-93ab-0c594de5c242 tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d019097f-2f39-4b13-ab73-ae49d287f596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:21:50 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-630b54cc-58f3-4862-93ab-0c594de5c242 tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d019097f-2f39-4b13-ab73-ae49d287f596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:21:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-612568735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f5ab4ab-6d92-4471-9750-286d6a1f8f68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa76448955dc442389b3348c1c9521fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:21:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:21:50Z,use_quota=True,user_id='35a1d872070b423b96d51c6020f36016',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:21:50 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-630b54cc-58f3-4862-93ab-0c594de5c242 tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e168852-16af-4783-9195-b2110644b0f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:21:50 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-630b54cc-58f3-4862-93ab-0c594de5c242 tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e168852-16af-4783-9195-b2110644b0f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:21:50 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-630b54cc-58f3-4862-93ab-0c594de5c242 tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47dcfb78-9e75-4856-8e68-14ad75506523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:21:50 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-630b54cc-58f3-4862-93ab-0c594de5c242 tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47dcfb78-9e75-4856-8e68-14ad75506523) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f5ab4ab-6d92-4471-9750-286d6a1f8f68', 'volume_name': 'volume-0f5ab4ab-6d92-4471-9750-286d6a1f8f68', 'volume_size': 2}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:21:50 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-630b54cc-58f3-4862-93ab-0c594de5c242 tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2e04ecb-5b88-4558-8d90-a981900d7980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:21:50 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-630b54cc-58f3-4862-93ab-0c594de5c242 tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2e04ecb-5b88-4558-8d90-a981900d7980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:21:50 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-630b54cc-58f3-4862-93ab-0c594de5c242 tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a45ec388-06b8-4b75-9b2f-f617eadbed23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:21:50 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-630b54cc-58f3-4862-93ab-0c594de5c242 tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] Volume 0f5ab4ab-6d92-4471-9750-286d6a1f8f68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f5ab4ab-6d92-4471-9750-286d6a1f8f68', 'volume_size': 2} Jul 10 10:21:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-630b54cc-58f3-4862-93ab-0c594de5c242 tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:21:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-630b54cc-58f3-4862-93ab-0c594de5c242 tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:21:50 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-630b54cc-58f3-4862-93ab-0c594de5c242 tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:21:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-612568735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f5ab4ab-6d92-4471-9750-286d6a1f8f68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa76448955dc442389b3348c1c9521fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:21:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:21:50Z,use_quota=True,user_id='35a1d872070b423b96d51c6020f36016',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:21:50 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-630b54cc-58f3-4862-93ab-0c594de5c242 tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] Creating volume 0f5ab4ab-6d92-4471-9750-286d6a1f8f68 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:21:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-630b54cc-58f3-4862-93ab-0c594de5c242 tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:21:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-630b54cc-58f3-4862-93ab-0c594de5c242 tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:21:50 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-630b54cc-58f3-4862-93ab-0c594de5c242 tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:21:50 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-630b54cc-58f3-4862-93ab-0c594de5c242 tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:21:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-630b54cc-58f3-4862-93ab-0c594de5c242 tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:21:50 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-630b54cc-58f3-4862-93ab-0c594de5c242 tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:21:50 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-630b54cc-58f3-4862-93ab-0c594de5c242 tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:21:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-630b54cc-58f3-4862-93ab-0c594de5c242 tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0f5ab4ab-6d92-4471-9750-286d6a1f8f68 2147483648 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:21:50 devstack sudo[103981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0f5ab4ab-6d92-4471-9750-286d6a1f8f68 2147483648 Jul 10 10:21:50 devstack sudo[103981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:21:51 devstack sudo[103981]: pam_unix(sudo:session): session closed for user root Jul 10 10:21:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-630b54cc-58f3-4862-93ab-0c594de5c242 tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0f5ab4ab-6d92-4471-9750-286d6a1f8f68 2147483648" returned: 0 in 0.897s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:21:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-630b54cc-58f3-4862-93ab-0c594de5c242 tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0f5ab4ab-6d92-4471-9750-286d6a1f8f68 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:21:51 devstack sudo[103987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0f5ab4ab-6d92-4471-9750-286d6a1f8f68 Jul 10 10:21:51 devstack sudo[103987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:21:51 devstack sudo[103987]: pam_unix(sudo:session): session closed for user root Jul 10 10:21:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-630b54cc-58f3-4862-93ab-0c594de5c242 tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0f5ab4ab-6d92-4471-9750-286d6a1f8f68" returned: 0 in 0.645s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:21:51 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-630b54cc-58f3-4862-93ab-0c594de5c242 tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] <== create_volume: return (1587ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:21:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-630b54cc-58f3-4862-93ab-0c594de5c242 tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.590s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:21:51 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-630b54cc-58f3-4862-93ab-0c594de5c242 tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a45ec388-06b8-4b75-9b2f-f617eadbed23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f5ab4ab-6d92-4471-9750-286d6a1f8f68', 'volume_size': 2}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:21:51 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-630b54cc-58f3-4862-93ab-0c594de5c242 tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfea5f6e-3f34-4192-a80b-cdd11aacc6fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:21:52 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-630b54cc-58f3-4862-93ab-0c594de5c242 tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] Volume volume-0f5ab4ab-6d92-4471-9750-286d6a1f8f68 (0f5ab4ab-6d92-4471-9750-286d6a1f8f68): created successfully Jul 10 10:21:52 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-630b54cc-58f3-4862-93ab-0c594de5c242 tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfea5f6e-3f34-4192-a80b-cdd11aacc6fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:21:52 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-630b54cc-58f3-4862-93ab-0c594de5c242 tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] Flow 'volume_create_manager' (23b8a5bf-8c80-4abb-bf1d-73ebac3e6edf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:21:52 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-630b54cc-58f3-4862-93ab-0c594de5c242 tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] Created volume successfully. Jul 10 10:21:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-fecb1734-84d3-4a93-b66e-99601b0f5a75 tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:21:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-fecb1734-84d3-4a93-b66e-99601b0f5a75 tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:21:52 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-fecb1734-84d3-4a93-b66e-99601b0f5a75 tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] Creating offline snapshot 87c62e21-9ff3-4418-8fb1-c83c87eb40b2 of volume 0f5ab4ab-6d92-4471-9750-286d6a1f8f68 {{(pid=87234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 10:21:52 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9636d96-347c-4ea4-b643-99c7e7327417]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:21:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fecb1734-84d3-4a93-b66e-99601b0f5a75 tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0f5ab4ab-6d92-4471-9750-286d6a1f8f68 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:21:52 devstack sudo[103990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0f5ab4ab-6d92-4471-9750-286d6a1f8f68 Jul 10 10:21:52 devstack sudo[103990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:21:53 devstack sudo[103990]: pam_unix(sudo:session): session closed for user root Jul 10 10:21:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fecb1734-84d3-4a93-b66e-99601b0f5a75 tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0f5ab4ab-6d92-4471-9750-286d6a1f8f68" returned: 0 in 0.773s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:21:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fecb1734-84d3-4a93-b66e-99601b0f5a75 tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0f5ab4ab-6d92-4471-9750-286d6a1f8f68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0f5ab4ab-6d92-4471-9750-286d6a1f8f68.87c62e21-9ff3-4418-8fb1-c83c87eb40b2 2G {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:21:53 devstack sudo[103995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0f5ab4ab-6d92-4471-9750-286d6a1f8f68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0f5ab4ab-6d92-4471-9750-286d6a1f8f68.87c62e21-9ff3-4418-8fb1-c83c87eb40b2 2G Jul 10 10:21:53 devstack sudo[103995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:21:54 devstack sudo[103995]: pam_unix(sudo:session): session closed for user root Jul 10 10:21:54 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fecb1734-84d3-4a93-b66e-99601b0f5a75 tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0f5ab4ab-6d92-4471-9750-286d6a1f8f68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0f5ab4ab-6d92-4471-9750-286d6a1f8f68.87c62e21-9ff3-4418-8fb1-c83c87eb40b2 2G" returned: 0 in 0.817s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:21:54 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fecb1734-84d3-4a93-b66e-99601b0f5a75 tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f5ab4ab-6d92-4471-9750-286d6a1f8f68 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0f5ab4ab-6d92-4471-9750-286d6a1f8f68.87c62e21-9ff3-4418-8fb1-c83c87eb40b2 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:21:54 devstack sudo[104000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f5ab4ab-6d92-4471-9750-286d6a1f8f68 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0f5ab4ab-6d92-4471-9750-286d6a1f8f68.87c62e21-9ff3-4418-8fb1-c83c87eb40b2 Jul 10 10:21:54 devstack sudo[104000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:21:54 devstack sudo[104000]: pam_unix(sudo:session): session closed for user root Jul 10 10:21:54 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fecb1734-84d3-4a93-b66e-99601b0f5a75 tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f5ab4ab-6d92-4471-9750-286d6a1f8f68 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0f5ab4ab-6d92-4471-9750-286d6a1f8f68.87c62e21-9ff3-4418-8fb1-c83c87eb40b2" returned: 0 in 0.696s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:21:54 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-fecb1734-84d3-4a93-b66e-99601b0f5a75 tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0f5ab4ab-6d92-4471-9750-286d6a1f8f68.87c62e21-9ff3-4418-8fb1-c83c87eb40b2 is being set with open permissions: ugo+rw Jul 10 10:21:54 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fecb1734-84d3-4a93-b66e-99601b0f5a75 tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0f5ab4ab-6d92-4471-9750-286d6a1f8f68.87c62e21-9ff3-4418-8fb1-c83c87eb40b2 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:21:54 devstack sudo[104005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0f5ab4ab-6d92-4471-9750-286d6a1f8f68.87c62e21-9ff3-4418-8fb1-c83c87eb40b2 Jul 10 10:21:54 devstack sudo[104005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:21:55 devstack sudo[104005]: pam_unix(sudo:session): session closed for user root Jul 10 10:21:55 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fecb1734-84d3-4a93-b66e-99601b0f5a75 tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0f5ab4ab-6d92-4471-9750-286d6a1f8f68.87c62e21-9ff3-4418-8fb1-c83c87eb40b2" returned: 0 in 0.656s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:21:55 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fecb1734-84d3-4a93-b66e-99601b0f5a75 tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0f5ab4ab-6d92-4471-9750-286d6a1f8f68.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:21:55 devstack sudo[104008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0f5ab4ab-6d92-4471-9750-286d6a1f8f68.info Jul 10 10:21:55 devstack sudo[104008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:21:56 devstack sudo[104008]: pam_unix(sudo:session): session closed for user root Jul 10 10:21:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fecb1734-84d3-4a93-b66e-99601b0f5a75 tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0f5ab4ab-6d92-4471-9750-286d6a1f8f68.info" returned: 0 in 0.659s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:21:56 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-fecb1734-84d3-4a93-b66e-99601b0f5a75 tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0f5ab4ab-6d92-4471-9750-286d6a1f8f68.info is being set with open permissions: ugo+rw Jul 10 10:21:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fecb1734-84d3-4a93-b66e-99601b0f5a75 tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0f5ab4ab-6d92-4471-9750-286d6a1f8f68.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:21:56 devstack sudo[104011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0f5ab4ab-6d92-4471-9750-286d6a1f8f68.info Jul 10 10:21:56 devstack sudo[104011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:21:56 devstack sudo[104011]: pam_unix(sudo:session): session closed for user root Jul 10 10:21:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fecb1734-84d3-4a93-b66e-99601b0f5a75 tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0f5ab4ab-6d92-4471-9750-286d6a1f8f68.info" returned: 0 in 0.645s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:21:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-fecb1734-84d3-4a93-b66e-99601b0f5a75 tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.330s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:21:56 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-fecb1734-84d3-4a93-b66e-99601b0f5a75 tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] Create snapshot completed successfully Jul 10 10:21:57 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-2460c0c6-e0c0-466b-b3ce-6a7e40a9765d tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] Acquiring lock "cinder-87c62e21-9ff3-4418-8fb1-c83c87eb40b2-delete_snapshot" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:21:57 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-2460c0c6-e0c0-466b-b3ce-6a7e40a9765d tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] Lock "cinder-87c62e21-9ff3-4418-8fb1-c83c87eb40b2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:21:57 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-2460c0c6-e0c0-466b-b3ce-6a7e40a9765d tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] Acquiring lock "cinder-quobyte-0f5ab4ab-6d92-4471-9750-286d6a1f8f68" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:21:57 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-2460c0c6-e0c0-466b-b3ce-6a7e40a9765d tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] Lock "cinder-quobyte-0f5ab4ab-6d92-4471-9750-286d6a1f8f68" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:21:57 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-2460c0c6-e0c0-466b-b3ce-6a7e40a9765d tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] Acquiring lock "cinder-quobyte-87c62e21-9ff3-4418-8fb1-c83c87eb40b2" by "_delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:21:57 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-2460c0c6-e0c0-466b-b3ce-6a7e40a9765d tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] Lock "cinder-quobyte-87c62e21-9ff3-4418-8fb1-c83c87eb40b2" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:21:57 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-2460c0c6-e0c0-466b-b3ce-6a7e40a9765d tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] Deleting offline snapshot 87c62e21-9ff3-4418-8fb1-c83c87eb40b2 of volume 0f5ab4ab-6d92-4471-9750-286d6a1f8f68 {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 10:21:57 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-2460c0c6-e0c0-466b-b3ce-6a7e40a9765d tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] snapshot_file for this snap is: volume-0f5ab4ab-6d92-4471-9750-286d6a1f8f68.87c62e21-9ff3-4418-8fb1-c83c87eb40b2 {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 10:21:57 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f4a1a2-cea9-4868-92ce-dea4742c2b20]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:21:57 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-2460c0c6-e0c0-466b-b3ce-6a7e40a9765d tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0f5ab4ab-6d92-4471-9750-286d6a1f8f68.87c62e21-9ff3-4418-8fb1-c83c87eb40b2 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:21:58 devstack sudo[104015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0f5ab4ab-6d92-4471-9750-286d6a1f8f68.87c62e21-9ff3-4418-8fb1-c83c87eb40b2 Jul 10 10:21:58 devstack sudo[104015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:21:58 devstack sudo[104015]: pam_unix(sudo:session): session closed for user root Jul 10 10:21:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-2460c0c6-e0c0-466b-b3ce-6a7e40a9765d tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0f5ab4ab-6d92-4471-9750-286d6a1f8f68.87c62e21-9ff3-4418-8fb1-c83c87eb40b2" returned: 0 in 0.754s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:21:58 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-2460c0c6-e0c0-466b-b3ce-6a7e40a9765d tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f5ab4ab-6d92-4471-9750-286d6a1f8f68(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 10:21:58 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[150e583f-4701-4085-815b-01aeb9b5ea4d]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:21:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-2460c0c6-e0c0-466b-b3ce-6a7e40a9765d tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0f5ab4ab-6d92-4471-9750-286d6a1f8f68 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:21:58 devstack sudo[104020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0f5ab4ab-6d92-4471-9750-286d6a1f8f68 Jul 10 10:21:58 devstack sudo[104020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:21:59 devstack sudo[104020]: pam_unix(sudo:session): session closed for user root Jul 10 10:21:59 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-2460c0c6-e0c0-466b-b3ce-6a7e40a9765d tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0f5ab4ab-6d92-4471-9750-286d6a1f8f68" returned: 0 in 0.756s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:21:59 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-2460c0c6-e0c0-466b-b3ce-6a7e40a9765d tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0f5ab4ab-6d92-4471-9750-286d6a1f8f68.87c62e21-9ff3-4418-8fb1-c83c87eb40b2 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:21:59 devstack sudo[104025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0f5ab4ab-6d92-4471-9750-286d6a1f8f68.87c62e21-9ff3-4418-8fb1-c83c87eb40b2 Jul 10 10:21:59 devstack sudo[104025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:22:00 devstack sudo[104025]: pam_unix(sudo:session): session closed for user root Jul 10 10:22:00 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-2460c0c6-e0c0-466b-b3ce-6a7e40a9765d tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0f5ab4ab-6d92-4471-9750-286d6a1f8f68.87c62e21-9ff3-4418-8fb1-c83c87eb40b2" returned: 0 in 0.756s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:22:00 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-2460c0c6-e0c0-466b-b3ce-6a7e40a9765d tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0f5ab4ab-6d92-4471-9750-286d6a1f8f68.87c62e21-9ff3-4418-8fb1-c83c87eb40b2 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:22:00 devstack sudo[104030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0f5ab4ab-6d92-4471-9750-286d6a1f8f68.87c62e21-9ff3-4418-8fb1-c83c87eb40b2 Jul 10 10:22:00 devstack sudo[104030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:22:00 devstack sudo[104030]: pam_unix(sudo:session): session closed for user root Jul 10 10:22:00 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-2460c0c6-e0c0-466b-b3ce-6a7e40a9765d tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0f5ab4ab-6d92-4471-9750-286d6a1f8f68.87c62e21-9ff3-4418-8fb1-c83c87eb40b2" returned: 0 in 0.666s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:22:00 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-2460c0c6-e0c0-466b-b3ce-6a7e40a9765d tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] Lock "cinder-quobyte-87c62e21-9ff3-4418-8fb1-c83c87eb40b2" released by "_delete_snapshot" :: held 3.032s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:22:00 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-2460c0c6-e0c0-466b-b3ce-6a7e40a9765d tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] Lock "cinder-quobyte-0f5ab4ab-6d92-4471-9750-286d6a1f8f68" released by "delete_snapshot" :: held 3.062s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:22:00 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-2460c0c6-e0c0-466b-b3ce-6a7e40a9765d tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] Created reservations ['db3d9d21-36ad-4872-a3ee-49ef20d23204', '0ac330e1-2f5a-4315-8727-ac888f83754d', '66840278-d7a8-4f57-9cb3-ae1709e89d11', '9f15b990-3da0-4cb4-900d-69cf9302f2f8'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:22:01 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-2460c0c6-e0c0-466b-b3ce-6a7e40a9765d tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] Delete snapshot completed successfully. Jul 10 10:22:01 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-2460c0c6-e0c0-466b-b3ce-6a7e40a9765d tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] Lock "cinder-87c62e21-9ff3-4418-8fb1-c83c87eb40b2-delete_snapshot" released by "delete_snapshot" :: held 3.192s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:22:02 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-c3a869de-da75-4b86-a84b-c11a47e9d304 tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] Acquiring lock "cinder-0f5ab4ab-6d92-4471-9750-286d6a1f8f68-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:22:02 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-c3a869de-da75-4b86-a84b-c11a47e9d304 tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] Lock "cinder-0f5ab4ab-6d92-4471-9750-286d6a1f8f68-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:22:02 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-c3a869de-da75-4b86-a84b-c11a47e9d304 tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] Acquiring lock "cinder-quobyte-0f5ab4ab-6d92-4471-9750-286d6a1f8f68" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:22:02 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-c3a869de-da75-4b86-a84b-c11a47e9d304 tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] Lock "cinder-quobyte-0f5ab4ab-6d92-4471-9750-286d6a1f8f68" acquired by "delete_volume" :: waited 0.014s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:22:02 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ea851f-b159-4cef-aabc-0d58ff01b5bd]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:22:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c3a869de-da75-4b86-a84b-c11a47e9d304 tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0f5ab4ab-6d92-4471-9750-286d6a1f8f68 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:22:02 devstack sudo[104033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0f5ab4ab-6d92-4471-9750-286d6a1f8f68 Jul 10 10:22:02 devstack sudo[104033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:22:02 devstack sudo[104033]: pam_unix(sudo:session): session closed for user root Jul 10 10:22:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c3a869de-da75-4b86-a84b-c11a47e9d304 tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0f5ab4ab-6d92-4471-9750-286d6a1f8f68" returned: 0 in 0.767s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:22:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c3a869de-da75-4b86-a84b-c11a47e9d304 tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0f5ab4ab-6d92-4471-9750-286d6a1f8f68 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:22:02 devstack sudo[104038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0f5ab4ab-6d92-4471-9750-286d6a1f8f68 Jul 10 10:22:02 devstack sudo[104038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:22:03 devstack sudo[104038]: pam_unix(sudo:session): session closed for user root Jul 10 10:22:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c3a869de-da75-4b86-a84b-c11a47e9d304 tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0f5ab4ab-6d92-4471-9750-286d6a1f8f68" returned: 0 in 0.651s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:22:03 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-c3a869de-da75-4b86-a84b-c11a47e9d304 tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] Lock "cinder-quobyte-0f5ab4ab-6d92-4471-9750-286d6a1f8f68" released by "delete_volume" :: held 1.474s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:22:03 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-c3a869de-da75-4b86-a84b-c11a47e9d304 tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] Created reservations ['36c576f2-b1c3-4906-af0c-a476c60a5844', '9689f169-6c00-44ce-8ea9-76591aaff4f2', 'e2cb5f7b-c3d8-4326-a0d8-24ef2fef356f', '7ef33e04-7a48-4471-9d34-4690f35142a1'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:22:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-c3a869de-da75-4b86-a84b-c11a47e9d304 tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:22:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-c3a869de-da75-4b86-a84b-c11a47e9d304 tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:22:03 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-c3a869de-da75-4b86-a84b-c11a47e9d304 tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:22:03 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-c3a869de-da75-4b86-a84b-c11a47e9d304 tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:22:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-c3a869de-da75-4b86-a84b-c11a47e9d304 tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:22:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c3a869de-da75-4b86-a84b-c11a47e9d304 tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:22:03 devstack sudo[104042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:22:03 devstack sudo[104042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:22:04 devstack sudo[104042]: pam_unix(sudo:session): session closed for user root Jul 10 10:22:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c3a869de-da75-4b86-a84b-c11a47e9d304 tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.654s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:22:04 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-c3a869de-da75-4b86-a84b-c11a47e9d304 tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:22:04 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-c3a869de-da75-4b86-a84b-c11a47e9d304 tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] Deleted volume successfully. Jul 10 10:22:04 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-c3a869de-da75-4b86-a84b-c11a47e9d304 tempest-VolumesSnapshotNegativeTestJSON-1542009494 None] Lock "cinder-0f5ab4ab-6d92-4471-9750-286d6a1f8f68-delete_volume" released by "delete_volume" :: held 2.326s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:22:13 devstack cinder-volume[87234]: DEBUG dbcounter [-] [87234] Writing DB stats cinder:SELECT=53,cinder:INSERT=19,cinder:UPDATE=54,cinder:DELETE=4 {{(pid=87234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 10:22:14 devstack cinder-volume[87234]: DEBUG dbcounter [-] [87234] Writing DB stats cinder:SELECT=45,cinder:UPDATE=65,cinder:INSERT=17,cinder:DELETE=5 {{(pid=87234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 10:22:28 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-537eae35-5523-4f8e-b9db-57247f3bab9b tempest-TestInstancesWithCinderVolumes-1702359969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:22:28 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-537eae35-5523-4f8e-b9db-57247f3bab9b tempest-TestInstancesWithCinderVolumes-1702359969 None] Flow 'volume_create_manager' (b7c8829f-67be-486b-b4dd-dc5fa0df825d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:22:28 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-537eae35-5523-4f8e-b9db-57247f3bab9b tempest-TestInstancesWithCinderVolumes-1702359969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5468eba2-fe82-4f82-a1d0-fe0763540516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:22:28 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-537eae35-5523-4f8e-b9db-57247f3bab9b tempest-TestInstancesWithCinderVolumes-1702359969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5468eba2-fe82-4f82-a1d0-fe0763540516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:22:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1509795501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10ea3281-aab0-4033-92d9-98db213dd46f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57483d20736a4be4962b4c405af47161',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:22:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:22:29Z,use_quota=True,user_id='9a7149b5d5fe45d9b9d6e922bceb01b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(683335e0-0c05-4a50-9f51-572d9f77812e),volume_type_id=683335e0-0c05-4a50-9f51-572d9f77812e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:22:28 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-537eae35-5523-4f8e-b9db-57247f3bab9b tempest-TestInstancesWithCinderVolumes-1702359969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (016306e7-d815-4cad-a759-38891ac767d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:22:28 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-537eae35-5523-4f8e-b9db-57247f3bab9b tempest-TestInstancesWithCinderVolumes-1702359969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (016306e7-d815-4cad-a759-38891ac767d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:22:28 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-537eae35-5523-4f8e-b9db-57247f3bab9b tempest-TestInstancesWithCinderVolumes-1702359969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (372e99ec-4221-4dd2-a0aa-b01da119aabe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:22:28 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-537eae35-5523-4f8e-b9db-57247f3bab9b tempest-TestInstancesWithCinderVolumes-1702359969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (372e99ec-4221-4dd2-a0aa-b01da119aabe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10ea3281-aab0-4033-92d9-98db213dd46f', 'volume_name': 'volume-10ea3281-aab0-4033-92d9-98db213dd46f', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:22:28 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-537eae35-5523-4f8e-b9db-57247f3bab9b tempest-TestInstancesWithCinderVolumes-1702359969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (313fb213-2da6-47fd-b34b-43c0a611e573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:22:28 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-537eae35-5523-4f8e-b9db-57247f3bab9b tempest-TestInstancesWithCinderVolumes-1702359969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (313fb213-2da6-47fd-b34b-43c0a611e573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:22:28 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-537eae35-5523-4f8e-b9db-57247f3bab9b tempest-TestInstancesWithCinderVolumes-1702359969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (328e7d92-1999-42b3-bd24-95c3d5420d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:22:28 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-537eae35-5523-4f8e-b9db-57247f3bab9b tempest-TestInstancesWithCinderVolumes-1702359969 None] Volume 10ea3281-aab0-4033-92d9-98db213dd46f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10ea3281-aab0-4033-92d9-98db213dd46f', 'volume_size': 1} Jul 10 10:22:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-537eae35-5523-4f8e-b9db-57247f3bab9b tempest-TestInstancesWithCinderVolumes-1702359969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:22:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-537eae35-5523-4f8e-b9db-57247f3bab9b tempest-TestInstancesWithCinderVolumes-1702359969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:22:28 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-537eae35-5523-4f8e-b9db-57247f3bab9b tempest-TestInstancesWithCinderVolumes-1702359969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:22:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1509795501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10ea3281-aab0-4033-92d9-98db213dd46f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57483d20736a4be4962b4c405af47161',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:22:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:22:29Z,use_quota=True,user_id='9a7149b5d5fe45d9b9d6e922bceb01b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(683335e0-0c05-4a50-9f51-572d9f77812e),volume_type_id=683335e0-0c05-4a50-9f51-572d9f77812e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:22:28 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-537eae35-5523-4f8e-b9db-57247f3bab9b tempest-TestInstancesWithCinderVolumes-1702359969 None] Creating volume 10ea3281-aab0-4033-92d9-98db213dd46f {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:22:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-537eae35-5523-4f8e-b9db-57247f3bab9b tempest-TestInstancesWithCinderVolumes-1702359969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:22:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-537eae35-5523-4f8e-b9db-57247f3bab9b tempest-TestInstancesWithCinderVolumes-1702359969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:22:28 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-537eae35-5523-4f8e-b9db-57247f3bab9b tempest-TestInstancesWithCinderVolumes-1702359969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:22:28 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-537eae35-5523-4f8e-b9db-57247f3bab9b tempest-TestInstancesWithCinderVolumes-1702359969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:22:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-537eae35-5523-4f8e-b9db-57247f3bab9b tempest-TestInstancesWithCinderVolumes-1702359969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:22:28 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-537eae35-5523-4f8e-b9db-57247f3bab9b tempest-TestInstancesWithCinderVolumes-1702359969 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:22:28 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-537eae35-5523-4f8e-b9db-57247f3bab9b tempest-TestInstancesWithCinderVolumes-1702359969 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:22:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-537eae35-5523-4f8e-b9db-57247f3bab9b tempest-TestInstancesWithCinderVolumes-1702359969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-10ea3281-aab0-4033-92d9-98db213dd46f 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:22:28 devstack sudo[104089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-10ea3281-aab0-4033-92d9-98db213dd46f 1073741824 Jul 10 10:22:28 devstack sudo[104089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:22:29 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-10113548-860d-4edc-9908-bc81219a3a1b tempest-TestInstancesWithCinderVolumes-1702359969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:22:29 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-10113548-860d-4edc-9908-bc81219a3a1b tempest-TestInstancesWithCinderVolumes-1702359969 None] Flow 'volume_create_manager' (ab7f2c7e-63c3-4cbf-ac5f-14e0cffaa383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:22:29 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-10113548-860d-4edc-9908-bc81219a3a1b tempest-TestInstancesWithCinderVolumes-1702359969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (993a6f61-a9d5-49c7-85fb-399e4dbcf701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:22:29 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-10113548-860d-4edc-9908-bc81219a3a1b tempest-TestInstancesWithCinderVolumes-1702359969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (993a6f61-a9d5-49c7-85fb-399e4dbcf701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:22:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-513329011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edeba1e3-5236-4ff4-9108-03591dd6fff2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57483d20736a4be4962b4c405af47161',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:22:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:22:29Z,use_quota=True,user_id='9a7149b5d5fe45d9b9d6e922bceb01b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a3ab519e-f3b9-49bd-9d5a-2ba348da1a8f),volume_type_id=a3ab519e-f3b9-49bd-9d5a-2ba348da1a8f)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:22:29 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-10113548-860d-4edc-9908-bc81219a3a1b tempest-TestInstancesWithCinderVolumes-1702359969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a04c4a4d-5fe4-48b5-ae75-0f30cbed483a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:22:29 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-10113548-860d-4edc-9908-bc81219a3a1b tempest-TestInstancesWithCinderVolumes-1702359969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a04c4a4d-5fe4-48b5-ae75-0f30cbed483a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:22:29 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-10113548-860d-4edc-9908-bc81219a3a1b tempest-TestInstancesWithCinderVolumes-1702359969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7023368-d082-4933-be7b-2e630cc391ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:22:29 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-10113548-860d-4edc-9908-bc81219a3a1b tempest-TestInstancesWithCinderVolumes-1702359969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7023368-d082-4933-be7b-2e630cc391ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edeba1e3-5236-4ff4-9108-03591dd6fff2', 'volume_name': 'volume-edeba1e3-5236-4ff4-9108-03591dd6fff2', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:22:29 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-10113548-860d-4edc-9908-bc81219a3a1b tempest-TestInstancesWithCinderVolumes-1702359969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9435b6d1-68f9-41da-b5cb-a42b69e88737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:22:29 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-10113548-860d-4edc-9908-bc81219a3a1b tempest-TestInstancesWithCinderVolumes-1702359969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9435b6d1-68f9-41da-b5cb-a42b69e88737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:22:29 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-10113548-860d-4edc-9908-bc81219a3a1b tempest-TestInstancesWithCinderVolumes-1702359969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2828edf2-f78f-4985-b7a3-29be5d01cc90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:22:29 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-10113548-860d-4edc-9908-bc81219a3a1b tempest-TestInstancesWithCinderVolumes-1702359969 None] Volume edeba1e3-5236-4ff4-9108-03591dd6fff2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edeba1e3-5236-4ff4-9108-03591dd6fff2', 'volume_size': 1} Jul 10 10:22:29 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-10113548-860d-4edc-9908-bc81219a3a1b tempest-TestInstancesWithCinderVolumes-1702359969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:22:29 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ef40842-2142-44de-b558-6a46214d34d1 tempest-TestInstancesWithCinderVolumes-1702359969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:22:29 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4ef40842-2142-44de-b558-6a46214d34d1 tempest-TestInstancesWithCinderVolumes-1702359969 None] Flow 'volume_create_manager' (66070ef0-9734-4384-9163-d3ecc0ef444b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:22:29 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4ef40842-2142-44de-b558-6a46214d34d1 tempest-TestInstancesWithCinderVolumes-1702359969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9e2a120-659f-4992-bf8e-e51dc3d4b667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:22:29 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4ef40842-2142-44de-b558-6a46214d34d1 tempest-TestInstancesWithCinderVolumes-1702359969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9e2a120-659f-4992-bf8e-e51dc3d4b667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:22:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-955292465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fe423e8-78ce-40d8-bf5c-323974185a1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57483d20736a4be4962b4c405af47161',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:22:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:22:30Z,use_quota=True,user_id='9a7149b5d5fe45d9b9d6e922bceb01b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(86572ac3-075b-4987-9d17-47d033e11922),volume_type_id=86572ac3-075b-4987-9d17-47d033e11922)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:22:29 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4ef40842-2142-44de-b558-6a46214d34d1 tempest-TestInstancesWithCinderVolumes-1702359969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0471d31d-f728-4385-a17e-8d48c5bd025e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:22:29 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4ef40842-2142-44de-b558-6a46214d34d1 tempest-TestInstancesWithCinderVolumes-1702359969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0471d31d-f728-4385-a17e-8d48c5bd025e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:22:29 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4ef40842-2142-44de-b558-6a46214d34d1 tempest-TestInstancesWithCinderVolumes-1702359969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1515e39a-73f9-4ce8-9bbb-181a9111257b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:22:29 devstack cinder-volume[87234]: DEBUG cinder.image.glance [None req-4ef40842-2142-44de-b558-6a46214d34d1 tempest-TestInstancesWithCinderVolumes-1702359969 None] Creating Keystone auth plugin from conf {{(pid=87234) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 10:22:29 devstack sudo[104089]: pam_unix(sudo:session): session closed for user root Jul 10 10:22:29 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-537eae35-5523-4f8e-b9db-57247f3bab9b tempest-TestInstancesWithCinderVolumes-1702359969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-10ea3281-aab0-4033-92d9-98db213dd46f 1073741824" returned: 0 in 0.910s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:22:29 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-537eae35-5523-4f8e-b9db-57247f3bab9b tempest-TestInstancesWithCinderVolumes-1702359969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-10ea3281-aab0-4033-92d9-98db213dd46f {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:22:29 devstack sudo[104094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-10ea3281-aab0-4033-92d9-98db213dd46f Jul 10 10:22:29 devstack sudo[104094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:22:29 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4ef40842-2142-44de-b558-6a46214d34d1 tempest-TestInstancesWithCinderVolumes-1702359969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1515e39a-73f9-4ce8-9bbb-181a9111257b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8fe423e8-78ce-40d8-bf5c-323974185a1f', 'volume_name': 'volume-8fe423e8-78ce-40d8-bf5c-323974185a1f', 'volume_size': 1, 'image_id': '0e5c5938-4bcb-4473-a733-8b46fc625bb2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0e5c5938-4bcb-4473-a733-8b46fc625bb2', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--998651201', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '57483d20736a4be4962b4c405af47161', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0e5c5938-4bcb-4473-a733-8b46fc625bb2', 'created_at': datetime.datetime(2026, 7, 10, 8, 22, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 8, 22, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0e5c5938-4bcb-4473-a733-8b46fc625bb2/file', 'properties': {}}, 'image_service': }' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:22:29 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4ef40842-2142-44de-b558-6a46214d34d1 tempest-TestInstancesWithCinderVolumes-1702359969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c785745d-5afb-46e7-9059-650d0c09e941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:22:29 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4ef40842-2142-44de-b558-6a46214d34d1 tempest-TestInstancesWithCinderVolumes-1702359969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c785745d-5afb-46e7-9059-650d0c09e941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:22:29 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4ef40842-2142-44de-b558-6a46214d34d1 tempest-TestInstancesWithCinderVolumes-1702359969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (324384c2-a5f7-49de-94a7-a6173e54e269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:22:29 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-4ef40842-2142-44de-b558-6a46214d34d1 tempest-TestInstancesWithCinderVolumes-1702359969 None] Volume 8fe423e8-78ce-40d8-bf5c-323974185a1f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8fe423e8-78ce-40d8-bf5c-323974185a1f', 'volume_size': 1, 'image_id': '0e5c5938-4bcb-4473-a733-8b46fc625bb2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0e5c5938-4bcb-4473-a733-8b46fc625bb2', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--998651201', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '57483d20736a4be4962b4c405af47161', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0e5c5938-4bcb-4473-a733-8b46fc625bb2', 'created_at': datetime.datetime(2026, 7, 10, 8, 22, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 8, 22, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0e5c5938-4bcb-4473-a733-8b46fc625bb2/file', 'properties': {}}, 'image_service': } Jul 10 10:22:29 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ef40842-2142-44de-b558-6a46214d34d1 tempest-TestInstancesWithCinderVolumes-1702359969 None] Trying to clone 8fe423e8-78ce-40d8-bf5c-323974185a1f from image 0e5c5938-4bcb-4473-a733-8b46fc625bb2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0e5c5938-4bcb-4473-a733-8b46fc625bb2', 'metadata': {}}]). {{(pid=87234) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 10:22:30 devstack sudo[104094]: pam_unix(sudo:session): session closed for user root Jul 10 10:22:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-537eae35-5523-4f8e-b9db-57247f3bab9b tempest-TestInstancesWithCinderVolumes-1702359969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-10ea3281-aab0-4033-92d9-98db213dd46f" returned: 0 in 0.678s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:22:30 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-537eae35-5523-4f8e-b9db-57247f3bab9b tempest-TestInstancesWithCinderVolumes-1702359969 None] <== create_volume: return (1687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:22:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-537eae35-5523-4f8e-b9db-57247f3bab9b tempest-TestInstancesWithCinderVolumes-1702359969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.689s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:22:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-10113548-860d-4edc-9908-bc81219a3a1b tempest-TestInstancesWithCinderVolumes-1702359969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.304s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:22:30 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-10113548-860d-4edc-9908-bc81219a3a1b tempest-TestInstancesWithCinderVolumes-1702359969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:22:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-513329011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edeba1e3-5236-4ff4-9108-03591dd6fff2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57483d20736a4be4962b4c405af47161',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:22:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:22:29Z,use_quota=True,user_id='9a7149b5d5fe45d9b9d6e922bceb01b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a3ab519e-f3b9-49bd-9d5a-2ba348da1a8f),volume_type_id=a3ab519e-f3b9-49bd-9d5a-2ba348da1a8f)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:22:30 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-10113548-860d-4edc-9908-bc81219a3a1b tempest-TestInstancesWithCinderVolumes-1702359969 None] Creating volume edeba1e3-5236-4ff4-9108-03591dd6fff2 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:22:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-10113548-860d-4edc-9908-bc81219a3a1b tempest-TestInstancesWithCinderVolumes-1702359969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:22:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-10113548-860d-4edc-9908-bc81219a3a1b tempest-TestInstancesWithCinderVolumes-1702359969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:22:30 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-10113548-860d-4edc-9908-bc81219a3a1b tempest-TestInstancesWithCinderVolumes-1702359969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:22:30 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-10113548-860d-4edc-9908-bc81219a3a1b tempest-TestInstancesWithCinderVolumes-1702359969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:22:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-10113548-860d-4edc-9908-bc81219a3a1b tempest-TestInstancesWithCinderVolumes-1702359969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:22:30 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-10113548-860d-4edc-9908-bc81219a3a1b tempest-TestInstancesWithCinderVolumes-1702359969 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:22:30 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-10113548-860d-4edc-9908-bc81219a3a1b tempest-TestInstancesWithCinderVolumes-1702359969 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:22:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-10113548-860d-4edc-9908-bc81219a3a1b tempest-TestInstancesWithCinderVolumes-1702359969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-edeba1e3-5236-4ff4-9108-03591dd6fff2 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:22:30 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-537eae35-5523-4f8e-b9db-57247f3bab9b tempest-TestInstancesWithCinderVolumes-1702359969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (328e7d92-1999-42b3-bd24-95c3d5420d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10ea3281-aab0-4033-92d9-98db213dd46f', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:22:30 devstack sudo[104103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-edeba1e3-5236-4ff4-9108-03591dd6fff2 1073741824 Jul 10 10:22:30 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-537eae35-5523-4f8e-b9db-57247f3bab9b tempest-TestInstancesWithCinderVolumes-1702359969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b03e38ac-3430-4651-98ba-7964d539b4cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:22:30 devstack sudo[104103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:22:30 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-537eae35-5523-4f8e-b9db-57247f3bab9b tempest-TestInstancesWithCinderVolumes-1702359969 None] Volume volume-10ea3281-aab0-4033-92d9-98db213dd46f (10ea3281-aab0-4033-92d9-98db213dd46f): created successfully Jul 10 10:22:30 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-537eae35-5523-4f8e-b9db-57247f3bab9b tempest-TestInstancesWithCinderVolumes-1702359969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b03e38ac-3430-4651-98ba-7964d539b4cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:22:30 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-537eae35-5523-4f8e-b9db-57247f3bab9b tempest-TestInstancesWithCinderVolumes-1702359969 None] Flow 'volume_create_manager' (b7c8829f-67be-486b-b4dd-dc5fa0df825d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:22:30 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-537eae35-5523-4f8e-b9db-57247f3bab9b tempest-TestInstancesWithCinderVolumes-1702359969 None] Created volume successfully. Jul 10 10:22:31 devstack sudo[104103]: pam_unix(sudo:session): session closed for user root Jul 10 10:22:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-10113548-860d-4edc-9908-bc81219a3a1b tempest-TestInstancesWithCinderVolumes-1702359969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-edeba1e3-5236-4ff4-9108-03591dd6fff2 1073741824" returned: 0 in 0.912s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:22:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-10113548-860d-4edc-9908-bc81219a3a1b tempest-TestInstancesWithCinderVolumes-1702359969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-edeba1e3-5236-4ff4-9108-03591dd6fff2 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:22:31 devstack sudo[104109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-edeba1e3-5236-4ff4-9108-03591dd6fff2 Jul 10 10:22:31 devstack sudo[104109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:22:32 devstack sudo[104109]: pam_unix(sudo:session): session closed for user root Jul 10 10:22:32 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-10113548-860d-4edc-9908-bc81219a3a1b tempest-TestInstancesWithCinderVolumes-1702359969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-edeba1e3-5236-4ff4-9108-03591dd6fff2" returned: 0 in 0.658s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:22:32 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-10113548-860d-4edc-9908-bc81219a3a1b tempest-TestInstancesWithCinderVolumes-1702359969 None] <== create_volume: return (1616ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:22:32 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-10113548-860d-4edc-9908-bc81219a3a1b tempest-TestInstancesWithCinderVolumes-1702359969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.619s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:22:32 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-10113548-860d-4edc-9908-bc81219a3a1b tempest-TestInstancesWithCinderVolumes-1702359969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2828edf2-f78f-4985-b7a3-29be5d01cc90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edeba1e3-5236-4ff4-9108-03591dd6fff2', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:22:32 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-10113548-860d-4edc-9908-bc81219a3a1b tempest-TestInstancesWithCinderVolumes-1702359969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddbbea93-32f9-42ec-9564-c84d188e3767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:22:32 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-10113548-860d-4edc-9908-bc81219a3a1b tempest-TestInstancesWithCinderVolumes-1702359969 None] Volume volume-edeba1e3-5236-4ff4-9108-03591dd6fff2 (edeba1e3-5236-4ff4-9108-03591dd6fff2): created successfully Jul 10 10:22:32 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-10113548-860d-4edc-9908-bc81219a3a1b tempest-TestInstancesWithCinderVolumes-1702359969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddbbea93-32f9-42ec-9564-c84d188e3767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:22:32 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-10113548-860d-4edc-9908-bc81219a3a1b tempest-TestInstancesWithCinderVolumes-1702359969 None] Flow 'volume_create_manager' (ab7f2c7e-63c3-4cbf-ac5f-14e0cffaa383) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:22:32 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-10113548-860d-4edc-9908-bc81219a3a1b tempest-TestInstancesWithCinderVolumes-1702359969 None] Created volume successfully. Jul 10 10:22:33 devstack cinder-volume[87234]: DEBUG cinder.image.image_utils [None req-4ef40842-2142-44de-b558-6a46214d34d1 tempest-TestInstancesWithCinderVolumes-1702359969 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0e5c5938-4bcb-4473-a733-8b46fc625bb2_2pr11ilqdevstack@QuobyteHD, size 20.69 MB, duration 3.10 sec {{(pid=87234) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 10:22:33 devstack cinder-volume[87234]: INFO cinder.image.image_utils [None req-4ef40842-2142-44de-b558-6a46214d34d1 tempest-TestInstancesWithCinderVolumes-1702359969 None] Image download 20.69 MB at 6.68 MB/s Jul 10 10:22:33 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf96d17-1b1a-4b63-962e-fc3d317c4393]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:22:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4ef40842-2142-44de-b558-6a46214d34d1 tempest-TestInstancesWithCinderVolumes-1702359969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e5c5938-4bcb-4473-a733-8b46fc625bb2_2pr11ilqdevstack@QuobyteHD {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:22:33 devstack sudo[104112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e5c5938-4bcb-4473-a733-8b46fc625bb2_2pr11ilqdevstack@QuobyteHD Jul 10 10:22:33 devstack sudo[104112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:22:33 devstack sudo[104112]: pam_unix(sudo:session): session closed for user root Jul 10 10:22:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4ef40842-2142-44de-b558-6a46214d34d1 tempest-TestInstancesWithCinderVolumes-1702359969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e5c5938-4bcb-4473-a733-8b46fc625bb2_2pr11ilqdevstack@QuobyteHD" returned: 0 in 0.729s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:22:33 devstack cinder-volume[87234]: DEBUG cinder.image.image_utils [None req-4ef40842-2142-44de-b558-6a46214d34d1 tempest-TestInstancesWithCinderVolumes-1702359969 None] Temporary image 0e5c5938-4bcb-4473-a733-8b46fc625bb2 is fetched for user 9a7149b5d5fe45d9b9d6e922bceb01b6. {{(pid=87234) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 10:22:33 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1337d65-86c6-4a3d-90d1-5dd0070cdca7]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:22:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4ef40842-2142-44de-b558-6a46214d34d1 tempest-TestInstancesWithCinderVolumes-1702359969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e5c5938-4bcb-4473-a733-8b46fc625bb2_2pr11ilqdevstack@QuobyteHD {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:22:33 devstack sudo[104117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e5c5938-4bcb-4473-a733-8b46fc625bb2_2pr11ilqdevstack@QuobyteHD Jul 10 10:22:33 devstack sudo[104117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:22:34 devstack sudo[104117]: pam_unix(sudo:session): session closed for user root Jul 10 10:22:34 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4ef40842-2142-44de-b558-6a46214d34d1 tempest-TestInstancesWithCinderVolumes-1702359969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e5c5938-4bcb-4473-a733-8b46fc625bb2_2pr11ilqdevstack@QuobyteHD" returned: 0 in 0.726s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:22:34 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-4ef40842-2142-44de-b558-6a46214d34d1 tempest-TestInstancesWithCinderVolumes-1702359969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:22:34 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-4ef40842-2142-44de-b558-6a46214d34d1 tempest-TestInstancesWithCinderVolumes-1702359969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:22:34 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-4ef40842-2142-44de-b558-6a46214d34d1 tempest-TestInstancesWithCinderVolumes-1702359969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:22:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-955292465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fe423e8-78ce-40d8-bf5c-323974185a1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57483d20736a4be4962b4c405af47161',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:22:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:22:30Z,use_quota=True,user_id='9a7149b5d5fe45d9b9d6e922bceb01b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(86572ac3-075b-4987-9d17-47d033e11922),volume_type_id=86572ac3-075b-4987-9d17-47d033e11922)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:22:34 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-4ef40842-2142-44de-b558-6a46214d34d1 tempest-TestInstancesWithCinderVolumes-1702359969 None] Creating volume 8fe423e8-78ce-40d8-bf5c-323974185a1f {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:22:34 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-4ef40842-2142-44de-b558-6a46214d34d1 tempest-TestInstancesWithCinderVolumes-1702359969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:22:34 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-4ef40842-2142-44de-b558-6a46214d34d1 tempest-TestInstancesWithCinderVolumes-1702359969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:22:34 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-4ef40842-2142-44de-b558-6a46214d34d1 tempest-TestInstancesWithCinderVolumes-1702359969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:22:34 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-4ef40842-2142-44de-b558-6a46214d34d1 tempest-TestInstancesWithCinderVolumes-1702359969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:22:34 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-4ef40842-2142-44de-b558-6a46214d34d1 tempest-TestInstancesWithCinderVolumes-1702359969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:22:34 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-4ef40842-2142-44de-b558-6a46214d34d1 tempest-TestInstancesWithCinderVolumes-1702359969 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:22:34 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-4ef40842-2142-44de-b558-6a46214d34d1 tempest-TestInstancesWithCinderVolumes-1702359969 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:22:34 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4ef40842-2142-44de-b558-6a46214d34d1 tempest-TestInstancesWithCinderVolumes-1702359969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8fe423e8-78ce-40d8-bf5c-323974185a1f 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:22:34 devstack sudo[104122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8fe423e8-78ce-40d8-bf5c-323974185a1f 1073741824 Jul 10 10:22:34 devstack sudo[104122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:22:35 devstack sudo[104122]: pam_unix(sudo:session): session closed for user root Jul 10 10:22:35 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4ef40842-2142-44de-b558-6a46214d34d1 tempest-TestInstancesWithCinderVolumes-1702359969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8fe423e8-78ce-40d8-bf5c-323974185a1f 1073741824" returned: 0 in 0.835s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:22:35 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4ef40842-2142-44de-b558-6a46214d34d1 tempest-TestInstancesWithCinderVolumes-1702359969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8fe423e8-78ce-40d8-bf5c-323974185a1f {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:22:35 devstack sudo[104127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8fe423e8-78ce-40d8-bf5c-323974185a1f Jul 10 10:22:35 devstack sudo[104127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:22:36 devstack sudo[104127]: pam_unix(sudo:session): session closed for user root Jul 10 10:22:36 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4ef40842-2142-44de-b558-6a46214d34d1 tempest-TestInstancesWithCinderVolumes-1702359969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8fe423e8-78ce-40d8-bf5c-323974185a1f" returned: 0 in 0.655s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:22:36 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-4ef40842-2142-44de-b558-6a46214d34d1 tempest-TestInstancesWithCinderVolumes-1702359969 None] <== create_volume: return (1535ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:22:36 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-4ef40842-2142-44de-b558-6a46214d34d1 tempest-TestInstancesWithCinderVolumes-1702359969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.538s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:22:36 devstack cinder-volume[87234]: DEBUG cinder.volume.volume_utils [None req-4ef40842-2142-44de-b558-6a46214d34d1 tempest-TestInstancesWithCinderVolumes-1702359969 None] Attempting download of 0e5c5938-4bcb-4473-a733-8b46fc625bb2 ((None, [{'url': 'file:///opt/stack/data/glance/images/0e5c5938-4bcb-4473-a733-8b46fc625bb2', 'metadata': {}}])) to volume 8fe423e8-78ce-40d8-bf5c-323974185a1f. {{(pid=87234) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 10:22:36 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5e6247-cf4d-4a25-801e-bf1a7ed20242]: (4, 'raw') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:22:36 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4ef40842-2142-44de-b558-6a46214d34d1 tempest-TestInstancesWithCinderVolumes-1702359969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0e5c5938-4bcb-4473-a733-8b46fc625bb2_a8vbe4_b {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:22:36 devstack sudo[104130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0e5c5938-4bcb-4473-a733-8b46fc625bb2_a8vbe4_b Jul 10 10:22:36 devstack sudo[104130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:22:36 devstack sudo[104130]: pam_unix(sudo:session): session closed for user root Jul 10 10:22:36 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4ef40842-2142-44de-b558-6a46214d34d1 tempest-TestInstancesWithCinderVolumes-1702359969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0e5c5938-4bcb-4473-a733-8b46fc625bb2_a8vbe4_b" returned: 0 in 0.788s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:22:36 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4ef40842-2142-44de-b558-6a46214d34d1 tempest-TestInstancesWithCinderVolumes-1702359969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0e5c5938-4bcb-4473-a733-8b46fc625bb2_a8vbe4_b {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:22:37 devstack sudo[104134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0e5c5938-4bcb-4473-a733-8b46fc625bb2_a8vbe4_b Jul 10 10:22:37 devstack sudo[104134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:22:37 devstack sudo[104134]: pam_unix(sudo:session): session closed for user root Jul 10 10:22:37 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4ef40842-2142-44de-b558-6a46214d34d1 tempest-TestInstancesWithCinderVolumes-1702359969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0e5c5938-4bcb-4473-a733-8b46fc625bb2_a8vbe4_b" returned: 1 in 0.732s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:22:37 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4ef40842-2142-44de-b558-6a46214d34d1 tempest-TestInstancesWithCinderVolumes-1702359969 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0e5c5938-4bcb-4473-a733-8b46fc625bb2_a8vbe4_b' failed. Not Retrying. {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 10:22:37 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[11bb6930-6624-436f-957c-d03ca9dc011b]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:22:37 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4ef40842-2142-44de-b558-6a46214d34d1 tempest-TestInstancesWithCinderVolumes-1702359969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e5c5938-4bcb-4473-a733-8b46fc625bb2_2pr11ilqdevstack@QuobyteHD {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:22:37 devstack sudo[104139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e5c5938-4bcb-4473-a733-8b46fc625bb2_2pr11ilqdevstack@QuobyteHD Jul 10 10:22:37 devstack sudo[104139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:22:38 devstack sudo[104139]: pam_unix(sudo:session): session closed for user root Jul 10 10:22:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4ef40842-2142-44de-b558-6a46214d34d1 tempest-TestInstancesWithCinderVolumes-1702359969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0e5c5938-4bcb-4473-a733-8b46fc625bb2_2pr11ilqdevstack@QuobyteHD" returned: 0 in 0.730s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:22:38 devstack cinder-volume[87234]: DEBUG cinder.image.image_utils [None req-4ef40842-2142-44de-b558-6a46214d34d1 tempest-TestInstancesWithCinderVolumes-1702359969 None] 0e5c5938-4bcb-4473-a733-8b46fc625bb2 was qcow2, converting to raw {{(pid=87234) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 10:22:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4ef40842-2142-44de-b558-6a46214d34d1 tempest-TestInstancesWithCinderVolumes-1702359969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0e5c5938-4bcb-4473-a733-8b46fc625bb2_2pr11ilqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8fe423e8-78ce-40d8-bf5c-323974185a1f {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:22:38 devstack sudo[104144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0e5c5938-4bcb-4473-a733-8b46fc625bb2_2pr11ilqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8fe423e8-78ce-40d8-bf5c-323974185a1f Jul 10 10:22:38 devstack sudo[104144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:22:40 devstack sudo[104144]: pam_unix(sudo:session): session closed for user root Jul 10 10:22:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4ef40842-2142-44de-b558-6a46214d34d1 tempest-TestInstancesWithCinderVolumes-1702359969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0e5c5938-4bcb-4473-a733-8b46fc625bb2_2pr11ilqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8fe423e8-78ce-40d8-bf5c-323974185a1f" returned: 0 in 1.919s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:22:40 devstack cinder-volume[87234]: DEBUG cinder.image.image_utils [None req-4ef40842-2142-44de-b558-6a46214d34d1 tempest-TestInstancesWithCinderVolumes-1702359969 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0e5c5938-4bcb-4473-a733-8b46fc625bb2_2pr11ilqdevstack@QuobyteHD, size 112.00 MB, duration 1.92 sec, destination /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8fe423e8-78ce-40d8-bf5c-323974185a1f {{(pid=87234) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 10:22:40 devstack cinder-volume[87234]: INFO cinder.image.image_utils [None req-4ef40842-2142-44de-b558-6a46214d34d1 tempest-TestInstancesWithCinderVolumes-1702359969 None] Converted 112.00 MB image at 58.32 MB/s Jul 10 10:22:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4ef40842-2142-44de-b558-6a46214d34d1 tempest-TestInstancesWithCinderVolumes-1702359969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8fe423e8-78ce-40d8-bf5c-323974185a1f 1G {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:22:40 devstack sudo[104158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8fe423e8-78ce-40d8-bf5c-323974185a1f 1G Jul 10 10:22:40 devstack sudo[104158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:22:41 devstack sudo[104158]: pam_unix(sudo:session): session closed for user root Jul 10 10:22:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4ef40842-2142-44de-b558-6a46214d34d1 tempest-TestInstancesWithCinderVolumes-1702359969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8fe423e8-78ce-40d8-bf5c-323974185a1f 1G" returned: 0 in 0.717s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:22:41 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1895dd-d368-4965-87fb-b7414683bd7d]: (4, 'raw') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:22:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4ef40842-2142-44de-b558-6a46214d34d1 tempest-TestInstancesWithCinderVolumes-1702359969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8fe423e8-78ce-40d8-bf5c-323974185a1f {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:22:41 devstack sudo[104163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8fe423e8-78ce-40d8-bf5c-323974185a1f Jul 10 10:22:41 devstack sudo[104163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:22:41 devstack sudo[104163]: pam_unix(sudo:session): session closed for user root Jul 10 10:22:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4ef40842-2142-44de-b558-6a46214d34d1 tempest-TestInstancesWithCinderVolumes-1702359969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8fe423e8-78ce-40d8-bf5c-323974185a1f" returned: 0 in 0.759s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:22:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4ef40842-2142-44de-b558-6a46214d34d1 tempest-TestInstancesWithCinderVolumes-1702359969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8fe423e8-78ce-40d8-bf5c-323974185a1f {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:22:41 devstack sudo[104167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8fe423e8-78ce-40d8-bf5c-323974185a1f Jul 10 10:22:41 devstack sudo[104167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:22:42 devstack cinder-volume[87234]: DEBUG oslo_service.periodic_task [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 10:22:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:22:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:22:42 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:22:42 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:22:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:22:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:22:42 devstack sudo[104169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:22:42 devstack sudo[104169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:22:42 devstack sudo[104167]: pam_unix(sudo:session): session closed for user root Jul 10 10:22:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4ef40842-2142-44de-b558-6a46214d34d1 tempest-TestInstancesWithCinderVolumes-1702359969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8fe423e8-78ce-40d8-bf5c-323974185a1f" returned: 1 in 0.746s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:22:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4ef40842-2142-44de-b558-6a46214d34d1 tempest-TestInstancesWithCinderVolumes-1702359969 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8fe423e8-78ce-40d8-bf5c-323974185a1f' failed. Not Retrying. {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 10:22:42 devstack cinder-volume[87234]: DEBUG cinder.volume.volume_utils [None req-4ef40842-2142-44de-b558-6a46214d34d1 tempest-TestInstancesWithCinderVolumes-1702359969 None] Downloaded image 0e5c5938-4bcb-4473-a733-8b46fc625bb2 ((None, [{'url': 'file:///opt/stack/data/glance/images/0e5c5938-4bcb-4473-a733-8b46fc625bb2', 'metadata': {}}])) to volume 8fe423e8-78ce-40d8-bf5c-323974185a1f successfully. {{(pid=87234) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 10:22:42 devstack cinder-volume[87234]: DEBUG cinder.image.image_utils [None req-4ef40842-2142-44de-b558-6a46214d34d1 tempest-TestInstancesWithCinderVolumes-1702359969 None] Temporary image 0e5c5938-4bcb-4473-a733-8b46fc625bb2 for user 9a7149b5d5fe45d9b9d6e922bceb01b6 is deleted. {{(pid=87234) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 10:22:42 devstack cinder-volume[87234]: DEBUG cinder.volume.volume_utils [None req-4ef40842-2142-44de-b558-6a46214d34d1 tempest-TestInstancesWithCinderVolumes-1702359969 None] Marking volume 8fe423e8-78ce-40d8-bf5c-323974185a1f as bootable. {{(pid=87234) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 10:22:42 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ef40842-2142-44de-b558-6a46214d34d1 tempest-TestInstancesWithCinderVolumes-1702359969 None] Copying metadata from image 0e5c5938-4bcb-4473-a733-8b46fc625bb2 to 8fe423e8-78ce-40d8-bf5c-323974185a1f. {{(pid=87234) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 10:22:42 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ef40842-2142-44de-b558-6a46214d34d1 tempest-TestInstancesWithCinderVolumes-1702359969 None] Creating volume glance metadata for volume 8fe423e8-78ce-40d8-bf5c-323974185a1f backed by image 0e5c5938-4bcb-4473-a733-8b46fc625bb2 with: {'image_id': '0e5c5938-4bcb-4473-a733-8b46fc625bb2', 'image_name': 'tempest-scenario-img--998651201', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87234) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 10:22:42 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4ef40842-2142-44de-b558-6a46214d34d1 tempest-TestInstancesWithCinderVolumes-1702359969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (324384c2-a5f7-49de-94a7-a6173e54e269) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fe423e8-78ce-40d8-bf5c-323974185a1f', 'volume_size': 1, 'image_id': '0e5c5938-4bcb-4473-a733-8b46fc625bb2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0e5c5938-4bcb-4473-a733-8b46fc625bb2', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--998651201', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '57483d20736a4be4962b4c405af47161', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0e5c5938-4bcb-4473-a733-8b46fc625bb2', 'created_at': datetime.datetime(2026, 7, 10, 8, 22, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 8, 22, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0e5c5938-4bcb-4473-a733-8b46fc625bb2/file', 'properties': {}}, 'image_service': }' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:22:42 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4ef40842-2142-44de-b558-6a46214d34d1 tempest-TestInstancesWithCinderVolumes-1702359969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ee0896c-8276-4594-9738-dd5dd89f3c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:22:42 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-4ef40842-2142-44de-b558-6a46214d34d1 tempest-TestInstancesWithCinderVolumes-1702359969 None] Volume volume-8fe423e8-78ce-40d8-bf5c-323974185a1f (8fe423e8-78ce-40d8-bf5c-323974185a1f): created successfully Jul 10 10:22:42 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4ef40842-2142-44de-b558-6a46214d34d1 tempest-TestInstancesWithCinderVolumes-1702359969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ee0896c-8276-4594-9738-dd5dd89f3c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:22:42 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4ef40842-2142-44de-b558-6a46214d34d1 tempest-TestInstancesWithCinderVolumes-1702359969 None] Flow 'volume_create_manager' (66070ef0-9734-4384-9163-d3ecc0ef444b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:22:42 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-4ef40842-2142-44de-b558-6a46214d34d1 tempest-TestInstancesWithCinderVolumes-1702359969 None] Created volume successfully. Jul 10 10:22:42 devstack sudo[104169]: pam_unix(sudo:session): session closed for user root Jul 10 10:22:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.683s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:22:42 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:22:42 devstack cinder-volume[87234]: DEBUG oslo_service.periodic_task [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Running periodic task VolumeManager._thread_info {{(pid=87234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 10:22:42 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] thread count: 28 {{(pid=87234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 10:22:42 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] thread info: [<_MainThread(MainThread, started 131600773742720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 10:22:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-12ddbd07-2fa5-446f-b0a9-c772aede7620 req-67ecf4ce-e92b-4953-a77b-c49924084b1a tempest-TestInstancesWithCinderVolumes-1702359969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:22:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-12ddbd07-2fa5-446f-b0a9-c772aede7620 req-67ecf4ce-e92b-4953-a77b-c49924084b1a tempest-TestInstancesWithCinderVolumes-1702359969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:22:50 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[129037de-8346-4dee-a6ec-a1d76a968e35]: (4, 'raw') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:22:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-12ddbd07-2fa5-446f-b0a9-c772aede7620 req-67ecf4ce-e92b-4953-a77b-c49924084b1a tempest-TestInstancesWithCinderVolumes-1702359969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8fe423e8-78ce-40d8-bf5c-323974185a1f {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:22:50 devstack sudo[104188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8fe423e8-78ce-40d8-bf5c-323974185a1f Jul 10 10:22:50 devstack sudo[104188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:22:51 devstack sudo[104188]: pam_unix(sudo:session): session closed for user root Jul 10 10:22:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-12ddbd07-2fa5-446f-b0a9-c772aede7620 req-67ecf4ce-e92b-4953-a77b-c49924084b1a tempest-TestInstancesWithCinderVolumes-1702359969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8fe423e8-78ce-40d8-bf5c-323974185a1f" returned: 0 in 0.766s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:22:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-12ddbd07-2fa5-446f-b0a9-c772aede7620 req-67ecf4ce-e92b-4953-a77b-c49924084b1a tempest-TestInstancesWithCinderVolumes-1702359969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8fe423e8-78ce-40d8-bf5c-323974185a1f {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:22:51 devstack sudo[104192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8fe423e8-78ce-40d8-bf5c-323974185a1f Jul 10 10:22:51 devstack sudo[104192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:22:52 devstack sudo[104192]: pam_unix(sudo:session): session closed for user root Jul 10 10:22:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-12ddbd07-2fa5-446f-b0a9-c772aede7620 req-67ecf4ce-e92b-4953-a77b-c49924084b1a tempest-TestInstancesWithCinderVolumes-1702359969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8fe423e8-78ce-40d8-bf5c-323974185a1f" returned: 1 in 0.744s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:22:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-12ddbd07-2fa5-446f-b0a9-c772aede7620 req-67ecf4ce-e92b-4953-a77b-c49924084b1a tempest-TestInstancesWithCinderVolumes-1702359969 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8fe423e8-78ce-40d8-bf5c-323974185a1f' failed. Not Retrying. {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 10:22:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-12ddbd07-2fa5-446f-b0a9-c772aede7620 req-67ecf4ce-e92b-4953-a77b-c49924084b1a tempest-TestInstancesWithCinderVolumes-1702359969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.555s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:22:52 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [req-12ddbd07-2fa5-446f-b0a9-c772aede7620 req-67ecf4ce-e92b-4953-a77b-c49924084b1a tempest-TestInstancesWithCinderVolumes-1702359969 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091', 'name': 'volume-8fe423e8-78ce-40d8-bf5c-323974185a1f', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '24f4108e-c4f9-4e53-aac9-5d6bf4a46bb6', 'enforce_multipath': True} {{(pid=87234) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 10:22:52 devstack cinder-volume[87234]: INFO cinder.volume.manager [req-12ddbd07-2fa5-446f-b0a9-c772aede7620 req-67ecf4ce-e92b-4953-a77b-c49924084b1a tempest-TestInstancesWithCinderVolumes-1702359969 None] attachment_update completed successfully. Jul 10 10:23:02 devstack cinder-volume[87234]: DEBUG dbcounter [-] [87234] Writing DB stats cinder:UPDATE=14,cinder:SELECT=18,cinder:INSERT=7,cinder:DELETE=1 {{(pid=87234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 10:23:02 devstack cinder-volume[87234]: DEBUG dbcounter [-] [87234] Writing DB stats cinder:SELECT=16,cinder:UPDATE=10,cinder:INSERT=5,cinder:DELETE=2 {{(pid=87234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 10:23:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-d3651fa3-eb35-4dbb-aecc-bb0417d7f95e req-6c57d212-59b3-4b57-83c5-a2fcb5ffef05 tempest-TestInstancesWithCinderVolumes-1702359969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:23:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-d3651fa3-eb35-4dbb-aecc-bb0417d7f95e req-6c57d212-59b3-4b57-83c5-a2fcb5ffef05 tempest-TestInstancesWithCinderVolumes-1702359969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:23:28 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[38cbdc41-5e4f-497b-a888-a38b33cfc975]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:23:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-d3651fa3-eb35-4dbb-aecc-bb0417d7f95e req-6c57d212-59b3-4b57-83c5-a2fcb5ffef05 tempest-TestInstancesWithCinderVolumes-1702359969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-10ea3281-aab0-4033-92d9-98db213dd46f {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:23:28 devstack sudo[104808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-10ea3281-aab0-4033-92d9-98db213dd46f Jul 10 10:23:28 devstack sudo[104808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:23:29 devstack sudo[104808]: pam_unix(sudo:session): session closed for user root Jul 10 10:23:29 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-d3651fa3-eb35-4dbb-aecc-bb0417d7f95e req-6c57d212-59b3-4b57-83c5-a2fcb5ffef05 tempest-TestInstancesWithCinderVolumes-1702359969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-10ea3281-aab0-4033-92d9-98db213dd46f" returned: 0 in 0.805s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:23:29 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-d3651fa3-eb35-4dbb-aecc-bb0417d7f95e req-6c57d212-59b3-4b57-83c5-a2fcb5ffef05 tempest-TestInstancesWithCinderVolumes-1702359969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.824s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:23:29 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [req-d3651fa3-eb35-4dbb-aecc-bb0417d7f95e req-6c57d212-59b3-4b57-83c5-a2fcb5ffef05 tempest-TestInstancesWithCinderVolumes-1702359969 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091', 'name': 'volume-10ea3281-aab0-4033-92d9-98db213dd46f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ba910ed6-896d-4356-9ed5-8c368c6427ad', 'enforce_multipath': True} {{(pid=87234) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 10:23:29 devstack cinder-volume[87234]: INFO cinder.volume.manager [req-d3651fa3-eb35-4dbb-aecc-bb0417d7f95e req-6c57d212-59b3-4b57-83c5-a2fcb5ffef05 tempest-TestInstancesWithCinderVolumes-1702359969 None] attachment_update completed successfully. Jul 10 10:23:36 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-43e4cd42-1571-4fd3-8937-9ba60d444c0c req-aaa229d2-6ffa-4c2a-be9f-ada5dd4c3547 tempest-TestInstancesWithCinderVolumes-1702359969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:23:36 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-43e4cd42-1571-4fd3-8937-9ba60d444c0c req-aaa229d2-6ffa-4c2a-be9f-ada5dd4c3547 tempest-TestInstancesWithCinderVolumes-1702359969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:23:36 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b0c445-9737-49c4-ad93-d1a2a4f2c33d]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:23:36 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-43e4cd42-1571-4fd3-8937-9ba60d444c0c req-aaa229d2-6ffa-4c2a-be9f-ada5dd4c3547 tempest-TestInstancesWithCinderVolumes-1702359969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-edeba1e3-5236-4ff4-9108-03591dd6fff2 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:23:36 devstack sudo[104838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-edeba1e3-5236-4ff4-9108-03591dd6fff2 Jul 10 10:23:37 devstack sudo[104838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:23:37 devstack sudo[104838]: pam_unix(sudo:session): session closed for user root Jul 10 10:23:37 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [req-43e4cd42-1571-4fd3-8937-9ba60d444c0c req-aaa229d2-6ffa-4c2a-be9f-ada5dd4c3547 tempest-TestInstancesWithCinderVolumes-1702359969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-edeba1e3-5236-4ff4-9108-03591dd6fff2" returned: 0 in 0.774s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:23:37 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [req-43e4cd42-1571-4fd3-8937-9ba60d444c0c req-aaa229d2-6ffa-4c2a-be9f-ada5dd4c3547 tempest-TestInstancesWithCinderVolumes-1702359969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.792s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:23:37 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [req-43e4cd42-1571-4fd3-8937-9ba60d444c0c req-aaa229d2-6ffa-4c2a-be9f-ada5dd4c3547 tempest-TestInstancesWithCinderVolumes-1702359969 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091', 'name': 'volume-edeba1e3-5236-4ff4-9108-03591dd6fff2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a4073083-bd9e-4169-a8f7-984d664ded95', 'enforce_multipath': True} {{(pid=87234) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 10:23:37 devstack cinder-volume[87234]: INFO cinder.volume.manager [req-43e4cd42-1571-4fd3-8937-9ba60d444c0c req-aaa229d2-6ffa-4c2a-be9f-ada5dd4c3547 tempest-TestInstancesWithCinderVolumes-1702359969 None] attachment_update completed successfully. Jul 10 10:23:42 devstack cinder-volume[87234]: DEBUG oslo_service.periodic_task [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 10:23:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:23:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:23:42 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:23:42 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:23:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:23:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:23:42 devstack sudo[104852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:23:42 devstack sudo[104852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:23:42 devstack sudo[104852]: pam_unix(sudo:session): session closed for user root Jul 10 10:23:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.688s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:23:42 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:23:42 devstack cinder-volume[87234]: DEBUG oslo_service.periodic_task [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Running periodic task VolumeManager._thread_info {{(pid=87234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 10:23:42 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] thread count: 28 {{(pid=87234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 10:23:42 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] thread info: [<_MainThread(MainThread, started 131600773742720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 10:23:46 devstack cinder-volume[87234]: INFO cinder.volume.manager [req-4c1d37a6-03d3-4f00-a224-8f4e9fd8abbf req-a2534f66-fb1a-4c6f-a3cc-e7ec9185e315 tempest-TestInstancesWithCinderVolumes-1702359969 None] Terminate volume connection completed successfully. Jul 10 10:23:46 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [req-4c1d37a6-03d3-4f00-a224-8f4e9fd8abbf req-a2534f66-fb1a-4c6f-a3cc-e7ec9185e315 tempest-TestInstancesWithCinderVolumes-1702359969 None] Deleting attachment ba910ed6-896d-4356-9ed5-8c368c6427ad. {{(pid=87234) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 10:23:47 devstack cinder-volume[87234]: DEBUG dbcounter [-] [87234] Writing DB stats cinder:SELECT=14,cinder:UPDATE=3 {{(pid=87234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 10:23:48 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-992cd92b-fa69-40ff-9469-071e2c455211 tempest-TestInstancesWithCinderVolumes-1702359969 None] Acquiring lock "cinder-10ea3281-aab0-4033-92d9-98db213dd46f-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:23:48 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-992cd92b-fa69-40ff-9469-071e2c455211 tempest-TestInstancesWithCinderVolumes-1702359969 None] Lock "cinder-10ea3281-aab0-4033-92d9-98db213dd46f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:23:48 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-992cd92b-fa69-40ff-9469-071e2c455211 tempest-TestInstancesWithCinderVolumes-1702359969 None] Acquiring lock "cinder-quobyte-10ea3281-aab0-4033-92d9-98db213dd46f" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:23:48 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-992cd92b-fa69-40ff-9469-071e2c455211 tempest-TestInstancesWithCinderVolumes-1702359969 None] Lock "cinder-quobyte-10ea3281-aab0-4033-92d9-98db213dd46f" acquired by "delete_volume" :: waited 0.015s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:23:48 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[2994829a-5ba5-445b-9a4a-99d67d7e7324]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:23:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-992cd92b-fa69-40ff-9469-071e2c455211 tempest-TestInstancesWithCinderVolumes-1702359969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-10ea3281-aab0-4033-92d9-98db213dd46f {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:23:48 devstack sudo[104883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-10ea3281-aab0-4033-92d9-98db213dd46f Jul 10 10:23:48 devstack sudo[104883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:23:49 devstack sudo[104883]: pam_unix(sudo:session): session closed for user root Jul 10 10:23:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-992cd92b-fa69-40ff-9469-071e2c455211 tempest-TestInstancesWithCinderVolumes-1702359969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-10ea3281-aab0-4033-92d9-98db213dd46f" returned: 0 in 0.856s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:23:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-992cd92b-fa69-40ff-9469-071e2c455211 tempest-TestInstancesWithCinderVolumes-1702359969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-10ea3281-aab0-4033-92d9-98db213dd46f {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:23:49 devstack sudo[104890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-10ea3281-aab0-4033-92d9-98db213dd46f Jul 10 10:23:49 devstack sudo[104890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:23:49 devstack sudo[104890]: pam_unix(sudo:session): session closed for user root Jul 10 10:23:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-992cd92b-fa69-40ff-9469-071e2c455211 tempest-TestInstancesWithCinderVolumes-1702359969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-10ea3281-aab0-4033-92d9-98db213dd46f" returned: 0 in 0.691s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:23:49 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-992cd92b-fa69-40ff-9469-071e2c455211 tempest-TestInstancesWithCinderVolumes-1702359969 None] Lock "cinder-quobyte-10ea3281-aab0-4033-92d9-98db213dd46f" released by "delete_volume" :: held 1.600s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:23:49 devstack cinder-volume[87234]: WARNING cinder.quota [None req-992cd92b-fa69-40ff-9469-071e2c455211 tempest-TestInstancesWithCinderVolumes-1702359969 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1165898229-55730394 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1165898229-55730394, it is now deprecated. Please use the default quota class for default quota. Jul 10 10:23:49 devstack cinder-volume[87234]: WARNING cinder.quota [None req-992cd92b-fa69-40ff-9469-071e2c455211 tempest-TestInstancesWithCinderVolumes-1702359969 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1165898229-55730394 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1165898229-55730394, it is now deprecated. Please use the default quota class for default quota. Jul 10 10:23:49 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-992cd92b-fa69-40ff-9469-071e2c455211 tempest-TestInstancesWithCinderVolumes-1702359969 None] Created reservations ['e13a5e23-5070-46e0-9d67-846245af02b8', '109f5d55-f27b-4a8d-b831-cf7dd5da83f3', 'da175e47-646c-44ae-86e6-f736c8bf8a47', '0e679749-4801-4ba8-a9f9-5e9ba172a278'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:23:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-992cd92b-fa69-40ff-9469-071e2c455211 tempest-TestInstancesWithCinderVolumes-1702359969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:23:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-992cd92b-fa69-40ff-9469-071e2c455211 tempest-TestInstancesWithCinderVolumes-1702359969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:23:50 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-992cd92b-fa69-40ff-9469-071e2c455211 tempest-TestInstancesWithCinderVolumes-1702359969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:23:50 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-992cd92b-fa69-40ff-9469-071e2c455211 tempest-TestInstancesWithCinderVolumes-1702359969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:23:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-992cd92b-fa69-40ff-9469-071e2c455211 tempest-TestInstancesWithCinderVolumes-1702359969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:23:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-992cd92b-fa69-40ff-9469-071e2c455211 tempest-TestInstancesWithCinderVolumes-1702359969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:23:50 devstack sudo[104895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:23:50 devstack sudo[104895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:23:50 devstack sudo[104895]: pam_unix(sudo:session): session closed for user root Jul 10 10:23:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-992cd92b-fa69-40ff-9469-071e2c455211 tempest-TestInstancesWithCinderVolumes-1702359969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.681s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:23:50 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-992cd92b-fa69-40ff-9469-071e2c455211 tempest-TestInstancesWithCinderVolumes-1702359969 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:23:50 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-992cd92b-fa69-40ff-9469-071e2c455211 tempest-TestInstancesWithCinderVolumes-1702359969 None] Deleted volume successfully. Jul 10 10:23:50 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-992cd92b-fa69-40ff-9469-071e2c455211 tempest-TestInstancesWithCinderVolumes-1702359969 None] Lock "cinder-10ea3281-aab0-4033-92d9-98db213dd46f-delete_volume" released by "delete_volume" :: held 2.481s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:23:52 devstack cinder-volume[87234]: INFO cinder.volume.manager [req-ea981d3e-1af3-4ccf-9035-7766cbe33961 req-c5008296-9ad5-45e2-b01e-6f3a31ade199 tempest-TestInstancesWithCinderVolumes-1702359969 None] Terminate volume connection completed successfully. Jul 10 10:23:52 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [req-ea981d3e-1af3-4ccf-9035-7766cbe33961 req-c5008296-9ad5-45e2-b01e-6f3a31ade199 tempest-TestInstancesWithCinderVolumes-1702359969 None] Deleting attachment a4073083-bd9e-4169-a8f7-984d664ded95. {{(pid=87234) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 10:23:54 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-d29df2b1-6786-49c2-be86-38dd37fbfbaf tempest-TestInstancesWithCinderVolumes-1702359969 None] Acquiring lock "cinder-edeba1e3-5236-4ff4-9108-03591dd6fff2-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:23:54 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-d29df2b1-6786-49c2-be86-38dd37fbfbaf tempest-TestInstancesWithCinderVolumes-1702359969 None] Lock "cinder-edeba1e3-5236-4ff4-9108-03591dd6fff2-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:23:54 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-d29df2b1-6786-49c2-be86-38dd37fbfbaf tempest-TestInstancesWithCinderVolumes-1702359969 None] Acquiring lock "cinder-quobyte-edeba1e3-5236-4ff4-9108-03591dd6fff2" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:23:54 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-d29df2b1-6786-49c2-be86-38dd37fbfbaf tempest-TestInstancesWithCinderVolumes-1702359969 None] Lock "cinder-quobyte-edeba1e3-5236-4ff4-9108-03591dd6fff2" acquired by "delete_volume" :: waited 0.015s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:23:54 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[47704875-6d3e-4973-9519-aa19d28b5769]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:23:54 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-d29df2b1-6786-49c2-be86-38dd37fbfbaf tempest-TestInstancesWithCinderVolumes-1702359969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-edeba1e3-5236-4ff4-9108-03591dd6fff2 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:23:54 devstack sudo[104919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-edeba1e3-5236-4ff4-9108-03591dd6fff2 Jul 10 10:23:54 devstack sudo[104919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:23:55 devstack sudo[104919]: pam_unix(sudo:session): session closed for user root Jul 10 10:23:55 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-d29df2b1-6786-49c2-be86-38dd37fbfbaf tempest-TestInstancesWithCinderVolumes-1702359969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-edeba1e3-5236-4ff4-9108-03591dd6fff2" returned: 0 in 0.806s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:23:55 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-d29df2b1-6786-49c2-be86-38dd37fbfbaf tempest-TestInstancesWithCinderVolumes-1702359969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-edeba1e3-5236-4ff4-9108-03591dd6fff2 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:23:55 devstack sudo[104925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-edeba1e3-5236-4ff4-9108-03591dd6fff2 Jul 10 10:23:55 devstack sudo[104925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:23:56 devstack sudo[104925]: pam_unix(sudo:session): session closed for user root Jul 10 10:23:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-d29df2b1-6786-49c2-be86-38dd37fbfbaf tempest-TestInstancesWithCinderVolumes-1702359969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-edeba1e3-5236-4ff4-9108-03591dd6fff2" returned: 0 in 0.709s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:23:56 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-d29df2b1-6786-49c2-be86-38dd37fbfbaf tempest-TestInstancesWithCinderVolumes-1702359969 None] Lock "cinder-quobyte-edeba1e3-5236-4ff4-9108-03591dd6fff2" released by "delete_volume" :: held 1.557s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:23:56 devstack cinder-volume[87234]: WARNING cinder.quota [None req-d29df2b1-6786-49c2-be86-38dd37fbfbaf tempest-TestInstancesWithCinderVolumes-1702359969 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-181739702-1501926890 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-181739702-1501926890, it is now deprecated. Please use the default quota class for default quota. Jul 10 10:23:56 devstack cinder-volume[87234]: WARNING cinder.quota [None req-d29df2b1-6786-49c2-be86-38dd37fbfbaf tempest-TestInstancesWithCinderVolumes-1702359969 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-181739702-1501926890 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-181739702-1501926890, it is now deprecated. Please use the default quota class for default quota. Jul 10 10:23:56 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-d29df2b1-6786-49c2-be86-38dd37fbfbaf tempest-TestInstancesWithCinderVolumes-1702359969 None] Created reservations ['d925dc67-29b8-4d37-9956-5ff5e859c5fa', 'b5d46136-56df-4b50-a1d0-0f6d1c86cbc2', '0500d999-27c7-4fa5-87dd-960b93e81cb7', 'e31e5f97-a7b0-4dda-bc79-c0f357c1c906'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:23:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-d29df2b1-6786-49c2-be86-38dd37fbfbaf tempest-TestInstancesWithCinderVolumes-1702359969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:23:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-d29df2b1-6786-49c2-be86-38dd37fbfbaf tempest-TestInstancesWithCinderVolumes-1702359969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:23:56 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-d29df2b1-6786-49c2-be86-38dd37fbfbaf tempest-TestInstancesWithCinderVolumes-1702359969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:23:56 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-d29df2b1-6786-49c2-be86-38dd37fbfbaf tempest-TestInstancesWithCinderVolumes-1702359969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:23:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-d29df2b1-6786-49c2-be86-38dd37fbfbaf tempest-TestInstancesWithCinderVolumes-1702359969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:23:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-d29df2b1-6786-49c2-be86-38dd37fbfbaf tempest-TestInstancesWithCinderVolumes-1702359969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:23:56 devstack sudo[104929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:23:56 devstack sudo[104929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:23:57 devstack sudo[104929]: pam_unix(sudo:session): session closed for user root Jul 10 10:23:57 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-d29df2b1-6786-49c2-be86-38dd37fbfbaf tempest-TestInstancesWithCinderVolumes-1702359969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.794s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:23:57 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-d29df2b1-6786-49c2-be86-38dd37fbfbaf tempest-TestInstancesWithCinderVolumes-1702359969 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:23:57 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-d29df2b1-6786-49c2-be86-38dd37fbfbaf tempest-TestInstancesWithCinderVolumes-1702359969 None] Deleted volume successfully. Jul 10 10:23:57 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-d29df2b1-6786-49c2-be86-38dd37fbfbaf tempest-TestInstancesWithCinderVolumes-1702359969 None] Lock "cinder-edeba1e3-5236-4ff4-9108-03591dd6fff2-delete_volume" released by "delete_volume" :: held 2.554s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:24:00 devstack cinder-volume[87234]: INFO cinder.volume.manager [req-66012a34-1800-4d5f-aa2a-fc2be8e99ad0 req-f9d2c821-b16b-4e0f-b140-d5013c3a517c tempest-TestInstancesWithCinderVolumes-1702359969 None] Terminate volume connection completed successfully. Jul 10 10:24:00 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [req-66012a34-1800-4d5f-aa2a-fc2be8e99ad0 req-f9d2c821-b16b-4e0f-b140-d5013c3a517c tempest-TestInstancesWithCinderVolumes-1702359969 None] Deleting attachment 24f4108e-c4f9-4e53-aac9-5d6bf4a46bb6. {{(pid=87234) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 10:24:04 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-5f0d7bbf-93dc-44a0-bffa-e9e6e975a1ba tempest-TestInstancesWithCinderVolumes-1702359969 None] Acquiring lock "cinder-8fe423e8-78ce-40d8-bf5c-323974185a1f-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:24:04 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-5f0d7bbf-93dc-44a0-bffa-e9e6e975a1ba tempest-TestInstancesWithCinderVolumes-1702359969 None] Lock "cinder-8fe423e8-78ce-40d8-bf5c-323974185a1f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:24:04 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-5f0d7bbf-93dc-44a0-bffa-e9e6e975a1ba tempest-TestInstancesWithCinderVolumes-1702359969 None] Acquiring lock "cinder-quobyte-8fe423e8-78ce-40d8-bf5c-323974185a1f" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:24:04 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-5f0d7bbf-93dc-44a0-bffa-e9e6e975a1ba tempest-TestInstancesWithCinderVolumes-1702359969 None] Lock "cinder-quobyte-8fe423e8-78ce-40d8-bf5c-323974185a1f" acquired by "delete_volume" :: waited 0.017s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:24:04 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf244e4b-df2c-4785-94a3-dadd4c5a795f]: (4, 'raw') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:24:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5f0d7bbf-93dc-44a0-bffa-e9e6e975a1ba tempest-TestInstancesWithCinderVolumes-1702359969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8fe423e8-78ce-40d8-bf5c-323974185a1f {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:24:04 devstack sudo[104958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8fe423e8-78ce-40d8-bf5c-323974185a1f Jul 10 10:24:04 devstack sudo[104958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:24:05 devstack sudo[104958]: pam_unix(sudo:session): session closed for user root Jul 10 10:24:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5f0d7bbf-93dc-44a0-bffa-e9e6e975a1ba tempest-TestInstancesWithCinderVolumes-1702359969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8fe423e8-78ce-40d8-bf5c-323974185a1f" returned: 0 in 0.754s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:24:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5f0d7bbf-93dc-44a0-bffa-e9e6e975a1ba tempest-TestInstancesWithCinderVolumes-1702359969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8fe423e8-78ce-40d8-bf5c-323974185a1f {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:24:05 devstack sudo[104964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8fe423e8-78ce-40d8-bf5c-323974185a1f Jul 10 10:24:05 devstack sudo[104964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:24:05 devstack sudo[104964]: pam_unix(sudo:session): session closed for user root Jul 10 10:24:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5f0d7bbf-93dc-44a0-bffa-e9e6e975a1ba tempest-TestInstancesWithCinderVolumes-1702359969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8fe423e8-78ce-40d8-bf5c-323974185a1f" returned: 1 in 0.747s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:24:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5f0d7bbf-93dc-44a0-bffa-e9e6e975a1ba tempest-TestInstancesWithCinderVolumes-1702359969 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8fe423e8-78ce-40d8-bf5c-323974185a1f' failed. Not Retrying. {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 10:24:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5f0d7bbf-93dc-44a0-bffa-e9e6e975a1ba tempest-TestInstancesWithCinderVolumes-1702359969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8fe423e8-78ce-40d8-bf5c-323974185a1f {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:24:05 devstack sudo[104969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8fe423e8-78ce-40d8-bf5c-323974185a1f Jul 10 10:24:05 devstack sudo[104969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:24:06 devstack sudo[104969]: pam_unix(sudo:session): session closed for user root Jul 10 10:24:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5f0d7bbf-93dc-44a0-bffa-e9e6e975a1ba tempest-TestInstancesWithCinderVolumes-1702359969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8fe423e8-78ce-40d8-bf5c-323974185a1f" returned: 0 in 0.662s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:24:06 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-5f0d7bbf-93dc-44a0-bffa-e9e6e975a1ba tempest-TestInstancesWithCinderVolumes-1702359969 None] Lock "cinder-quobyte-8fe423e8-78ce-40d8-bf5c-323974185a1f" released by "delete_volume" :: held 2.230s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:24:06 devstack cinder-volume[87234]: WARNING cinder.quota [None req-5f0d7bbf-93dc-44a0-bffa-e9e6e975a1ba tempest-TestInstancesWithCinderVolumes-1702359969 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-240095127-1316839358 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-240095127-1316839358, it is now deprecated. Please use the default quota class for default quota. Jul 10 10:24:06 devstack cinder-volume[87234]: WARNING cinder.quota [None req-5f0d7bbf-93dc-44a0-bffa-e9e6e975a1ba tempest-TestInstancesWithCinderVolumes-1702359969 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-240095127-1316839358 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-240095127-1316839358, it is now deprecated. Please use the default quota class for default quota. Jul 10 10:24:06 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-5f0d7bbf-93dc-44a0-bffa-e9e6e975a1ba tempest-TestInstancesWithCinderVolumes-1702359969 None] Created reservations ['c13ae21a-3411-45d5-93e8-2be4eea173a2', 'c157b228-c0ec-4a26-b433-28738a6266fa', '345e5d47-9e76-4f57-a60b-b57bea0feac3', '0c3d82e3-71f1-421c-b989-a781acce01ff'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:24:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-5f0d7bbf-93dc-44a0-bffa-e9e6e975a1ba tempest-TestInstancesWithCinderVolumes-1702359969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:24:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-5f0d7bbf-93dc-44a0-bffa-e9e6e975a1ba tempest-TestInstancesWithCinderVolumes-1702359969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:24:06 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-5f0d7bbf-93dc-44a0-bffa-e9e6e975a1ba tempest-TestInstancesWithCinderVolumes-1702359969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:24:06 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-5f0d7bbf-93dc-44a0-bffa-e9e6e975a1ba tempest-TestInstancesWithCinderVolumes-1702359969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:24:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-5f0d7bbf-93dc-44a0-bffa-e9e6e975a1ba tempest-TestInstancesWithCinderVolumes-1702359969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:24:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5f0d7bbf-93dc-44a0-bffa-e9e6e975a1ba tempest-TestInstancesWithCinderVolumes-1702359969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:24:06 devstack sudo[104972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:24:06 devstack sudo[104972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:24:07 devstack sudo[104972]: pam_unix(sudo:session): session closed for user root Jul 10 10:24:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5f0d7bbf-93dc-44a0-bffa-e9e6e975a1ba tempest-TestInstancesWithCinderVolumes-1702359969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.640s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:24:07 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-5f0d7bbf-93dc-44a0-bffa-e9e6e975a1ba tempest-TestInstancesWithCinderVolumes-1702359969 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:24:07 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-5f0d7bbf-93dc-44a0-bffa-e9e6e975a1ba tempest-TestInstancesWithCinderVolumes-1702359969 None] Deleted volume successfully. Jul 10 10:24:07 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-5f0d7bbf-93dc-44a0-bffa-e9e6e975a1ba tempest-TestInstancesWithCinderVolumes-1702359969 None] Lock "cinder-8fe423e8-78ce-40d8-bf5c-323974185a1f-delete_volume" released by "delete_volume" :: held 3.075s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:24:16 devstack cinder-volume[87234]: DEBUG dbcounter [-] [87234] Writing DB stats cinder:UPDATE=28,cinder:SELECT=16,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 10:24:17 devstack cinder-volume[87234]: DEBUG dbcounter [-] [87234] Writing DB stats cinder:SELECT=29,cinder:UPDATE=24,cinder:INSERT=8,cinder:DELETE=2 {{(pid=87234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 10:24:17 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-7afb1ed5-f0a0-4348-b7b5-76858f357b9b tempest-CreateVolumesFromSnapshotTest-912888318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:24:17 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-7afb1ed5-f0a0-4348-b7b5-76858f357b9b tempest-CreateVolumesFromSnapshotTest-912888318 None] Flow 'volume_create_manager' (4a166b26-5a0e-4266-99a0-a12766175fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:24:17 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-7afb1ed5-f0a0-4348-b7b5-76858f357b9b tempest-CreateVolumesFromSnapshotTest-912888318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e429f79-1f49-4791-9e9d-9069d6dc085d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:24:17 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-7afb1ed5-f0a0-4348-b7b5-76858f357b9b tempest-CreateVolumesFromSnapshotTest-912888318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e429f79-1f49-4791-9e9d-9069d6dc085d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:24:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1707168988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9abbee2-c5d5-4f3f-9898-63464e064d50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b60a11d051f942b98618e3f6f4d9b1a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:24:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:24:17Z,use_quota=True,user_id='3a397496280c4be2a81985f862f595d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:24:17 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-7afb1ed5-f0a0-4348-b7b5-76858f357b9b tempest-CreateVolumesFromSnapshotTest-912888318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93dbd0a4-36cd-48de-8b45-0050c82f2df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:24:17 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-7afb1ed5-f0a0-4348-b7b5-76858f357b9b tempest-CreateVolumesFromSnapshotTest-912888318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93dbd0a4-36cd-48de-8b45-0050c82f2df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:24:17 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-7afb1ed5-f0a0-4348-b7b5-76858f357b9b tempest-CreateVolumesFromSnapshotTest-912888318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9998bd9-43f0-47e3-8cab-acfa0b26051b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:24:17 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-7afb1ed5-f0a0-4348-b7b5-76858f357b9b tempest-CreateVolumesFromSnapshotTest-912888318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9998bd9-43f0-47e3-8cab-acfa0b26051b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9abbee2-c5d5-4f3f-9898-63464e064d50', 'volume_name': 'volume-b9abbee2-c5d5-4f3f-9898-63464e064d50', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:24:17 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-7afb1ed5-f0a0-4348-b7b5-76858f357b9b tempest-CreateVolumesFromSnapshotTest-912888318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82f457e5-a3aa-4179-bf77-6564172bb0c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:24:17 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-7afb1ed5-f0a0-4348-b7b5-76858f357b9b tempest-CreateVolumesFromSnapshotTest-912888318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82f457e5-a3aa-4179-bf77-6564172bb0c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:24:17 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-7afb1ed5-f0a0-4348-b7b5-76858f357b9b tempest-CreateVolumesFromSnapshotTest-912888318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efa473e2-9951-4b15-8bd7-93146f9f6103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:24:17 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-7afb1ed5-f0a0-4348-b7b5-76858f357b9b tempest-CreateVolumesFromSnapshotTest-912888318 None] Volume b9abbee2-c5d5-4f3f-9898-63464e064d50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9abbee2-c5d5-4f3f-9898-63464e064d50', 'volume_size': 1} Jul 10 10:24:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-7afb1ed5-f0a0-4348-b7b5-76858f357b9b tempest-CreateVolumesFromSnapshotTest-912888318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:24:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-7afb1ed5-f0a0-4348-b7b5-76858f357b9b tempest-CreateVolumesFromSnapshotTest-912888318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:24:17 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-7afb1ed5-f0a0-4348-b7b5-76858f357b9b tempest-CreateVolumesFromSnapshotTest-912888318 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:24:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1707168988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9abbee2-c5d5-4f3f-9898-63464e064d50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b60a11d051f942b98618e3f6f4d9b1a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:24:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:24:17Z,use_quota=True,user_id='3a397496280c4be2a81985f862f595d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:24:17 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-7afb1ed5-f0a0-4348-b7b5-76858f357b9b tempest-CreateVolumesFromSnapshotTest-912888318 None] Creating volume b9abbee2-c5d5-4f3f-9898-63464e064d50 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:24:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-7afb1ed5-f0a0-4348-b7b5-76858f357b9b tempest-CreateVolumesFromSnapshotTest-912888318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:24:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-7afb1ed5-f0a0-4348-b7b5-76858f357b9b tempest-CreateVolumesFromSnapshotTest-912888318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:24:17 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-7afb1ed5-f0a0-4348-b7b5-76858f357b9b tempest-CreateVolumesFromSnapshotTest-912888318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:24:17 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-7afb1ed5-f0a0-4348-b7b5-76858f357b9b tempest-CreateVolumesFromSnapshotTest-912888318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:24:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-7afb1ed5-f0a0-4348-b7b5-76858f357b9b tempest-CreateVolumesFromSnapshotTest-912888318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:24:17 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-7afb1ed5-f0a0-4348-b7b5-76858f357b9b tempest-CreateVolumesFromSnapshotTest-912888318 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:24:17 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-7afb1ed5-f0a0-4348-b7b5-76858f357b9b tempest-CreateVolumesFromSnapshotTest-912888318 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:24:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-7afb1ed5-f0a0-4348-b7b5-76858f357b9b tempest-CreateVolumesFromSnapshotTest-912888318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b9abbee2-c5d5-4f3f-9898-63464e064d50 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:24:17 devstack sudo[104982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b9abbee2-c5d5-4f3f-9898-63464e064d50 1073741824 Jul 10 10:24:17 devstack sudo[104982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:24:18 devstack sudo[104982]: pam_unix(sudo:session): session closed for user root Jul 10 10:24:18 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-7afb1ed5-f0a0-4348-b7b5-76858f357b9b tempest-CreateVolumesFromSnapshotTest-912888318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b9abbee2-c5d5-4f3f-9898-63464e064d50 1073741824" returned: 0 in 0.821s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:24:18 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-7afb1ed5-f0a0-4348-b7b5-76858f357b9b tempest-CreateVolumesFromSnapshotTest-912888318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b9abbee2-c5d5-4f3f-9898-63464e064d50 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:24:18 devstack sudo[104988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b9abbee2-c5d5-4f3f-9898-63464e064d50 Jul 10 10:24:18 devstack sudo[104988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:24:19 devstack sudo[104988]: pam_unix(sudo:session): session closed for user root Jul 10 10:24:19 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-7afb1ed5-f0a0-4348-b7b5-76858f357b9b tempest-CreateVolumesFromSnapshotTest-912888318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b9abbee2-c5d5-4f3f-9898-63464e064d50" returned: 0 in 0.667s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:24:19 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-7afb1ed5-f0a0-4348-b7b5-76858f357b9b tempest-CreateVolumesFromSnapshotTest-912888318 None] <== create_volume: return (1531ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:24:19 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-7afb1ed5-f0a0-4348-b7b5-76858f357b9b tempest-CreateVolumesFromSnapshotTest-912888318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.534s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:24:19 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-7afb1ed5-f0a0-4348-b7b5-76858f357b9b tempest-CreateVolumesFromSnapshotTest-912888318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efa473e2-9951-4b15-8bd7-93146f9f6103) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9abbee2-c5d5-4f3f-9898-63464e064d50', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:24:19 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-7afb1ed5-f0a0-4348-b7b5-76858f357b9b tempest-CreateVolumesFromSnapshotTest-912888318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (678af426-835b-443f-b845-dee5dd31a023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:24:19 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-7afb1ed5-f0a0-4348-b7b5-76858f357b9b tempest-CreateVolumesFromSnapshotTest-912888318 None] Volume volume-b9abbee2-c5d5-4f3f-9898-63464e064d50 (b9abbee2-c5d5-4f3f-9898-63464e064d50): created successfully Jul 10 10:24:19 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-7afb1ed5-f0a0-4348-b7b5-76858f357b9b tempest-CreateVolumesFromSnapshotTest-912888318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (678af426-835b-443f-b845-dee5dd31a023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:24:19 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-7afb1ed5-f0a0-4348-b7b5-76858f357b9b tempest-CreateVolumesFromSnapshotTest-912888318 None] Flow 'volume_create_manager' (4a166b26-5a0e-4266-99a0-a12766175fbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:24:19 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-7afb1ed5-f0a0-4348-b7b5-76858f357b9b tempest-CreateVolumesFromSnapshotTest-912888318 None] Created volume successfully. Jul 10 10:24:19 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-22876c7e-8cc9-421d-a535-0cfb68d9fa16 tempest-CreateVolumesFromSnapshotTest-912888318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:24:19 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-22876c7e-8cc9-421d-a535-0cfb68d9fa16 tempest-CreateVolumesFromSnapshotTest-912888318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:24:19 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-22876c7e-8cc9-421d-a535-0cfb68d9fa16 tempest-CreateVolumesFromSnapshotTest-912888318 None] Creating offline snapshot 9f8f49d7-f74b-4bf6-b33f-6648d69a1684 of volume b9abbee2-c5d5-4f3f-9898-63464e064d50 {{(pid=87234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 10:24:19 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d872844-9422-4332-821f-d630417adb86]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:24:19 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-22876c7e-8cc9-421d-a535-0cfb68d9fa16 tempest-CreateVolumesFromSnapshotTest-912888318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b9abbee2-c5d5-4f3f-9898-63464e064d50 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:24:19 devstack sudo[105026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b9abbee2-c5d5-4f3f-9898-63464e064d50 Jul 10 10:24:19 devstack sudo[105026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:24:20 devstack sudo[105026]: pam_unix(sudo:session): session closed for user root Jul 10 10:24:20 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-22876c7e-8cc9-421d-a535-0cfb68d9fa16 tempest-CreateVolumesFromSnapshotTest-912888318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b9abbee2-c5d5-4f3f-9898-63464e064d50" returned: 0 in 0.779s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:24:20 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-22876c7e-8cc9-421d-a535-0cfb68d9fa16 tempest-CreateVolumesFromSnapshotTest-912888318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b9abbee2-c5d5-4f3f-9898-63464e064d50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b9abbee2-c5d5-4f3f-9898-63464e064d50.9f8f49d7-f74b-4bf6-b33f-6648d69a1684 1G {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:24:20 devstack sudo[105033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b9abbee2-c5d5-4f3f-9898-63464e064d50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b9abbee2-c5d5-4f3f-9898-63464e064d50.9f8f49d7-f74b-4bf6-b33f-6648d69a1684 1G Jul 10 10:24:20 devstack sudo[105033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:24:21 devstack sudo[105033]: pam_unix(sudo:session): session closed for user root Jul 10 10:24:21 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-22876c7e-8cc9-421d-a535-0cfb68d9fa16 tempest-CreateVolumesFromSnapshotTest-912888318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b9abbee2-c5d5-4f3f-9898-63464e064d50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b9abbee2-c5d5-4f3f-9898-63464e064d50.9f8f49d7-f74b-4bf6-b33f-6648d69a1684 1G" returned: 0 in 0.794s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:24:21 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-22876c7e-8cc9-421d-a535-0cfb68d9fa16 tempest-CreateVolumesFromSnapshotTest-912888318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9abbee2-c5d5-4f3f-9898-63464e064d50 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b9abbee2-c5d5-4f3f-9898-63464e064d50.9f8f49d7-f74b-4bf6-b33f-6648d69a1684 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:24:21 devstack sudo[105038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9abbee2-c5d5-4f3f-9898-63464e064d50 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b9abbee2-c5d5-4f3f-9898-63464e064d50.9f8f49d7-f74b-4bf6-b33f-6648d69a1684 Jul 10 10:24:21 devstack sudo[105038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:24:21 devstack sudo[105038]: pam_unix(sudo:session): session closed for user root Jul 10 10:24:21 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-22876c7e-8cc9-421d-a535-0cfb68d9fa16 tempest-CreateVolumesFromSnapshotTest-912888318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9abbee2-c5d5-4f3f-9898-63464e064d50 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b9abbee2-c5d5-4f3f-9898-63464e064d50.9f8f49d7-f74b-4bf6-b33f-6648d69a1684" returned: 0 in 0.671s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:24:21 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-22876c7e-8cc9-421d-a535-0cfb68d9fa16 tempest-CreateVolumesFromSnapshotTest-912888318 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b9abbee2-c5d5-4f3f-9898-63464e064d50.9f8f49d7-f74b-4bf6-b33f-6648d69a1684 is being set with open permissions: ugo+rw Jul 10 10:24:21 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-22876c7e-8cc9-421d-a535-0cfb68d9fa16 tempest-CreateVolumesFromSnapshotTest-912888318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b9abbee2-c5d5-4f3f-9898-63464e064d50.9f8f49d7-f74b-4bf6-b33f-6648d69a1684 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:24:21 devstack sudo[105043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b9abbee2-c5d5-4f3f-9898-63464e064d50.9f8f49d7-f74b-4bf6-b33f-6648d69a1684 Jul 10 10:24:21 devstack sudo[105043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:24:22 devstack sudo[105043]: pam_unix(sudo:session): session closed for user root Jul 10 10:24:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-22876c7e-8cc9-421d-a535-0cfb68d9fa16 tempest-CreateVolumesFromSnapshotTest-912888318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b9abbee2-c5d5-4f3f-9898-63464e064d50.9f8f49d7-f74b-4bf6-b33f-6648d69a1684" returned: 0 in 0.653s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:24:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-22876c7e-8cc9-421d-a535-0cfb68d9fa16 tempest-CreateVolumesFromSnapshotTest-912888318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b9abbee2-c5d5-4f3f-9898-63464e064d50.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:24:22 devstack sudo[105048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b9abbee2-c5d5-4f3f-9898-63464e064d50.info Jul 10 10:24:22 devstack sudo[105048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:24:23 devstack sudo[105048]: pam_unix(sudo:session): session closed for user root Jul 10 10:24:23 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-22876c7e-8cc9-421d-a535-0cfb68d9fa16 tempest-CreateVolumesFromSnapshotTest-912888318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b9abbee2-c5d5-4f3f-9898-63464e064d50.info" returned: 0 in 0.645s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:24:23 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-22876c7e-8cc9-421d-a535-0cfb68d9fa16 tempest-CreateVolumesFromSnapshotTest-912888318 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b9abbee2-c5d5-4f3f-9898-63464e064d50.info is being set with open permissions: ugo+rw Jul 10 10:24:23 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-22876c7e-8cc9-421d-a535-0cfb68d9fa16 tempest-CreateVolumesFromSnapshotTest-912888318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b9abbee2-c5d5-4f3f-9898-63464e064d50.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:24:23 devstack sudo[105051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b9abbee2-c5d5-4f3f-9898-63464e064d50.info Jul 10 10:24:23 devstack sudo[105051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:24:23 devstack sudo[105051]: pam_unix(sudo:session): session closed for user root Jul 10 10:24:23 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-22876c7e-8cc9-421d-a535-0cfb68d9fa16 tempest-CreateVolumesFromSnapshotTest-912888318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b9abbee2-c5d5-4f3f-9898-63464e064d50.info" returned: 0 in 0.629s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:24:23 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-22876c7e-8cc9-421d-a535-0cfb68d9fa16 tempest-CreateVolumesFromSnapshotTest-912888318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.259s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:24:23 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-22876c7e-8cc9-421d-a535-0cfb68d9fa16 tempest-CreateVolumesFromSnapshotTest-912888318 None] Create snapshot completed successfully Jul 10 10:24:25 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-6096eba7-dead-4892-8ae9-15b6751671bc tempest-CreateVolumesFromSnapshotTest-912888318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:24:25 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-6096eba7-dead-4892-8ae9-15b6751671bc tempest-CreateVolumesFromSnapshotTest-912888318 None] Flow 'volume_create_manager' (27df4e6d-6686-422f-ba3a-be3c1f0197b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:24:25 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-6096eba7-dead-4892-8ae9-15b6751671bc tempest-CreateVolumesFromSnapshotTest-912888318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cc0a3ba-d151-4348-9542-03657acdaec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:24:25 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-6096eba7-dead-4892-8ae9-15b6751671bc tempest-CreateVolumesFromSnapshotTest-912888318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cc0a3ba-d151-4348-9542-03657acdaec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:24:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1798862465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4c5227a-a2c4-4bd3-a7a8-0630661fa1bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b60a11d051f942b98618e3f6f4d9b1a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:24:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:24:25Z,use_quota=True,user_id='3a397496280c4be2a81985f862f595d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:24:25 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-6096eba7-dead-4892-8ae9-15b6751671bc tempest-CreateVolumesFromSnapshotTest-912888318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24e6fddd-a2e9-406b-b74b-bb55619bc3f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:24:25 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-6096eba7-dead-4892-8ae9-15b6751671bc tempest-CreateVolumesFromSnapshotTest-912888318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24e6fddd-a2e9-406b-b74b-bb55619bc3f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:24:25 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-6096eba7-dead-4892-8ae9-15b6751671bc tempest-CreateVolumesFromSnapshotTest-912888318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (740836fa-97c8-40fb-9633-45b4353478f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:24:25 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-6096eba7-dead-4892-8ae9-15b6751671bc tempest-CreateVolumesFromSnapshotTest-912888318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (740836fa-97c8-40fb-9633-45b4353478f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4c5227a-a2c4-4bd3-a7a8-0630661fa1bd', 'volume_name': 'volume-b4c5227a-a2c4-4bd3-a7a8-0630661fa1bd', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:24:25 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-6096eba7-dead-4892-8ae9-15b6751671bc tempest-CreateVolumesFromSnapshotTest-912888318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5090042b-0891-404e-9693-d75fc23def38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:24:25 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-6096eba7-dead-4892-8ae9-15b6751671bc tempest-CreateVolumesFromSnapshotTest-912888318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5090042b-0891-404e-9693-d75fc23def38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:24:25 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-6096eba7-dead-4892-8ae9-15b6751671bc tempest-CreateVolumesFromSnapshotTest-912888318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (918d430e-c07c-4b65-b155-07e58d8f1a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:24:25 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-6096eba7-dead-4892-8ae9-15b6751671bc tempest-CreateVolumesFromSnapshotTest-912888318 None] Volume b4c5227a-a2c4-4bd3-a7a8-0630661fa1bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4c5227a-a2c4-4bd3-a7a8-0630661fa1bd', 'volume_size': 1} Jul 10 10:24:25 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-6096eba7-dead-4892-8ae9-15b6751671bc tempest-CreateVolumesFromSnapshotTest-912888318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:24:25 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-6096eba7-dead-4892-8ae9-15b6751671bc tempest-CreateVolumesFromSnapshotTest-912888318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:24:25 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-6096eba7-dead-4892-8ae9-15b6751671bc tempest-CreateVolumesFromSnapshotTest-912888318 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:24:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1798862465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4c5227a-a2c4-4bd3-a7a8-0630661fa1bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b60a11d051f942b98618e3f6f4d9b1a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:24:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:24:25Z,use_quota=True,user_id='3a397496280c4be2a81985f862f595d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:24:25 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-6096eba7-dead-4892-8ae9-15b6751671bc tempest-CreateVolumesFromSnapshotTest-912888318 None] Creating volume b4c5227a-a2c4-4bd3-a7a8-0630661fa1bd {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:24:25 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-6096eba7-dead-4892-8ae9-15b6751671bc tempest-CreateVolumesFromSnapshotTest-912888318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:24:25 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-6096eba7-dead-4892-8ae9-15b6751671bc tempest-CreateVolumesFromSnapshotTest-912888318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:24:25 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-6096eba7-dead-4892-8ae9-15b6751671bc tempest-CreateVolumesFromSnapshotTest-912888318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:24:25 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-6096eba7-dead-4892-8ae9-15b6751671bc tempest-CreateVolumesFromSnapshotTest-912888318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:24:25 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-6096eba7-dead-4892-8ae9-15b6751671bc tempest-CreateVolumesFromSnapshotTest-912888318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:24:25 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-6096eba7-dead-4892-8ae9-15b6751671bc tempest-CreateVolumesFromSnapshotTest-912888318 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:24:25 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-6096eba7-dead-4892-8ae9-15b6751671bc tempest-CreateVolumesFromSnapshotTest-912888318 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:24:25 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-6096eba7-dead-4892-8ae9-15b6751671bc tempest-CreateVolumesFromSnapshotTest-912888318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b4c5227a-a2c4-4bd3-a7a8-0630661fa1bd 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:24:25 devstack sudo[105054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b4c5227a-a2c4-4bd3-a7a8-0630661fa1bd 1073741824 Jul 10 10:24:25 devstack sudo[105054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:24:25 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-58395dbe-7c44-435b-94e1-9ee3fc522b34 tempest-CreateVolumesFromSnapshotTest-912888318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:24:25 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-58395dbe-7c44-435b-94e1-9ee3fc522b34 tempest-CreateVolumesFromSnapshotTest-912888318 None] Flow 'volume_create_manager' (9ad4553c-e714-44fc-be6f-67c55aab6be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:24:25 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-58395dbe-7c44-435b-94e1-9ee3fc522b34 tempest-CreateVolumesFromSnapshotTest-912888318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0926a1c-e367-4a08-8d50-3dfe5e70ac12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:24:25 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-58395dbe-7c44-435b-94e1-9ee3fc522b34 tempest-CreateVolumesFromSnapshotTest-912888318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0926a1c-e367-4a08-8d50-3dfe5e70ac12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:24:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-838471404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4ddd52f-b508-4efe-9899-1313e66f9be9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b60a11d051f942b98618e3f6f4d9b1a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:24:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:24:26Z,use_quota=True,user_id='3a397496280c4be2a81985f862f595d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:24:25 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-58395dbe-7c44-435b-94e1-9ee3fc522b34 tempest-CreateVolumesFromSnapshotTest-912888318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffbb85bc-1cbc-4af7-8c37-e726cb248ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:24:25 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-58395dbe-7c44-435b-94e1-9ee3fc522b34 tempest-CreateVolumesFromSnapshotTest-912888318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffbb85bc-1cbc-4af7-8c37-e726cb248ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:24:25 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-58395dbe-7c44-435b-94e1-9ee3fc522b34 tempest-CreateVolumesFromSnapshotTest-912888318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75c59971-cc7a-4e27-b82d-baf185d91ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:24:25 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-58395dbe-7c44-435b-94e1-9ee3fc522b34 tempest-CreateVolumesFromSnapshotTest-912888318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75c59971-cc7a-4e27-b82d-baf185d91ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4ddd52f-b508-4efe-9899-1313e66f9be9', 'volume_name': 'volume-b4ddd52f-b508-4efe-9899-1313e66f9be9', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:24:25 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-58395dbe-7c44-435b-94e1-9ee3fc522b34 tempest-CreateVolumesFromSnapshotTest-912888318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81820db6-90ed-49a0-b46c-a92d8bbfea98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:24:25 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-58395dbe-7c44-435b-94e1-9ee3fc522b34 tempest-CreateVolumesFromSnapshotTest-912888318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81820db6-90ed-49a0-b46c-a92d8bbfea98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:24:25 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-58395dbe-7c44-435b-94e1-9ee3fc522b34 tempest-CreateVolumesFromSnapshotTest-912888318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fa5b01c-02ba-4f9f-9fb0-4c8dd33fd7c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:24:25 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-58395dbe-7c44-435b-94e1-9ee3fc522b34 tempest-CreateVolumesFromSnapshotTest-912888318 None] Volume b4ddd52f-b508-4efe-9899-1313e66f9be9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4ddd52f-b508-4efe-9899-1313e66f9be9', 'volume_size': 1} Jul 10 10:24:25 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-58395dbe-7c44-435b-94e1-9ee3fc522b34 tempest-CreateVolumesFromSnapshotTest-912888318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:24:26 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fc35fa5-6059-4d44-8fa0-9be95b86df6f tempest-CreateVolumesFromSnapshotTest-912888318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:24:26 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8fc35fa5-6059-4d44-8fa0-9be95b86df6f tempest-CreateVolumesFromSnapshotTest-912888318 None] Flow 'volume_create_manager' (edd835ec-90a8-4538-90fd-8203027ae279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:24:26 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8fc35fa5-6059-4d44-8fa0-9be95b86df6f tempest-CreateVolumesFromSnapshotTest-912888318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45ee3d58-dea3-495a-8641-6990a6fc1e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:24:26 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8fc35fa5-6059-4d44-8fa0-9be95b86df6f tempest-CreateVolumesFromSnapshotTest-912888318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45ee3d58-dea3-495a-8641-6990a6fc1e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:24:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1163742593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64eb72fd-e216-4d3f-9a73-929a3c5a4a63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b60a11d051f942b98618e3f6f4d9b1a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:24:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:24:26Z,use_quota=True,user_id='3a397496280c4be2a81985f862f595d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:24:26 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8fc35fa5-6059-4d44-8fa0-9be95b86df6f tempest-CreateVolumesFromSnapshotTest-912888318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d0df393-c78e-4b9c-b229-edb3c5803fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:24:26 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8fc35fa5-6059-4d44-8fa0-9be95b86df6f tempest-CreateVolumesFromSnapshotTest-912888318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d0df393-c78e-4b9c-b229-edb3c5803fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:24:26 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8fc35fa5-6059-4d44-8fa0-9be95b86df6f tempest-CreateVolumesFromSnapshotTest-912888318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e9becbe-2288-4465-ab42-6efc67b93204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:24:26 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8fc35fa5-6059-4d44-8fa0-9be95b86df6f tempest-CreateVolumesFromSnapshotTest-912888318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e9becbe-2288-4465-ab42-6efc67b93204) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64eb72fd-e216-4d3f-9a73-929a3c5a4a63', 'volume_name': 'volume-64eb72fd-e216-4d3f-9a73-929a3c5a4a63', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:24:26 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8fc35fa5-6059-4d44-8fa0-9be95b86df6f tempest-CreateVolumesFromSnapshotTest-912888318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f67c055-ba03-4852-8eb6-4aef0f616b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:24:26 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8fc35fa5-6059-4d44-8fa0-9be95b86df6f tempest-CreateVolumesFromSnapshotTest-912888318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f67c055-ba03-4852-8eb6-4aef0f616b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:24:26 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8fc35fa5-6059-4d44-8fa0-9be95b86df6f tempest-CreateVolumesFromSnapshotTest-912888318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (342ee771-f0ba-4f00-aef3-7bb07db09868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:24:26 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-8fc35fa5-6059-4d44-8fa0-9be95b86df6f tempest-CreateVolumesFromSnapshotTest-912888318 None] Volume 64eb72fd-e216-4d3f-9a73-929a3c5a4a63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64eb72fd-e216-4d3f-9a73-929a3c5a4a63', 'volume_size': 1} Jul 10 10:24:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-8fc35fa5-6059-4d44-8fa0-9be95b86df6f tempest-CreateVolumesFromSnapshotTest-912888318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:24:26 devstack sudo[105054]: pam_unix(sudo:session): session closed for user root Jul 10 10:24:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-6096eba7-dead-4892-8ae9-15b6751671bc tempest-CreateVolumesFromSnapshotTest-912888318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b4c5227a-a2c4-4bd3-a7a8-0630661fa1bd 1073741824" returned: 0 in 0.941s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:24:26 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-92a446eb-7320-4a40-bc3f-54fc0e669edc tempest-CreateVolumesFromSnapshotTest-912888318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:24:26 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-92a446eb-7320-4a40-bc3f-54fc0e669edc tempest-CreateVolumesFromSnapshotTest-912888318 None] Flow 'volume_create_manager' (5a475544-3970-4d98-a255-e249e406c1c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:24:26 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-92a446eb-7320-4a40-bc3f-54fc0e669edc tempest-CreateVolumesFromSnapshotTest-912888318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0ebd6ba-2bd6-4302-8730-71329b03ebed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:24:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-6096eba7-dead-4892-8ae9-15b6751671bc tempest-CreateVolumesFromSnapshotTest-912888318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b4c5227a-a2c4-4bd3-a7a8-0630661fa1bd {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:24:26 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-92a446eb-7320-4a40-bc3f-54fc0e669edc tempest-CreateVolumesFromSnapshotTest-912888318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0ebd6ba-2bd6-4302-8730-71329b03ebed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:24:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-449247426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bb6b7fd-685f-430d-bd88-4fb28f29ba73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b60a11d051f942b98618e3f6f4d9b1a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:24:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:24:26Z,use_quota=True,user_id='3a397496280c4be2a81985f862f595d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:24:26 devstack sudo[105060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b4c5227a-a2c4-4bd3-a7a8-0630661fa1bd Jul 10 10:24:26 devstack sudo[105060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:24:26 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-92a446eb-7320-4a40-bc3f-54fc0e669edc tempest-CreateVolumesFromSnapshotTest-912888318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7876868d-6012-4135-8cca-268097220fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:24:26 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-92a446eb-7320-4a40-bc3f-54fc0e669edc tempest-CreateVolumesFromSnapshotTest-912888318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7876868d-6012-4135-8cca-268097220fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:24:26 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-92a446eb-7320-4a40-bc3f-54fc0e669edc tempest-CreateVolumesFromSnapshotTest-912888318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bd7b9b0-b459-40fb-b534-7404b1567923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:24:26 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-92a446eb-7320-4a40-bc3f-54fc0e669edc tempest-CreateVolumesFromSnapshotTest-912888318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bd7b9b0-b459-40fb-b534-7404b1567923) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bb6b7fd-685f-430d-bd88-4fb28f29ba73', 'volume_name': 'volume-3bb6b7fd-685f-430d-bd88-4fb28f29ba73', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:24:26 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-92a446eb-7320-4a40-bc3f-54fc0e669edc tempest-CreateVolumesFromSnapshotTest-912888318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3e0ff7e-cd54-4c29-8f2f-530f10d7fe57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:24:26 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-92a446eb-7320-4a40-bc3f-54fc0e669edc tempest-CreateVolumesFromSnapshotTest-912888318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3e0ff7e-cd54-4c29-8f2f-530f10d7fe57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:24:26 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-92a446eb-7320-4a40-bc3f-54fc0e669edc tempest-CreateVolumesFromSnapshotTest-912888318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d1778c9-ae24-41d7-86a2-4ffba982aacb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:24:26 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-92a446eb-7320-4a40-bc3f-54fc0e669edc tempest-CreateVolumesFromSnapshotTest-912888318 None] Volume 3bb6b7fd-685f-430d-bd88-4fb28f29ba73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bb6b7fd-685f-430d-bd88-4fb28f29ba73', 'volume_size': 1} Jul 10 10:24:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-92a446eb-7320-4a40-bc3f-54fc0e669edc tempest-CreateVolumesFromSnapshotTest-912888318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:24:26 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a80f967-9fe2-4452-91c9-46fb10b89c8f tempest-CreateVolumesFromSnapshotTest-912888318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:24:26 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1a80f967-9fe2-4452-91c9-46fb10b89c8f tempest-CreateVolumesFromSnapshotTest-912888318 None] Flow 'volume_create_manager' (9380a314-3a14-41d1-9c07-284d6fd75bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:24:26 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1a80f967-9fe2-4452-91c9-46fb10b89c8f tempest-CreateVolumesFromSnapshotTest-912888318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2bd5dc5-26d2-4616-ad72-5a9ceba12286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:24:26 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1a80f967-9fe2-4452-91c9-46fb10b89c8f tempest-CreateVolumesFromSnapshotTest-912888318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2bd5dc5-26d2-4616-ad72-5a9ceba12286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:24:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-355023453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92021663-30f9-40dd-9ac8-631f7e5ac755,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b60a11d051f942b98618e3f6f4d9b1a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:24:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:24:27Z,use_quota=True,user_id='3a397496280c4be2a81985f862f595d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:24:26 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1a80f967-9fe2-4452-91c9-46fb10b89c8f tempest-CreateVolumesFromSnapshotTest-912888318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60542632-52c6-4624-b6e6-cc620bc9c5bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:24:26 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1a80f967-9fe2-4452-91c9-46fb10b89c8f tempest-CreateVolumesFromSnapshotTest-912888318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60542632-52c6-4624-b6e6-cc620bc9c5bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:24:26 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1a80f967-9fe2-4452-91c9-46fb10b89c8f tempest-CreateVolumesFromSnapshotTest-912888318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d985d6b3-06fd-424c-8b4b-0240cff0d17f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:24:26 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1a80f967-9fe2-4452-91c9-46fb10b89c8f tempest-CreateVolumesFromSnapshotTest-912888318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d985d6b3-06fd-424c-8b4b-0240cff0d17f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92021663-30f9-40dd-9ac8-631f7e5ac755', 'volume_name': 'volume-92021663-30f9-40dd-9ac8-631f7e5ac755', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:24:26 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1a80f967-9fe2-4452-91c9-46fb10b89c8f tempest-CreateVolumesFromSnapshotTest-912888318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d4362c4-3dc7-4adc-9114-d19f6c47dd74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:24:26 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1a80f967-9fe2-4452-91c9-46fb10b89c8f tempest-CreateVolumesFromSnapshotTest-912888318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d4362c4-3dc7-4adc-9114-d19f6c47dd74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:24:26 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1a80f967-9fe2-4452-91c9-46fb10b89c8f tempest-CreateVolumesFromSnapshotTest-912888318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf213ef7-e857-4aa1-9bee-77946dbf404c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:24:26 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-1a80f967-9fe2-4452-91c9-46fb10b89c8f tempest-CreateVolumesFromSnapshotTest-912888318 None] Volume 92021663-30f9-40dd-9ac8-631f7e5ac755: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92021663-30f9-40dd-9ac8-631f7e5ac755', 'volume_size': 1} Jul 10 10:24:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-1a80f967-9fe2-4452-91c9-46fb10b89c8f tempest-CreateVolumesFromSnapshotTest-912888318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:24:27 devstack sudo[105060]: pam_unix(sudo:session): session closed for user root Jul 10 10:24:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-6096eba7-dead-4892-8ae9-15b6751671bc tempest-CreateVolumesFromSnapshotTest-912888318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b4c5227a-a2c4-4bd3-a7a8-0630661fa1bd" returned: 0 in 0.707s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:24:27 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-6096eba7-dead-4892-8ae9-15b6751671bc tempest-CreateVolumesFromSnapshotTest-912888318 None] <== create_volume: return (1721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:24:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-6096eba7-dead-4892-8ae9-15b6751671bc tempest-CreateVolumesFromSnapshotTest-912888318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.724s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:24:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-58395dbe-7c44-435b-94e1-9ee3fc522b34 tempest-CreateVolumesFromSnapshotTest-912888318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.355s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:24:27 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-58395dbe-7c44-435b-94e1-9ee3fc522b34 tempest-CreateVolumesFromSnapshotTest-912888318 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:24:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-838471404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4ddd52f-b508-4efe-9899-1313e66f9be9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b60a11d051f942b98618e3f6f4d9b1a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:24:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:24:26Z,use_quota=True,user_id='3a397496280c4be2a81985f862f595d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:24:27 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-58395dbe-7c44-435b-94e1-9ee3fc522b34 tempest-CreateVolumesFromSnapshotTest-912888318 None] Creating volume b4ddd52f-b508-4efe-9899-1313e66f9be9 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:24:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-58395dbe-7c44-435b-94e1-9ee3fc522b34 tempest-CreateVolumesFromSnapshotTest-912888318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:24:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-58395dbe-7c44-435b-94e1-9ee3fc522b34 tempest-CreateVolumesFromSnapshotTest-912888318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:24:27 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-58395dbe-7c44-435b-94e1-9ee3fc522b34 tempest-CreateVolumesFromSnapshotTest-912888318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:24:27 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-58395dbe-7c44-435b-94e1-9ee3fc522b34 tempest-CreateVolumesFromSnapshotTest-912888318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:24:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-58395dbe-7c44-435b-94e1-9ee3fc522b34 tempest-CreateVolumesFromSnapshotTest-912888318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:24:27 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-58395dbe-7c44-435b-94e1-9ee3fc522b34 tempest-CreateVolumesFromSnapshotTest-912888318 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:24:27 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-58395dbe-7c44-435b-94e1-9ee3fc522b34 tempest-CreateVolumesFromSnapshotTest-912888318 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:24:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-58395dbe-7c44-435b-94e1-9ee3fc522b34 tempest-CreateVolumesFromSnapshotTest-912888318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b4ddd52f-b508-4efe-9899-1313e66f9be9 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:24:27 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-6096eba7-dead-4892-8ae9-15b6751671bc tempest-CreateVolumesFromSnapshotTest-912888318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (918d430e-c07c-4b65-b155-07e58d8f1a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4c5227a-a2c4-4bd3-a7a8-0630661fa1bd', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:24:27 devstack sudo[105063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b4ddd52f-b508-4efe-9899-1313e66f9be9 1073741824 Jul 10 10:24:27 devstack sudo[105063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:24:27 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-6096eba7-dead-4892-8ae9-15b6751671bc tempest-CreateVolumesFromSnapshotTest-912888318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbdde624-d5b6-46c9-8714-6dc826a86ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:24:27 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-6096eba7-dead-4892-8ae9-15b6751671bc tempest-CreateVolumesFromSnapshotTest-912888318 None] Volume volume-b4c5227a-a2c4-4bd3-a7a8-0630661fa1bd (b4c5227a-a2c4-4bd3-a7a8-0630661fa1bd): created successfully Jul 10 10:24:27 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-6096eba7-dead-4892-8ae9-15b6751671bc tempest-CreateVolumesFromSnapshotTest-912888318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbdde624-d5b6-46c9-8714-6dc826a86ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:24:27 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-6096eba7-dead-4892-8ae9-15b6751671bc tempest-CreateVolumesFromSnapshotTest-912888318 None] Flow 'volume_create_manager' (27df4e6d-6686-422f-ba3a-be3c1f0197b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:24:27 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-6096eba7-dead-4892-8ae9-15b6751671bc tempest-CreateVolumesFromSnapshotTest-912888318 None] Created volume successfully. Jul 10 10:24:27 devstack sudo[105063]: pam_unix(sudo:session): session closed for user root Jul 10 10:24:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-58395dbe-7c44-435b-94e1-9ee3fc522b34 tempest-CreateVolumesFromSnapshotTest-912888318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b4ddd52f-b508-4efe-9899-1313e66f9be9 1073741824" returned: 0 in 0.835s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:24:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-58395dbe-7c44-435b-94e1-9ee3fc522b34 tempest-CreateVolumesFromSnapshotTest-912888318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b4ddd52f-b508-4efe-9899-1313e66f9be9 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:24:27 devstack sudo[105069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b4ddd52f-b508-4efe-9899-1313e66f9be9 Jul 10 10:24:27 devstack sudo[105069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:24:28 devstack sudo[105069]: pam_unix(sudo:session): session closed for user root Jul 10 10:24:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-58395dbe-7c44-435b-94e1-9ee3fc522b34 tempest-CreateVolumesFromSnapshotTest-912888318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b4ddd52f-b508-4efe-9899-1313e66f9be9" returned: 0 in 0.648s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:24:28 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-58395dbe-7c44-435b-94e1-9ee3fc522b34 tempest-CreateVolumesFromSnapshotTest-912888318 None] <== create_volume: return (1519ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:24:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-58395dbe-7c44-435b-94e1-9ee3fc522b34 tempest-CreateVolumesFromSnapshotTest-912888318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.523s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:24:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-8fc35fa5-6059-4d44-8fa0-9be95b86df6f tempest-CreateVolumesFromSnapshotTest-912888318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.508s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:24:28 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-8fc35fa5-6059-4d44-8fa0-9be95b86df6f tempest-CreateVolumesFromSnapshotTest-912888318 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:24:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1163742593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64eb72fd-e216-4d3f-9a73-929a3c5a4a63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b60a11d051f942b98618e3f6f4d9b1a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:24:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:24:26Z,use_quota=True,user_id='3a397496280c4be2a81985f862f595d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:24:28 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-8fc35fa5-6059-4d44-8fa0-9be95b86df6f tempest-CreateVolumesFromSnapshotTest-912888318 None] Creating volume 64eb72fd-e216-4d3f-9a73-929a3c5a4a63 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:24:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-8fc35fa5-6059-4d44-8fa0-9be95b86df6f tempest-CreateVolumesFromSnapshotTest-912888318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:24:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-8fc35fa5-6059-4d44-8fa0-9be95b86df6f tempest-CreateVolumesFromSnapshotTest-912888318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:24:28 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-8fc35fa5-6059-4d44-8fa0-9be95b86df6f tempest-CreateVolumesFromSnapshotTest-912888318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:24:28 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-8fc35fa5-6059-4d44-8fa0-9be95b86df6f tempest-CreateVolumesFromSnapshotTest-912888318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:24:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-8fc35fa5-6059-4d44-8fa0-9be95b86df6f tempest-CreateVolumesFromSnapshotTest-912888318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:24:28 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-8fc35fa5-6059-4d44-8fa0-9be95b86df6f tempest-CreateVolumesFromSnapshotTest-912888318 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:24:28 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-8fc35fa5-6059-4d44-8fa0-9be95b86df6f tempest-CreateVolumesFromSnapshotTest-912888318 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:24:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-8fc35fa5-6059-4d44-8fa0-9be95b86df6f tempest-CreateVolumesFromSnapshotTest-912888318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-64eb72fd-e216-4d3f-9a73-929a3c5a4a63 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:24:28 devstack sudo[105072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-64eb72fd-e216-4d3f-9a73-929a3c5a4a63 1073741824 Jul 10 10:24:28 devstack sudo[105072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:24:28 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-58395dbe-7c44-435b-94e1-9ee3fc522b34 tempest-CreateVolumesFromSnapshotTest-912888318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fa5b01c-02ba-4f9f-9fb0-4c8dd33fd7c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4ddd52f-b508-4efe-9899-1313e66f9be9', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:24:28 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-58395dbe-7c44-435b-94e1-9ee3fc522b34 tempest-CreateVolumesFromSnapshotTest-912888318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c49d0f6-19e3-4dda-98a1-596310a170f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:24:28 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-58395dbe-7c44-435b-94e1-9ee3fc522b34 tempest-CreateVolumesFromSnapshotTest-912888318 None] Volume volume-b4ddd52f-b508-4efe-9899-1313e66f9be9 (b4ddd52f-b508-4efe-9899-1313e66f9be9): created successfully Jul 10 10:24:28 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-58395dbe-7c44-435b-94e1-9ee3fc522b34 tempest-CreateVolumesFromSnapshotTest-912888318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c49d0f6-19e3-4dda-98a1-596310a170f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:24:28 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-58395dbe-7c44-435b-94e1-9ee3fc522b34 tempest-CreateVolumesFromSnapshotTest-912888318 None] Flow 'volume_create_manager' (9ad4553c-e714-44fc-be6f-67c55aab6be4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:24:28 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-58395dbe-7c44-435b-94e1-9ee3fc522b34 tempest-CreateVolumesFromSnapshotTest-912888318 None] Created volume successfully. Jul 10 10:24:29 devstack sudo[105072]: pam_unix(sudo:session): session closed for user root Jul 10 10:24:29 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-8fc35fa5-6059-4d44-8fa0-9be95b86df6f tempest-CreateVolumesFromSnapshotTest-912888318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-64eb72fd-e216-4d3f-9a73-929a3c5a4a63 1073741824" returned: 0 in 0.800s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:24:29 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-8fc35fa5-6059-4d44-8fa0-9be95b86df6f tempest-CreateVolumesFromSnapshotTest-912888318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-64eb72fd-e216-4d3f-9a73-929a3c5a4a63 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:24:29 devstack sudo[105078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-64eb72fd-e216-4d3f-9a73-929a3c5a4a63 Jul 10 10:24:29 devstack sudo[105078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:24:30 devstack sudo[105078]: pam_unix(sudo:session): session closed for user root Jul 10 10:24:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-8fc35fa5-6059-4d44-8fa0-9be95b86df6f tempest-CreateVolumesFromSnapshotTest-912888318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-64eb72fd-e216-4d3f-9a73-929a3c5a4a63" returned: 0 in 0.625s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:24:30 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-8fc35fa5-6059-4d44-8fa0-9be95b86df6f tempest-CreateVolumesFromSnapshotTest-912888318 None] <== create_volume: return (1461ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:24:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-8fc35fa5-6059-4d44-8fa0-9be95b86df6f tempest-CreateVolumesFromSnapshotTest-912888318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.464s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:24:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-92a446eb-7320-4a40-bc3f-54fc0e669edc tempest-CreateVolumesFromSnapshotTest-912888318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.649s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:24:30 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-92a446eb-7320-4a40-bc3f-54fc0e669edc tempest-CreateVolumesFromSnapshotTest-912888318 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:24:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-449247426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bb6b7fd-685f-430d-bd88-4fb28f29ba73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b60a11d051f942b98618e3f6f4d9b1a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:24:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:24:26Z,use_quota=True,user_id='3a397496280c4be2a81985f862f595d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:24:30 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-92a446eb-7320-4a40-bc3f-54fc0e669edc tempest-CreateVolumesFromSnapshotTest-912888318 None] Creating volume 3bb6b7fd-685f-430d-bd88-4fb28f29ba73 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:24:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-92a446eb-7320-4a40-bc3f-54fc0e669edc tempest-CreateVolumesFromSnapshotTest-912888318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:24:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-92a446eb-7320-4a40-bc3f-54fc0e669edc tempest-CreateVolumesFromSnapshotTest-912888318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:24:30 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-92a446eb-7320-4a40-bc3f-54fc0e669edc tempest-CreateVolumesFromSnapshotTest-912888318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:24:30 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-92a446eb-7320-4a40-bc3f-54fc0e669edc tempest-CreateVolumesFromSnapshotTest-912888318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:24:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-92a446eb-7320-4a40-bc3f-54fc0e669edc tempest-CreateVolumesFromSnapshotTest-912888318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:24:30 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-92a446eb-7320-4a40-bc3f-54fc0e669edc tempest-CreateVolumesFromSnapshotTest-912888318 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:24:30 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-92a446eb-7320-4a40-bc3f-54fc0e669edc tempest-CreateVolumesFromSnapshotTest-912888318 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:24:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-92a446eb-7320-4a40-bc3f-54fc0e669edc tempest-CreateVolumesFromSnapshotTest-912888318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3bb6b7fd-685f-430d-bd88-4fb28f29ba73 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:24:30 devstack sudo[105081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3bb6b7fd-685f-430d-bd88-4fb28f29ba73 1073741824 Jul 10 10:24:30 devstack sudo[105081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:24:30 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8fc35fa5-6059-4d44-8fa0-9be95b86df6f tempest-CreateVolumesFromSnapshotTest-912888318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (342ee771-f0ba-4f00-aef3-7bb07db09868) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64eb72fd-e216-4d3f-9a73-929a3c5a4a63', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:24:30 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8fc35fa5-6059-4d44-8fa0-9be95b86df6f tempest-CreateVolumesFromSnapshotTest-912888318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4839322d-e688-4a6d-b65f-1325bc0768df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:24:30 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-8fc35fa5-6059-4d44-8fa0-9be95b86df6f tempest-CreateVolumesFromSnapshotTest-912888318 None] Volume volume-64eb72fd-e216-4d3f-9a73-929a3c5a4a63 (64eb72fd-e216-4d3f-9a73-929a3c5a4a63): created successfully Jul 10 10:24:30 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8fc35fa5-6059-4d44-8fa0-9be95b86df6f tempest-CreateVolumesFromSnapshotTest-912888318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4839322d-e688-4a6d-b65f-1325bc0768df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:24:30 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8fc35fa5-6059-4d44-8fa0-9be95b86df6f tempest-CreateVolumesFromSnapshotTest-912888318 None] Flow 'volume_create_manager' (edd835ec-90a8-4538-90fd-8203027ae279) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:24:30 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-8fc35fa5-6059-4d44-8fa0-9be95b86df6f tempest-CreateVolumesFromSnapshotTest-912888318 None] Created volume successfully. Jul 10 10:24:30 devstack sudo[105081]: pam_unix(sudo:session): session closed for user root Jul 10 10:24:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-92a446eb-7320-4a40-bc3f-54fc0e669edc tempest-CreateVolumesFromSnapshotTest-912888318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3bb6b7fd-685f-430d-bd88-4fb28f29ba73 1073741824" returned: 0 in 0.813s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:24:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-92a446eb-7320-4a40-bc3f-54fc0e669edc tempest-CreateVolumesFromSnapshotTest-912888318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3bb6b7fd-685f-430d-bd88-4fb28f29ba73 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:24:30 devstack sudo[105093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3bb6b7fd-685f-430d-bd88-4fb28f29ba73 Jul 10 10:24:30 devstack sudo[105093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:24:31 devstack sudo[105093]: pam_unix(sudo:session): session closed for user root Jul 10 10:24:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-92a446eb-7320-4a40-bc3f-54fc0e669edc tempest-CreateVolumesFromSnapshotTest-912888318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3bb6b7fd-685f-430d-bd88-4fb28f29ba73" returned: 0 in 0.643s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:24:31 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-92a446eb-7320-4a40-bc3f-54fc0e669edc tempest-CreateVolumesFromSnapshotTest-912888318 None] <== create_volume: return (1493ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:24:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-92a446eb-7320-4a40-bc3f-54fc0e669edc tempest-CreateVolumesFromSnapshotTest-912888318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.495s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:24:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-1a80f967-9fe2-4452-91c9-46fb10b89c8f tempest-CreateVolumesFromSnapshotTest-912888318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.812s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:24:31 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-1a80f967-9fe2-4452-91c9-46fb10b89c8f tempest-CreateVolumesFromSnapshotTest-912888318 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:24:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-355023453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92021663-30f9-40dd-9ac8-631f7e5ac755,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b60a11d051f942b98618e3f6f4d9b1a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:24:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:24:27Z,use_quota=True,user_id='3a397496280c4be2a81985f862f595d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:24:31 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-1a80f967-9fe2-4452-91c9-46fb10b89c8f tempest-CreateVolumesFromSnapshotTest-912888318 None] Creating volume 92021663-30f9-40dd-9ac8-631f7e5ac755 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:24:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-1a80f967-9fe2-4452-91c9-46fb10b89c8f tempest-CreateVolumesFromSnapshotTest-912888318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:24:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-1a80f967-9fe2-4452-91c9-46fb10b89c8f tempest-CreateVolumesFromSnapshotTest-912888318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:24:31 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-1a80f967-9fe2-4452-91c9-46fb10b89c8f tempest-CreateVolumesFromSnapshotTest-912888318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:24:31 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-1a80f967-9fe2-4452-91c9-46fb10b89c8f tempest-CreateVolumesFromSnapshotTest-912888318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:24:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-1a80f967-9fe2-4452-91c9-46fb10b89c8f tempest-CreateVolumesFromSnapshotTest-912888318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:24:31 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-1a80f967-9fe2-4452-91c9-46fb10b89c8f tempest-CreateVolumesFromSnapshotTest-912888318 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:24:31 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-1a80f967-9fe2-4452-91c9-46fb10b89c8f tempest-CreateVolumesFromSnapshotTest-912888318 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:24:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1a80f967-9fe2-4452-91c9-46fb10b89c8f tempest-CreateVolumesFromSnapshotTest-912888318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-92021663-30f9-40dd-9ac8-631f7e5ac755 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:24:31 devstack sudo[105096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-92021663-30f9-40dd-9ac8-631f7e5ac755 1073741824 Jul 10 10:24:31 devstack sudo[105096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:24:31 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-92a446eb-7320-4a40-bc3f-54fc0e669edc tempest-CreateVolumesFromSnapshotTest-912888318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d1778c9-ae24-41d7-86a2-4ffba982aacb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bb6b7fd-685f-430d-bd88-4fb28f29ba73', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:24:31 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-92a446eb-7320-4a40-bc3f-54fc0e669edc tempest-CreateVolumesFromSnapshotTest-912888318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (857a8fc4-bfa2-4914-998a-0f2038e56707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:24:31 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-92a446eb-7320-4a40-bc3f-54fc0e669edc tempest-CreateVolumesFromSnapshotTest-912888318 None] Volume volume-3bb6b7fd-685f-430d-bd88-4fb28f29ba73 (3bb6b7fd-685f-430d-bd88-4fb28f29ba73): created successfully Jul 10 10:24:31 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-92a446eb-7320-4a40-bc3f-54fc0e669edc tempest-CreateVolumesFromSnapshotTest-912888318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (857a8fc4-bfa2-4914-998a-0f2038e56707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:24:31 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-92a446eb-7320-4a40-bc3f-54fc0e669edc tempest-CreateVolumesFromSnapshotTest-912888318 None] Flow 'volume_create_manager' (5a475544-3970-4d98-a255-e249e406c1c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:24:31 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-92a446eb-7320-4a40-bc3f-54fc0e669edc tempest-CreateVolumesFromSnapshotTest-912888318 None] Created volume successfully. Jul 10 10:24:32 devstack sudo[105096]: pam_unix(sudo:session): session closed for user root Jul 10 10:24:32 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1a80f967-9fe2-4452-91c9-46fb10b89c8f tempest-CreateVolumesFromSnapshotTest-912888318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-92021663-30f9-40dd-9ac8-631f7e5ac755 1073741824" returned: 0 in 0.800s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:24:32 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1a80f967-9fe2-4452-91c9-46fb10b89c8f tempest-CreateVolumesFromSnapshotTest-912888318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-92021663-30f9-40dd-9ac8-631f7e5ac755 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:24:32 devstack sudo[105101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-92021663-30f9-40dd-9ac8-631f7e5ac755 Jul 10 10:24:32 devstack sudo[105101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:24:33 devstack sudo[105101]: pam_unix(sudo:session): session closed for user root Jul 10 10:24:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1a80f967-9fe2-4452-91c9-46fb10b89c8f tempest-CreateVolumesFromSnapshotTest-912888318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-92021663-30f9-40dd-9ac8-631f7e5ac755" returned: 0 in 0.623s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:24:33 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-1a80f967-9fe2-4452-91c9-46fb10b89c8f tempest-CreateVolumesFromSnapshotTest-912888318 None] <== create_volume: return (1460ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:24:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-1a80f967-9fe2-4452-91c9-46fb10b89c8f tempest-CreateVolumesFromSnapshotTest-912888318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.463s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:24:33 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1a80f967-9fe2-4452-91c9-46fb10b89c8f tempest-CreateVolumesFromSnapshotTest-912888318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf213ef7-e857-4aa1-9bee-77946dbf404c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92021663-30f9-40dd-9ac8-631f7e5ac755', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:24:33 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1a80f967-9fe2-4452-91c9-46fb10b89c8f tempest-CreateVolumesFromSnapshotTest-912888318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ef805ba-075c-4713-9172-208e0765d8b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:24:33 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-1a80f967-9fe2-4452-91c9-46fb10b89c8f tempest-CreateVolumesFromSnapshotTest-912888318 None] Volume volume-92021663-30f9-40dd-9ac8-631f7e5ac755 (92021663-30f9-40dd-9ac8-631f7e5ac755): created successfully Jul 10 10:24:33 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1a80f967-9fe2-4452-91c9-46fb10b89c8f tempest-CreateVolumesFromSnapshotTest-912888318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ef805ba-075c-4713-9172-208e0765d8b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:24:33 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1a80f967-9fe2-4452-91c9-46fb10b89c8f tempest-CreateVolumesFromSnapshotTest-912888318 None] Flow 'volume_create_manager' (9380a314-3a14-41d1-9c07-284d6fd75bb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:24:33 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-1a80f967-9fe2-4452-91c9-46fb10b89c8f tempest-CreateVolumesFromSnapshotTest-912888318 None] Created volume successfully. Jul 10 10:24:33 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-008c3acc-141c-4205-9598-bc75da25c5cc tempest-CreateVolumesFromSnapshotTest-912888318 None] Acquiring lock "cinder-92021663-30f9-40dd-9ac8-631f7e5ac755-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:24:33 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-008c3acc-141c-4205-9598-bc75da25c5cc tempest-CreateVolumesFromSnapshotTest-912888318 None] Lock "cinder-92021663-30f9-40dd-9ac8-631f7e5ac755-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:24:33 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-008c3acc-141c-4205-9598-bc75da25c5cc tempest-CreateVolumesFromSnapshotTest-912888318 None] Acquiring lock "cinder-quobyte-92021663-30f9-40dd-9ac8-631f7e5ac755" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:24:33 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-008c3acc-141c-4205-9598-bc75da25c5cc tempest-CreateVolumesFromSnapshotTest-912888318 None] Lock "cinder-quobyte-92021663-30f9-40dd-9ac8-631f7e5ac755" acquired by "delete_volume" :: waited 0.017s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:24:33 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f15c08-f927-4117-8827-5b35d7dd0a79]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:24:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-008c3acc-141c-4205-9598-bc75da25c5cc tempest-CreateVolumesFromSnapshotTest-912888318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-92021663-30f9-40dd-9ac8-631f7e5ac755 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:24:33 devstack sudo[105104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-92021663-30f9-40dd-9ac8-631f7e5ac755 Jul 10 10:24:33 devstack sudo[105104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:24:34 devstack sudo[105104]: pam_unix(sudo:session): session closed for user root Jul 10 10:24:34 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-008c3acc-141c-4205-9598-bc75da25c5cc tempest-CreateVolumesFromSnapshotTest-912888318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-92021663-30f9-40dd-9ac8-631f7e5ac755" returned: 0 in 0.736s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:24:34 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-008c3acc-141c-4205-9598-bc75da25c5cc tempest-CreateVolumesFromSnapshotTest-912888318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-92021663-30f9-40dd-9ac8-631f7e5ac755 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:24:34 devstack sudo[105109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-92021663-30f9-40dd-9ac8-631f7e5ac755 Jul 10 10:24:34 devstack sudo[105109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:24:34 devstack sudo[105109]: pam_unix(sudo:session): session closed for user root Jul 10 10:24:34 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-008c3acc-141c-4205-9598-bc75da25c5cc tempest-CreateVolumesFromSnapshotTest-912888318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-92021663-30f9-40dd-9ac8-631f7e5ac755" returned: 0 in 0.657s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:24:34 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-008c3acc-141c-4205-9598-bc75da25c5cc tempest-CreateVolumesFromSnapshotTest-912888318 None] Lock "cinder-quobyte-92021663-30f9-40dd-9ac8-631f7e5ac755" released by "delete_volume" :: held 1.431s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:24:34 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-008c3acc-141c-4205-9598-bc75da25c5cc tempest-CreateVolumesFromSnapshotTest-912888318 None] Created reservations ['50812527-8664-4cb5-ba5b-2eaaffa29311', 'e350b457-c0d9-47ac-9ec5-c4165ca48951', '0c897c36-fc4b-4b97-8e7b-aef39ca7a346', '871cc091-a303-44fe-b6cd-02a4afba10e1'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:24:34 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-008c3acc-141c-4205-9598-bc75da25c5cc tempest-CreateVolumesFromSnapshotTest-912888318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:24:34 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-008c3acc-141c-4205-9598-bc75da25c5cc tempest-CreateVolumesFromSnapshotTest-912888318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:24:34 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-008c3acc-141c-4205-9598-bc75da25c5cc tempest-CreateVolumesFromSnapshotTest-912888318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:24:34 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-008c3acc-141c-4205-9598-bc75da25c5cc tempest-CreateVolumesFromSnapshotTest-912888318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:24:34 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-008c3acc-141c-4205-9598-bc75da25c5cc tempest-CreateVolumesFromSnapshotTest-912888318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:24:34 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-008c3acc-141c-4205-9598-bc75da25c5cc tempest-CreateVolumesFromSnapshotTest-912888318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:24:34 devstack sudo[105112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:24:34 devstack sudo[105112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:24:35 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-0bf991f2-7280-44eb-a9d1-589d5ac315f0 tempest-CreateVolumesFromSnapshotTest-912888318 None] Acquiring lock "cinder-3bb6b7fd-685f-430d-bd88-4fb28f29ba73-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:24:35 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-0bf991f2-7280-44eb-a9d1-589d5ac315f0 tempest-CreateVolumesFromSnapshotTest-912888318 None] Lock "cinder-3bb6b7fd-685f-430d-bd88-4fb28f29ba73-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:24:35 devstack sudo[105112]: pam_unix(sudo:session): session closed for user root Jul 10 10:24:35 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-008c3acc-141c-4205-9598-bc75da25c5cc tempest-CreateVolumesFromSnapshotTest-912888318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.666s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:24:35 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-008c3acc-141c-4205-9598-bc75da25c5cc tempest-CreateVolumesFromSnapshotTest-912888318 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:24:35 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-0bf991f2-7280-44eb-a9d1-589d5ac315f0 tempest-CreateVolumesFromSnapshotTest-912888318 None] Acquiring lock "cinder-quobyte-3bb6b7fd-685f-430d-bd88-4fb28f29ba73" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:24:35 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-008c3acc-141c-4205-9598-bc75da25c5cc tempest-CreateVolumesFromSnapshotTest-912888318 None] Deleted volume successfully. Jul 10 10:24:35 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-0bf991f2-7280-44eb-a9d1-589d5ac315f0 tempest-CreateVolumesFromSnapshotTest-912888318 None] Lock "cinder-quobyte-3bb6b7fd-685f-430d-bd88-4fb28f29ba73" acquired by "delete_volume" :: waited 0.025s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:24:35 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-008c3acc-141c-4205-9598-bc75da25c5cc tempest-CreateVolumesFromSnapshotTest-912888318 None] Lock "cinder-92021663-30f9-40dd-9ac8-631f7e5ac755-delete_volume" released by "delete_volume" :: held 2.316s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:24:35 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff1d1ad-9416-4af6-b6df-7d009907b1c7]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:24:35 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0bf991f2-7280-44eb-a9d1-589d5ac315f0 tempest-CreateVolumesFromSnapshotTest-912888318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3bb6b7fd-685f-430d-bd88-4fb28f29ba73 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:24:35 devstack sudo[105115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3bb6b7fd-685f-430d-bd88-4fb28f29ba73 Jul 10 10:24:35 devstack sudo[105115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:24:36 devstack sudo[105115]: pam_unix(sudo:session): session closed for user root Jul 10 10:24:36 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0bf991f2-7280-44eb-a9d1-589d5ac315f0 tempest-CreateVolumesFromSnapshotTest-912888318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3bb6b7fd-685f-430d-bd88-4fb28f29ba73" returned: 0 in 0.764s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:24:36 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0bf991f2-7280-44eb-a9d1-589d5ac315f0 tempest-CreateVolumesFromSnapshotTest-912888318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3bb6b7fd-685f-430d-bd88-4fb28f29ba73 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:24:36 devstack sudo[105120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3bb6b7fd-685f-430d-bd88-4fb28f29ba73 Jul 10 10:24:36 devstack sudo[105120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:24:37 devstack sudo[105120]: pam_unix(sudo:session): session closed for user root Jul 10 10:24:37 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0bf991f2-7280-44eb-a9d1-589d5ac315f0 tempest-CreateVolumesFromSnapshotTest-912888318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3bb6b7fd-685f-430d-bd88-4fb28f29ba73" returned: 0 in 0.646s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:24:37 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-0bf991f2-7280-44eb-a9d1-589d5ac315f0 tempest-CreateVolumesFromSnapshotTest-912888318 None] Lock "cinder-quobyte-3bb6b7fd-685f-430d-bd88-4fb28f29ba73" released by "delete_volume" :: held 1.451s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:24:37 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-0bf991f2-7280-44eb-a9d1-589d5ac315f0 tempest-CreateVolumesFromSnapshotTest-912888318 None] Created reservations ['1e98c4bb-cc6e-4e5a-93ac-1d688cf87508', 'bcd784fa-b5f3-41f2-881e-f682d3c70944', '1848d30e-1231-4f9d-b0ec-22834badefe6', '3edee6dd-4812-439d-9eb3-e39669e40825'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:24:37 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-0bf991f2-7280-44eb-a9d1-589d5ac315f0 tempest-CreateVolumesFromSnapshotTest-912888318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:24:37 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-0bf991f2-7280-44eb-a9d1-589d5ac315f0 tempest-CreateVolumesFromSnapshotTest-912888318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:24:37 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-0bf991f2-7280-44eb-a9d1-589d5ac315f0 tempest-CreateVolumesFromSnapshotTest-912888318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:24:37 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-0bf991f2-7280-44eb-a9d1-589d5ac315f0 tempest-CreateVolumesFromSnapshotTest-912888318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:24:37 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-0bf991f2-7280-44eb-a9d1-589d5ac315f0 tempest-CreateVolumesFromSnapshotTest-912888318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:24:37 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0bf991f2-7280-44eb-a9d1-589d5ac315f0 tempest-CreateVolumesFromSnapshotTest-912888318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:24:37 devstack sudo[105123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:24:37 devstack sudo[105123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:24:37 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-3c153fc3-a902-4c71-ba22-67d7b48b5703 tempest-CreateVolumesFromSnapshotTest-912888318 None] Acquiring lock "cinder-64eb72fd-e216-4d3f-9a73-929a3c5a4a63-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:24:37 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-3c153fc3-a902-4c71-ba22-67d7b48b5703 tempest-CreateVolumesFromSnapshotTest-912888318 None] Lock "cinder-64eb72fd-e216-4d3f-9a73-929a3c5a4a63-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:24:37 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-3c153fc3-a902-4c71-ba22-67d7b48b5703 tempest-CreateVolumesFromSnapshotTest-912888318 None] Acquiring lock "cinder-quobyte-64eb72fd-e216-4d3f-9a73-929a3c5a4a63" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:24:37 devstack sudo[105123]: pam_unix(sudo:session): session closed for user root Jul 10 10:24:37 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0bf991f2-7280-44eb-a9d1-589d5ac315f0 tempest-CreateVolumesFromSnapshotTest-912888318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.659s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:24:37 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-0bf991f2-7280-44eb-a9d1-589d5ac315f0 tempest-CreateVolumesFromSnapshotTest-912888318 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:24:37 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-0bf991f2-7280-44eb-a9d1-589d5ac315f0 tempest-CreateVolumesFromSnapshotTest-912888318 None] Deleted volume successfully. Jul 10 10:24:37 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-3c153fc3-a902-4c71-ba22-67d7b48b5703 tempest-CreateVolumesFromSnapshotTest-912888318 None] Lock "cinder-quobyte-64eb72fd-e216-4d3f-9a73-929a3c5a4a63" acquired by "delete_volume" :: waited 0.022s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:24:37 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb626ffa-5174-48fa-9a75-3d60a7840194]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:24:37 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3c153fc3-a902-4c71-ba22-67d7b48b5703 tempest-CreateVolumesFromSnapshotTest-912888318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-64eb72fd-e216-4d3f-9a73-929a3c5a4a63 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:24:37 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-0bf991f2-7280-44eb-a9d1-589d5ac315f0 tempest-CreateVolumesFromSnapshotTest-912888318 None] Lock "cinder-3bb6b7fd-685f-430d-bd88-4fb28f29ba73-delete_volume" released by "delete_volume" :: held 2.348s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:24:37 devstack sudo[105127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-64eb72fd-e216-4d3f-9a73-929a3c5a4a63 Jul 10 10:24:37 devstack sudo[105127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:24:38 devstack sudo[105127]: pam_unix(sudo:session): session closed for user root Jul 10 10:24:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3c153fc3-a902-4c71-ba22-67d7b48b5703 tempest-CreateVolumesFromSnapshotTest-912888318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-64eb72fd-e216-4d3f-9a73-929a3c5a4a63" returned: 0 in 0.730s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:24:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3c153fc3-a902-4c71-ba22-67d7b48b5703 tempest-CreateVolumesFromSnapshotTest-912888318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-64eb72fd-e216-4d3f-9a73-929a3c5a4a63 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:24:38 devstack sudo[105132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-64eb72fd-e216-4d3f-9a73-929a3c5a4a63 Jul 10 10:24:38 devstack sudo[105132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:24:39 devstack sudo[105132]: pam_unix(sudo:session): session closed for user root Jul 10 10:24:39 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3c153fc3-a902-4c71-ba22-67d7b48b5703 tempest-CreateVolumesFromSnapshotTest-912888318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-64eb72fd-e216-4d3f-9a73-929a3c5a4a63" returned: 0 in 0.648s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:24:39 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-3c153fc3-a902-4c71-ba22-67d7b48b5703 tempest-CreateVolumesFromSnapshotTest-912888318 None] Lock "cinder-quobyte-64eb72fd-e216-4d3f-9a73-929a3c5a4a63" released by "delete_volume" :: held 1.425s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:24:39 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-3c153fc3-a902-4c71-ba22-67d7b48b5703 tempest-CreateVolumesFromSnapshotTest-912888318 None] Created reservations ['4511f57a-6c59-480c-8799-2204b7b5eec0', 'bd5860a8-cf3e-4211-8f0c-376bc0aeca49', '7b9c0662-baf9-4378-8367-01059774a3b9', 'fd068446-c362-49cc-ab05-470ac419b370'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:24:39 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-3c153fc3-a902-4c71-ba22-67d7b48b5703 tempest-CreateVolumesFromSnapshotTest-912888318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:24:39 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-3c153fc3-a902-4c71-ba22-67d7b48b5703 tempest-CreateVolumesFromSnapshotTest-912888318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:24:39 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-3c153fc3-a902-4c71-ba22-67d7b48b5703 tempest-CreateVolumesFromSnapshotTest-912888318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:24:39 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-3c153fc3-a902-4c71-ba22-67d7b48b5703 tempest-CreateVolumesFromSnapshotTest-912888318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:24:39 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-3c153fc3-a902-4c71-ba22-67d7b48b5703 tempest-CreateVolumesFromSnapshotTest-912888318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:24:39 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3c153fc3-a902-4c71-ba22-67d7b48b5703 tempest-CreateVolumesFromSnapshotTest-912888318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:24:39 devstack sudo[105135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:24:39 devstack sudo[105135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:24:39 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-922fa654-bbda-4690-820b-1993508050ec tempest-CreateVolumesFromSnapshotTest-912888318 None] Acquiring lock "cinder-b4ddd52f-b508-4efe-9899-1313e66f9be9-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:24:39 devstack sudo[105135]: pam_unix(sudo:session): session closed for user root Jul 10 10:24:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3c153fc3-a902-4c71-ba22-67d7b48b5703 tempest-CreateVolumesFromSnapshotTest-912888318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.637s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:24:40 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-3c153fc3-a902-4c71-ba22-67d7b48b5703 tempest-CreateVolumesFromSnapshotTest-912888318 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:24:40 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-922fa654-bbda-4690-820b-1993508050ec tempest-CreateVolumesFromSnapshotTest-912888318 None] Lock "cinder-b4ddd52f-b508-4efe-9899-1313e66f9be9-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:24:40 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-3c153fc3-a902-4c71-ba22-67d7b48b5703 tempest-CreateVolumesFromSnapshotTest-912888318 None] Deleted volume successfully. Jul 10 10:24:40 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-922fa654-bbda-4690-820b-1993508050ec tempest-CreateVolumesFromSnapshotTest-912888318 None] Acquiring lock "cinder-quobyte-b4ddd52f-b508-4efe-9899-1313e66f9be9" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:24:40 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-3c153fc3-a902-4c71-ba22-67d7b48b5703 tempest-CreateVolumesFromSnapshotTest-912888318 None] Lock "cinder-64eb72fd-e216-4d3f-9a73-929a3c5a4a63-delete_volume" released by "delete_volume" :: held 2.275s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:24:40 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-922fa654-bbda-4690-820b-1993508050ec tempest-CreateVolumesFromSnapshotTest-912888318 None] Lock "cinder-quobyte-b4ddd52f-b508-4efe-9899-1313e66f9be9" acquired by "delete_volume" :: waited 0.015s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:24:40 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[98814c83-9479-431a-98bb-2efe96d00a51]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:24:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-922fa654-bbda-4690-820b-1993508050ec tempest-CreateVolumesFromSnapshotTest-912888318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b4ddd52f-b508-4efe-9899-1313e66f9be9 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:24:40 devstack sudo[105138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b4ddd52f-b508-4efe-9899-1313e66f9be9 Jul 10 10:24:40 devstack sudo[105138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:24:40 devstack sudo[105138]: pam_unix(sudo:session): session closed for user root Jul 10 10:24:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-922fa654-bbda-4690-820b-1993508050ec tempest-CreateVolumesFromSnapshotTest-912888318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b4ddd52f-b508-4efe-9899-1313e66f9be9" returned: 0 in 0.754s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:24:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-922fa654-bbda-4690-820b-1993508050ec tempest-CreateVolumesFromSnapshotTest-912888318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b4ddd52f-b508-4efe-9899-1313e66f9be9 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:24:40 devstack sudo[105143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b4ddd52f-b508-4efe-9899-1313e66f9be9 Jul 10 10:24:40 devstack sudo[105143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:24:41 devstack sudo[105143]: pam_unix(sudo:session): session closed for user root Jul 10 10:24:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-922fa654-bbda-4690-820b-1993508050ec tempest-CreateVolumesFromSnapshotTest-912888318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b4ddd52f-b508-4efe-9899-1313e66f9be9" returned: 0 in 0.641s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:24:41 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-922fa654-bbda-4690-820b-1993508050ec tempest-CreateVolumesFromSnapshotTest-912888318 None] Lock "cinder-quobyte-b4ddd52f-b508-4efe-9899-1313e66f9be9" released by "delete_volume" :: held 1.433s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:24:41 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-922fa654-bbda-4690-820b-1993508050ec tempest-CreateVolumesFromSnapshotTest-912888318 None] Created reservations ['d6bb9e3e-f8f8-41e7-975e-8710aae6f09f', 'b3a8ff24-39ab-41c5-95b2-873164fc5f76', 'd46a25c6-638b-4eba-9732-4b64a0afea2c', '37cdfe64-fed4-4b88-841c-d3888eab7619'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:24:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-922fa654-bbda-4690-820b-1993508050ec tempest-CreateVolumesFromSnapshotTest-912888318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:24:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-922fa654-bbda-4690-820b-1993508050ec tempest-CreateVolumesFromSnapshotTest-912888318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:24:41 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-922fa654-bbda-4690-820b-1993508050ec tempest-CreateVolumesFromSnapshotTest-912888318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:24:41 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-922fa654-bbda-4690-820b-1993508050ec tempest-CreateVolumesFromSnapshotTest-912888318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:24:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-922fa654-bbda-4690-820b-1993508050ec tempest-CreateVolumesFromSnapshotTest-912888318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:24:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-922fa654-bbda-4690-820b-1993508050ec tempest-CreateVolumesFromSnapshotTest-912888318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:24:41 devstack sudo[105146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:24:41 devstack sudo[105146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:24:42 devstack cinder-volume[87234]: DEBUG oslo_service.periodic_task [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 10:24:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:24:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:24:42 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:24:42 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:24:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:24:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:24:42 devstack sudo[105149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:24:42 devstack sudo[105149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:24:42 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-0eb08356-0391-416e-aa56-df28ddab9a22 tempest-CreateVolumesFromSnapshotTest-912888318 None] Acquiring lock "cinder-b4c5227a-a2c4-4bd3-a7a8-0630661fa1bd-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:24:42 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-0eb08356-0391-416e-aa56-df28ddab9a22 tempest-CreateVolumesFromSnapshotTest-912888318 None] Lock "cinder-b4c5227a-a2c4-4bd3-a7a8-0630661fa1bd-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:24:42 devstack sudo[105146]: pam_unix(sudo:session): session closed for user root Jul 10 10:24:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-922fa654-bbda-4690-820b-1993508050ec tempest-CreateVolumesFromSnapshotTest-912888318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.656s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:24:42 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-922fa654-bbda-4690-820b-1993508050ec tempest-CreateVolumesFromSnapshotTest-912888318 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:24:42 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-922fa654-bbda-4690-820b-1993508050ec tempest-CreateVolumesFromSnapshotTest-912888318 None] Deleted volume successfully. Jul 10 10:24:42 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-0eb08356-0391-416e-aa56-df28ddab9a22 tempest-CreateVolumesFromSnapshotTest-912888318 None] Acquiring lock "cinder-quobyte-b4c5227a-a2c4-4bd3-a7a8-0630661fa1bd" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:24:42 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-922fa654-bbda-4690-820b-1993508050ec tempest-CreateVolumesFromSnapshotTest-912888318 None] Lock "cinder-b4ddd52f-b508-4efe-9899-1313e66f9be9-delete_volume" released by "delete_volume" :: held 2.299s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:24:42 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-0eb08356-0391-416e-aa56-df28ddab9a22 tempest-CreateVolumesFromSnapshotTest-912888318 None] Lock "cinder-quobyte-b4c5227a-a2c4-4bd3-a7a8-0630661fa1bd" acquired by "delete_volume" :: waited 0.019s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:24:42 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[e861e379-79e6-45e6-87e8-6cc692f6d82d]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:24:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0eb08356-0391-416e-aa56-df28ddab9a22 tempest-CreateVolumesFromSnapshotTest-912888318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b4c5227a-a2c4-4bd3-a7a8-0630661fa1bd {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:24:42 devstack sudo[105151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b4c5227a-a2c4-4bd3-a7a8-0630661fa1bd Jul 10 10:24:42 devstack sudo[105151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:24:42 devstack sudo[105149]: pam_unix(sudo:session): session closed for user root Jul 10 10:24:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.677s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:24:42 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:24:42 devstack cinder-volume[87234]: DEBUG oslo_service.periodic_task [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Running periodic task VolumeManager._thread_info {{(pid=87234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 10:24:42 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] thread count: 28 {{(pid=87234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 10:24:42 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] thread info: [<_MainThread(MainThread, started 131600773742720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 10:24:43 devstack sudo[105151]: pam_unix(sudo:session): session closed for user root Jul 10 10:24:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0eb08356-0391-416e-aa56-df28ddab9a22 tempest-CreateVolumesFromSnapshotTest-912888318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b4c5227a-a2c4-4bd3-a7a8-0630661fa1bd" returned: 0 in 0.786s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:24:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0eb08356-0391-416e-aa56-df28ddab9a22 tempest-CreateVolumesFromSnapshotTest-912888318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b4c5227a-a2c4-4bd3-a7a8-0630661fa1bd {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:24:43 devstack sudo[105157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b4c5227a-a2c4-4bd3-a7a8-0630661fa1bd Jul 10 10:24:43 devstack sudo[105157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:24:43 devstack sudo[105157]: pam_unix(sudo:session): session closed for user root Jul 10 10:24:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0eb08356-0391-416e-aa56-df28ddab9a22 tempest-CreateVolumesFromSnapshotTest-912888318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b4c5227a-a2c4-4bd3-a7a8-0630661fa1bd" returned: 0 in 0.634s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:24:43 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-0eb08356-0391-416e-aa56-df28ddab9a22 tempest-CreateVolumesFromSnapshotTest-912888318 None] Lock "cinder-quobyte-b4c5227a-a2c4-4bd3-a7a8-0630661fa1bd" released by "delete_volume" :: held 1.458s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:24:43 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-0eb08356-0391-416e-aa56-df28ddab9a22 tempest-CreateVolumesFromSnapshotTest-912888318 None] Created reservations ['f39b26db-88d3-42cb-98b2-3b96a8e1e120', '85a76844-4bf7-42ef-988c-2dd4382ea043', '3c6f344f-4bb3-4c9a-b593-94a72e358384', 'cb40ad76-7ec6-448d-8ac9-fd8d64987faf'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:24:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-0eb08356-0391-416e-aa56-df28ddab9a22 tempest-CreateVolumesFromSnapshotTest-912888318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:24:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-0eb08356-0391-416e-aa56-df28ddab9a22 tempest-CreateVolumesFromSnapshotTest-912888318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:24:43 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-0eb08356-0391-416e-aa56-df28ddab9a22 tempest-CreateVolumesFromSnapshotTest-912888318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:24:43 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-0eb08356-0391-416e-aa56-df28ddab9a22 tempest-CreateVolumesFromSnapshotTest-912888318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:24:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-0eb08356-0391-416e-aa56-df28ddab9a22 tempest-CreateVolumesFromSnapshotTest-912888318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:24:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0eb08356-0391-416e-aa56-df28ddab9a22 tempest-CreateVolumesFromSnapshotTest-912888318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:24:43 devstack sudo[105160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:24:43 devstack sudo[105160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:24:44 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-beb518e1-ea3a-468e-bdd1-ceba17612bf2 tempest-CreateVolumesFromSnapshotTest-912888318 None] Acquiring lock "cinder-9f8f49d7-f74b-4bf6-b33f-6648d69a1684-delete_snapshot" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:24:44 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-beb518e1-ea3a-468e-bdd1-ceba17612bf2 tempest-CreateVolumesFromSnapshotTest-912888318 None] Lock "cinder-9f8f49d7-f74b-4bf6-b33f-6648d69a1684-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:24:44 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-beb518e1-ea3a-468e-bdd1-ceba17612bf2 tempest-CreateVolumesFromSnapshotTest-912888318 None] Acquiring lock "cinder-quobyte-b9abbee2-c5d5-4f3f-9898-63464e064d50" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:24:44 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-beb518e1-ea3a-468e-bdd1-ceba17612bf2 tempest-CreateVolumesFromSnapshotTest-912888318 None] Lock "cinder-quobyte-b9abbee2-c5d5-4f3f-9898-63464e064d50" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:24:44 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-beb518e1-ea3a-468e-bdd1-ceba17612bf2 tempest-CreateVolumesFromSnapshotTest-912888318 None] Acquiring lock "cinder-quobyte-9f8f49d7-f74b-4bf6-b33f-6648d69a1684" by "_delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:24:44 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-beb518e1-ea3a-468e-bdd1-ceba17612bf2 tempest-CreateVolumesFromSnapshotTest-912888318 None] Lock "cinder-quobyte-9f8f49d7-f74b-4bf6-b33f-6648d69a1684" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:24:44 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-beb518e1-ea3a-468e-bdd1-ceba17612bf2 tempest-CreateVolumesFromSnapshotTest-912888318 None] Deleting offline snapshot 9f8f49d7-f74b-4bf6-b33f-6648d69a1684 of volume b9abbee2-c5d5-4f3f-9898-63464e064d50 {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 10:24:44 devstack sudo[105160]: pam_unix(sudo:session): session closed for user root Jul 10 10:24:44 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-beb518e1-ea3a-468e-bdd1-ceba17612bf2 tempest-CreateVolumesFromSnapshotTest-912888318 None] snapshot_file for this snap is: volume-b9abbee2-c5d5-4f3f-9898-63464e064d50.9f8f49d7-f74b-4bf6-b33f-6648d69a1684 {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 10:24:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0eb08356-0391-416e-aa56-df28ddab9a22 tempest-CreateVolumesFromSnapshotTest-912888318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.652s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:24:44 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-0eb08356-0391-416e-aa56-df28ddab9a22 tempest-CreateVolumesFromSnapshotTest-912888318 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:24:44 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-0eb08356-0391-416e-aa56-df28ddab9a22 tempest-CreateVolumesFromSnapshotTest-912888318 None] Deleted volume successfully. Jul 10 10:24:44 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[950620b5-394b-4fef-8aff-0edd6894bb81]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:24:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-beb518e1-ea3a-468e-bdd1-ceba17612bf2 tempest-CreateVolumesFromSnapshotTest-912888318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b9abbee2-c5d5-4f3f-9898-63464e064d50.9f8f49d7-f74b-4bf6-b33f-6648d69a1684 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:24:44 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-0eb08356-0391-416e-aa56-df28ddab9a22 tempest-CreateVolumesFromSnapshotTest-912888318 None] Lock "cinder-b4c5227a-a2c4-4bd3-a7a8-0630661fa1bd-delete_volume" released by "delete_volume" :: held 2.337s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:24:44 devstack sudo[105163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b9abbee2-c5d5-4f3f-9898-63464e064d50.9f8f49d7-f74b-4bf6-b33f-6648d69a1684 Jul 10 10:24:44 devstack sudo[105163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:24:45 devstack sudo[105163]: pam_unix(sudo:session): session closed for user root Jul 10 10:24:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-beb518e1-ea3a-468e-bdd1-ceba17612bf2 tempest-CreateVolumesFromSnapshotTest-912888318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b9abbee2-c5d5-4f3f-9898-63464e064d50.9f8f49d7-f74b-4bf6-b33f-6648d69a1684" returned: 0 in 0.748s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:24:45 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-beb518e1-ea3a-468e-bdd1-ceba17612bf2 tempest-CreateVolumesFromSnapshotTest-912888318 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9abbee2-c5d5-4f3f-9898-63464e064d50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 10:24:45 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d162d00-7042-433e-aece-73409556ecc9]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:24:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-beb518e1-ea3a-468e-bdd1-ceba17612bf2 tempest-CreateVolumesFromSnapshotTest-912888318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b9abbee2-c5d5-4f3f-9898-63464e064d50 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:24:45 devstack sudo[105168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b9abbee2-c5d5-4f3f-9898-63464e064d50 Jul 10 10:24:45 devstack sudo[105168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:24:46 devstack sudo[105168]: pam_unix(sudo:session): session closed for user root Jul 10 10:24:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-beb518e1-ea3a-468e-bdd1-ceba17612bf2 tempest-CreateVolumesFromSnapshotTest-912888318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b9abbee2-c5d5-4f3f-9898-63464e064d50" returned: 0 in 0.737s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:24:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-beb518e1-ea3a-468e-bdd1-ceba17612bf2 tempest-CreateVolumesFromSnapshotTest-912888318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b9abbee2-c5d5-4f3f-9898-63464e064d50.9f8f49d7-f74b-4bf6-b33f-6648d69a1684 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:24:46 devstack sudo[105173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b9abbee2-c5d5-4f3f-9898-63464e064d50.9f8f49d7-f74b-4bf6-b33f-6648d69a1684 Jul 10 10:24:46 devstack sudo[105173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:24:46 devstack sudo[105173]: pam_unix(sudo:session): session closed for user root Jul 10 10:24:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-beb518e1-ea3a-468e-bdd1-ceba17612bf2 tempest-CreateVolumesFromSnapshotTest-912888318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b9abbee2-c5d5-4f3f-9898-63464e064d50.9f8f49d7-f74b-4bf6-b33f-6648d69a1684" returned: 0 in 0.696s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:24:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-beb518e1-ea3a-468e-bdd1-ceba17612bf2 tempest-CreateVolumesFromSnapshotTest-912888318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b9abbee2-c5d5-4f3f-9898-63464e064d50.9f8f49d7-f74b-4bf6-b33f-6648d69a1684 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:24:46 devstack sudo[105178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b9abbee2-c5d5-4f3f-9898-63464e064d50.9f8f49d7-f74b-4bf6-b33f-6648d69a1684 Jul 10 10:24:46 devstack sudo[105178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:24:47 devstack sudo[105178]: pam_unix(sudo:session): session closed for user root Jul 10 10:24:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-beb518e1-ea3a-468e-bdd1-ceba17612bf2 tempest-CreateVolumesFromSnapshotTest-912888318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b9abbee2-c5d5-4f3f-9898-63464e064d50.9f8f49d7-f74b-4bf6-b33f-6648d69a1684" returned: 0 in 0.646s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:24:47 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-beb518e1-ea3a-468e-bdd1-ceba17612bf2 tempest-CreateVolumesFromSnapshotTest-912888318 None] Lock "cinder-quobyte-9f8f49d7-f74b-4bf6-b33f-6648d69a1684" released by "_delete_snapshot" :: held 2.932s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:24:47 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-beb518e1-ea3a-468e-bdd1-ceba17612bf2 tempest-CreateVolumesFromSnapshotTest-912888318 None] Lock "cinder-quobyte-b9abbee2-c5d5-4f3f-9898-63464e064d50" released by "delete_snapshot" :: held 2.955s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:24:47 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-beb518e1-ea3a-468e-bdd1-ceba17612bf2 tempest-CreateVolumesFromSnapshotTest-912888318 None] Created reservations ['b5ff38db-263b-48bf-8e9c-d89b89995ead', '6e6c176b-8ed3-4d70-a1e5-a9f5a5a48cbe', '2b1cfec9-77a3-4b1a-9add-1164147cd520', '35093f88-c530-450b-b844-45f2c6d304f6'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:24:47 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-beb518e1-ea3a-468e-bdd1-ceba17612bf2 tempest-CreateVolumesFromSnapshotTest-912888318 None] Delete snapshot completed successfully. Jul 10 10:24:47 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-beb518e1-ea3a-468e-bdd1-ceba17612bf2 tempest-CreateVolumesFromSnapshotTest-912888318 None] Lock "cinder-9f8f49d7-f74b-4bf6-b33f-6648d69a1684-delete_snapshot" released by "delete_snapshot" :: held 3.174s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:24:48 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-c8e12f73-b362-4a6b-be42-a511bc5db0c1 tempest-CreateVolumesFromSnapshotTest-912888318 None] Acquiring lock "cinder-b9abbee2-c5d5-4f3f-9898-63464e064d50-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:24:48 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-c8e12f73-b362-4a6b-be42-a511bc5db0c1 tempest-CreateVolumesFromSnapshotTest-912888318 None] Lock "cinder-b9abbee2-c5d5-4f3f-9898-63464e064d50-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:24:48 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-c8e12f73-b362-4a6b-be42-a511bc5db0c1 tempest-CreateVolumesFromSnapshotTest-912888318 None] Acquiring lock "cinder-quobyte-b9abbee2-c5d5-4f3f-9898-63464e064d50" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:24:48 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-c8e12f73-b362-4a6b-be42-a511bc5db0c1 tempest-CreateVolumesFromSnapshotTest-912888318 None] Lock "cinder-quobyte-b9abbee2-c5d5-4f3f-9898-63464e064d50" acquired by "delete_volume" :: waited 0.015s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:24:48 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa60ea7-eace-4b1f-9112-76ad82a7364a]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:24:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c8e12f73-b362-4a6b-be42-a511bc5db0c1 tempest-CreateVolumesFromSnapshotTest-912888318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b9abbee2-c5d5-4f3f-9898-63464e064d50 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:24:48 devstack sudo[105182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b9abbee2-c5d5-4f3f-9898-63464e064d50 Jul 10 10:24:48 devstack sudo[105182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:24:49 devstack sudo[105182]: pam_unix(sudo:session): session closed for user root Jul 10 10:24:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c8e12f73-b362-4a6b-be42-a511bc5db0c1 tempest-CreateVolumesFromSnapshotTest-912888318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b9abbee2-c5d5-4f3f-9898-63464e064d50" returned: 0 in 0.743s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:24:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c8e12f73-b362-4a6b-be42-a511bc5db0c1 tempest-CreateVolumesFromSnapshotTest-912888318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b9abbee2-c5d5-4f3f-9898-63464e064d50 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:24:49 devstack sudo[105187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b9abbee2-c5d5-4f3f-9898-63464e064d50 Jul 10 10:24:49 devstack sudo[105187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:24:50 devstack sudo[105187]: pam_unix(sudo:session): session closed for user root Jul 10 10:24:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c8e12f73-b362-4a6b-be42-a511bc5db0c1 tempest-CreateVolumesFromSnapshotTest-912888318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b9abbee2-c5d5-4f3f-9898-63464e064d50" returned: 0 in 0.652s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:24:50 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-c8e12f73-b362-4a6b-be42-a511bc5db0c1 tempest-CreateVolumesFromSnapshotTest-912888318 None] Lock "cinder-quobyte-b9abbee2-c5d5-4f3f-9898-63464e064d50" released by "delete_volume" :: held 1.454s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:24:50 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-c8e12f73-b362-4a6b-be42-a511bc5db0c1 tempest-CreateVolumesFromSnapshotTest-912888318 None] Created reservations ['1234a8c2-5d42-4232-8b19-8200463561a0', '9f47467f-54d8-4102-b869-e8c9adc7e8f6', '6622da1e-f445-4e96-b1bb-8251b000d5ab', 'bd3273b0-7097-4f71-88f8-a484d18b875f'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:24:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-c8e12f73-b362-4a6b-be42-a511bc5db0c1 tempest-CreateVolumesFromSnapshotTest-912888318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:24:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-c8e12f73-b362-4a6b-be42-a511bc5db0c1 tempest-CreateVolumesFromSnapshotTest-912888318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:24:50 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-c8e12f73-b362-4a6b-be42-a511bc5db0c1 tempest-CreateVolumesFromSnapshotTest-912888318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:24:50 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-c8e12f73-b362-4a6b-be42-a511bc5db0c1 tempest-CreateVolumesFromSnapshotTest-912888318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:24:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-c8e12f73-b362-4a6b-be42-a511bc5db0c1 tempest-CreateVolumesFromSnapshotTest-912888318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:24:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c8e12f73-b362-4a6b-be42-a511bc5db0c1 tempest-CreateVolumesFromSnapshotTest-912888318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:24:50 devstack sudo[105190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:24:50 devstack sudo[105190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:24:50 devstack sudo[105190]: pam_unix(sudo:session): session closed for user root Jul 10 10:24:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c8e12f73-b362-4a6b-be42-a511bc5db0c1 tempest-CreateVolumesFromSnapshotTest-912888318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.628s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:24:50 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-c8e12f73-b362-4a6b-be42-a511bc5db0c1 tempest-CreateVolumesFromSnapshotTest-912888318 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:24:50 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-c8e12f73-b362-4a6b-be42-a511bc5db0c1 tempest-CreateVolumesFromSnapshotTest-912888318 None] Deleted volume successfully. Jul 10 10:24:50 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-c8e12f73-b362-4a6b-be42-a511bc5db0c1 tempest-CreateVolumesFromSnapshotTest-912888318 None] Lock "cinder-b9abbee2-c5d5-4f3f-9898-63464e064d50-delete_volume" released by "delete_volume" :: held 2.277s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:24:53 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4e6960f-94a7-471b-b76a-2e03be177d36 tempest-VolumeDependencyTests-837474312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:24:53 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a4e6960f-94a7-471b-b76a-2e03be177d36 tempest-VolumeDependencyTests-837474312 None] Flow 'volume_create_manager' (fa657c8f-6d24-4bc0-9a3d-0e3401c3ee89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:24:53 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a4e6960f-94a7-471b-b76a-2e03be177d36 tempest-VolumeDependencyTests-837474312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82a76657-5540-4936-975d-986699de958c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:24:53 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a4e6960f-94a7-471b-b76a-2e03be177d36 tempest-VolumeDependencyTests-837474312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82a76657-5540-4936-975d-986699de958c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:24:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1040721406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=489f40c1-1f5c-446b-9805-63b9e5029abf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf0377a0890e4b53b9795abf2053d226',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:24:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:24:53Z,use_quota=True,user_id='a5a7da361650486289dcc19661e08f1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:24:53 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a4e6960f-94a7-471b-b76a-2e03be177d36 tempest-VolumeDependencyTests-837474312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80dadfac-0142-4297-8535-83381886b520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:24:53 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a4e6960f-94a7-471b-b76a-2e03be177d36 tempest-VolumeDependencyTests-837474312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80dadfac-0142-4297-8535-83381886b520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:24:53 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a4e6960f-94a7-471b-b76a-2e03be177d36 tempest-VolumeDependencyTests-837474312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43125d96-d950-4389-a9b1-c7829febbff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:24:53 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a4e6960f-94a7-471b-b76a-2e03be177d36 tempest-VolumeDependencyTests-837474312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43125d96-d950-4389-a9b1-c7829febbff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '489f40c1-1f5c-446b-9805-63b9e5029abf', 'volume_name': 'volume-489f40c1-1f5c-446b-9805-63b9e5029abf', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:24:53 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a4e6960f-94a7-471b-b76a-2e03be177d36 tempest-VolumeDependencyTests-837474312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0b5115e-e98a-40ea-8a79-d43dfd64ecca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:24:53 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a4e6960f-94a7-471b-b76a-2e03be177d36 tempest-VolumeDependencyTests-837474312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0b5115e-e98a-40ea-8a79-d43dfd64ecca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:24:53 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a4e6960f-94a7-471b-b76a-2e03be177d36 tempest-VolumeDependencyTests-837474312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ebd5065-4cc9-48e4-9cdd-aa891d7f2d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:24:53 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-a4e6960f-94a7-471b-b76a-2e03be177d36 tempest-VolumeDependencyTests-837474312 None] Volume 489f40c1-1f5c-446b-9805-63b9e5029abf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-489f40c1-1f5c-446b-9805-63b9e5029abf', 'volume_size': 1} Jul 10 10:24:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-a4e6960f-94a7-471b-b76a-2e03be177d36 tempest-VolumeDependencyTests-837474312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:24:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-a4e6960f-94a7-471b-b76a-2e03be177d36 tempest-VolumeDependencyTests-837474312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:24:53 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-a4e6960f-94a7-471b-b76a-2e03be177d36 tempest-VolumeDependencyTests-837474312 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:24:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1040721406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=489f40c1-1f5c-446b-9805-63b9e5029abf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf0377a0890e4b53b9795abf2053d226',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:24:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:24:53Z,use_quota=True,user_id='a5a7da361650486289dcc19661e08f1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:24:53 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-a4e6960f-94a7-471b-b76a-2e03be177d36 tempest-VolumeDependencyTests-837474312 None] Creating volume 489f40c1-1f5c-446b-9805-63b9e5029abf {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:24:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-a4e6960f-94a7-471b-b76a-2e03be177d36 tempest-VolumeDependencyTests-837474312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:24:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-a4e6960f-94a7-471b-b76a-2e03be177d36 tempest-VolumeDependencyTests-837474312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:24:53 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-a4e6960f-94a7-471b-b76a-2e03be177d36 tempest-VolumeDependencyTests-837474312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:24:53 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-a4e6960f-94a7-471b-b76a-2e03be177d36 tempest-VolumeDependencyTests-837474312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:24:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-a4e6960f-94a7-471b-b76a-2e03be177d36 tempest-VolumeDependencyTests-837474312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:24:53 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-a4e6960f-94a7-471b-b76a-2e03be177d36 tempest-VolumeDependencyTests-837474312 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:24:53 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-a4e6960f-94a7-471b-b76a-2e03be177d36 tempest-VolumeDependencyTests-837474312 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:24:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a4e6960f-94a7-471b-b76a-2e03be177d36 tempest-VolumeDependencyTests-837474312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-489f40c1-1f5c-446b-9805-63b9e5029abf 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:24:53 devstack sudo[105193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-489f40c1-1f5c-446b-9805-63b9e5029abf 1073741824 Jul 10 10:24:53 devstack sudo[105193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:24:54 devstack sudo[105193]: pam_unix(sudo:session): session closed for user root Jul 10 10:24:54 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a4e6960f-94a7-471b-b76a-2e03be177d36 tempest-VolumeDependencyTests-837474312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-489f40c1-1f5c-446b-9805-63b9e5029abf 1073741824" returned: 0 in 0.820s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:24:54 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a4e6960f-94a7-471b-b76a-2e03be177d36 tempest-VolumeDependencyTests-837474312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-489f40c1-1f5c-446b-9805-63b9e5029abf {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:24:54 devstack sudo[105198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-489f40c1-1f5c-446b-9805-63b9e5029abf Jul 10 10:24:54 devstack sudo[105198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:24:55 devstack sudo[105198]: pam_unix(sudo:session): session closed for user root Jul 10 10:24:55 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a4e6960f-94a7-471b-b76a-2e03be177d36 tempest-VolumeDependencyTests-837474312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-489f40c1-1f5c-446b-9805-63b9e5029abf" returned: 0 in 0.645s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:24:55 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-a4e6960f-94a7-471b-b76a-2e03be177d36 tempest-VolumeDependencyTests-837474312 None] <== create_volume: return (1534ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:24:55 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-a4e6960f-94a7-471b-b76a-2e03be177d36 tempest-VolumeDependencyTests-837474312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.536s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:24:55 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a4e6960f-94a7-471b-b76a-2e03be177d36 tempest-VolumeDependencyTests-837474312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ebd5065-4cc9-48e4-9cdd-aa891d7f2d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-489f40c1-1f5c-446b-9805-63b9e5029abf', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:24:55 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a4e6960f-94a7-471b-b76a-2e03be177d36 tempest-VolumeDependencyTests-837474312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61013479-c78e-45a7-90c8-e11d6317230e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:24:55 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-a4e6960f-94a7-471b-b76a-2e03be177d36 tempest-VolumeDependencyTests-837474312 None] Volume volume-489f40c1-1f5c-446b-9805-63b9e5029abf (489f40c1-1f5c-446b-9805-63b9e5029abf): created successfully Jul 10 10:24:55 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a4e6960f-94a7-471b-b76a-2e03be177d36 tempest-VolumeDependencyTests-837474312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61013479-c78e-45a7-90c8-e11d6317230e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:24:55 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-a4e6960f-94a7-471b-b76a-2e03be177d36 tempest-VolumeDependencyTests-837474312 None] Flow 'volume_create_manager' (fa657c8f-6d24-4bc0-9a3d-0e3401c3ee89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:24:55 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-a4e6960f-94a7-471b-b76a-2e03be177d36 tempest-VolumeDependencyTests-837474312 None] Created volume successfully. Jul 10 10:24:55 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-3617ee3f-4b8d-4026-97c8-d6df1ee93161 tempest-VolumeDependencyTests-837474312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:24:55 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-3617ee3f-4b8d-4026-97c8-d6df1ee93161 tempest-VolumeDependencyTests-837474312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:24:55 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-3617ee3f-4b8d-4026-97c8-d6df1ee93161 tempest-VolumeDependencyTests-837474312 None] Creating offline snapshot 82a561d3-2f7a-4a22-80c5-c9dc2205a7d9 of volume 489f40c1-1f5c-446b-9805-63b9e5029abf {{(pid=87234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 10:24:55 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ebb59e-b350-4a47-ae22-75d589e4686e]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:24:55 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3617ee3f-4b8d-4026-97c8-d6df1ee93161 tempest-VolumeDependencyTests-837474312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-489f40c1-1f5c-446b-9805-63b9e5029abf {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:24:55 devstack sudo[105201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-489f40c1-1f5c-446b-9805-63b9e5029abf Jul 10 10:24:55 devstack sudo[105201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:24:56 devstack sudo[105201]: pam_unix(sudo:session): session closed for user root Jul 10 10:24:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3617ee3f-4b8d-4026-97c8-d6df1ee93161 tempest-VolumeDependencyTests-837474312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-489f40c1-1f5c-446b-9805-63b9e5029abf" returned: 0 in 0.746s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:24:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3617ee3f-4b8d-4026-97c8-d6df1ee93161 tempest-VolumeDependencyTests-837474312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-489f40c1-1f5c-446b-9805-63b9e5029abf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-489f40c1-1f5c-446b-9805-63b9e5029abf.82a561d3-2f7a-4a22-80c5-c9dc2205a7d9 1G {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:24:56 devstack sudo[105206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-489f40c1-1f5c-446b-9805-63b9e5029abf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-489f40c1-1f5c-446b-9805-63b9e5029abf.82a561d3-2f7a-4a22-80c5-c9dc2205a7d9 1G Jul 10 10:24:56 devstack sudo[105206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:24:57 devstack sudo[105206]: pam_unix(sudo:session): session closed for user root Jul 10 10:24:57 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3617ee3f-4b8d-4026-97c8-d6df1ee93161 tempest-VolumeDependencyTests-837474312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-489f40c1-1f5c-446b-9805-63b9e5029abf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-489f40c1-1f5c-446b-9805-63b9e5029abf.82a561d3-2f7a-4a22-80c5-c9dc2205a7d9 1G" returned: 0 in 0.780s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:24:57 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3617ee3f-4b8d-4026-97c8-d6df1ee93161 tempest-VolumeDependencyTests-837474312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-489f40c1-1f5c-446b-9805-63b9e5029abf -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-489f40c1-1f5c-446b-9805-63b9e5029abf.82a561d3-2f7a-4a22-80c5-c9dc2205a7d9 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:24:57 devstack sudo[105211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-489f40c1-1f5c-446b-9805-63b9e5029abf -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-489f40c1-1f5c-446b-9805-63b9e5029abf.82a561d3-2f7a-4a22-80c5-c9dc2205a7d9 Jul 10 10:24:57 devstack sudo[105211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:24:57 devstack sudo[105211]: pam_unix(sudo:session): session closed for user root Jul 10 10:24:57 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3617ee3f-4b8d-4026-97c8-d6df1ee93161 tempest-VolumeDependencyTests-837474312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-489f40c1-1f5c-446b-9805-63b9e5029abf -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-489f40c1-1f5c-446b-9805-63b9e5029abf.82a561d3-2f7a-4a22-80c5-c9dc2205a7d9" returned: 0 in 0.672s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:24:57 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-3617ee3f-4b8d-4026-97c8-d6df1ee93161 tempest-VolumeDependencyTests-837474312 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-489f40c1-1f5c-446b-9805-63b9e5029abf.82a561d3-2f7a-4a22-80c5-c9dc2205a7d9 is being set with open permissions: ugo+rw Jul 10 10:24:57 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3617ee3f-4b8d-4026-97c8-d6df1ee93161 tempest-VolumeDependencyTests-837474312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-489f40c1-1f5c-446b-9805-63b9e5029abf.82a561d3-2f7a-4a22-80c5-c9dc2205a7d9 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:24:57 devstack sudo[105217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-489f40c1-1f5c-446b-9805-63b9e5029abf.82a561d3-2f7a-4a22-80c5-c9dc2205a7d9 Jul 10 10:24:57 devstack sudo[105217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:24:58 devstack sudo[105217]: pam_unix(sudo:session): session closed for user root Jul 10 10:24:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3617ee3f-4b8d-4026-97c8-d6df1ee93161 tempest-VolumeDependencyTests-837474312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-489f40c1-1f5c-446b-9805-63b9e5029abf.82a561d3-2f7a-4a22-80c5-c9dc2205a7d9" returned: 0 in 0.629s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:24:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3617ee3f-4b8d-4026-97c8-d6df1ee93161 tempest-VolumeDependencyTests-837474312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-489f40c1-1f5c-446b-9805-63b9e5029abf.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:24:58 devstack sudo[105220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-489f40c1-1f5c-446b-9805-63b9e5029abf.info Jul 10 10:24:58 devstack sudo[105220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:24:59 devstack sudo[105220]: pam_unix(sudo:session): session closed for user root Jul 10 10:24:59 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3617ee3f-4b8d-4026-97c8-d6df1ee93161 tempest-VolumeDependencyTests-837474312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-489f40c1-1f5c-446b-9805-63b9e5029abf.info" returned: 0 in 0.632s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:24:59 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-3617ee3f-4b8d-4026-97c8-d6df1ee93161 tempest-VolumeDependencyTests-837474312 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-489f40c1-1f5c-446b-9805-63b9e5029abf.info is being set with open permissions: ugo+rw Jul 10 10:24:59 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3617ee3f-4b8d-4026-97c8-d6df1ee93161 tempest-VolumeDependencyTests-837474312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-489f40c1-1f5c-446b-9805-63b9e5029abf.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:24:59 devstack sudo[105223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-489f40c1-1f5c-446b-9805-63b9e5029abf.info Jul 10 10:24:59 devstack sudo[105223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:24:59 devstack sudo[105223]: pam_unix(sudo:session): session closed for user root Jul 10 10:24:59 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3617ee3f-4b8d-4026-97c8-d6df1ee93161 tempest-VolumeDependencyTests-837474312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-489f40c1-1f5c-446b-9805-63b9e5029abf.info" returned: 0 in 0.642s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:24:59 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-3617ee3f-4b8d-4026-97c8-d6df1ee93161 tempest-VolumeDependencyTests-837474312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.181s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:24:59 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-3617ee3f-4b8d-4026-97c8-d6df1ee93161 tempest-VolumeDependencyTests-837474312 None] Create snapshot completed successfully Jul 10 10:25:01 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9012617-02f7-498a-8547-134074562a10 tempest-VolumeDependencyTests-837474312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:25:01 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f9012617-02f7-498a-8547-134074562a10 tempest-VolumeDependencyTests-837474312 None] Flow 'volume_create_manager' (81a2d820-b860-4175-93ae-fa5c5aaf6470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:25:01 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f9012617-02f7-498a-8547-134074562a10 tempest-VolumeDependencyTests-837474312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41c44c7e-f17b-4685-babe-2c19ddf93f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:01 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f9012617-02f7-498a-8547-134074562a10 tempest-VolumeDependencyTests-837474312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41c44c7e-f17b-4685-babe-2c19ddf93f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:25:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1523319506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=796f9c54-eb27-42df-984a-46c5f4221b88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf0377a0890e4b53b9795abf2053d226',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:25:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=82a561d3-2f7a-4a22-80c5-c9dc2205a7d9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:25:01Z,use_quota=True,user_id='a5a7da361650486289dcc19661e08f1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:01 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f9012617-02f7-498a-8547-134074562a10 tempest-VolumeDependencyTests-837474312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9139afa6-3920-4e7e-8ddc-121aeb17c7a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:01 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f9012617-02f7-498a-8547-134074562a10 tempest-VolumeDependencyTests-837474312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9139afa6-3920-4e7e-8ddc-121aeb17c7a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:01 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f9012617-02f7-498a-8547-134074562a10 tempest-VolumeDependencyTests-837474312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeebb791-77d4-4589-ba80-39cce8fa0ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:01 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f9012617-02f7-498a-8547-134074562a10 tempest-VolumeDependencyTests-837474312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeebb791-77d4-4589-ba80-39cce8fa0ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '796f9c54-eb27-42df-984a-46c5f4221b88', 'volume_name': 'volume-796f9c54-eb27-42df-984a-46c5f4221b88', 'volume_size': 1, 'snapshot_id': '82a561d3-2f7a-4a22-80c5-c9dc2205a7d9'}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:01 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f9012617-02f7-498a-8547-134074562a10 tempest-VolumeDependencyTests-837474312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47e1c423-ff55-4b19-b5ba-471773c5eb14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:01 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f9012617-02f7-498a-8547-134074562a10 tempest-VolumeDependencyTests-837474312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47e1c423-ff55-4b19-b5ba-471773c5eb14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:01 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f9012617-02f7-498a-8547-134074562a10 tempest-VolumeDependencyTests-837474312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a7ae849-5fb2-4f6a-8638-c0d386ad0477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:01 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-f9012617-02f7-498a-8547-134074562a10 tempest-VolumeDependencyTests-837474312 None] Volume 796f9c54-eb27-42df-984a-46c5f4221b88: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-796f9c54-eb27-42df-984a-46c5f4221b88', 'volume_size': 1, 'snapshot_id': '82a561d3-2f7a-4a22-80c5-c9dc2205a7d9'} Jul 10 10:25:01 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f9012617-02f7-498a-8547-134074562a10 tempest-VolumeDependencyTests-837474312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:25:01 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f9012617-02f7-498a-8547-134074562a10 tempest-VolumeDependencyTests-837474312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:25:01 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f9012617-02f7-498a-8547-134074562a10 tempest-VolumeDependencyTests-837474312 None] Acquiring lock "cinder-quobyte-82a561d3-2f7a-4a22-80c5-c9dc2205a7d9-796f9c54-eb27-42df-984a-46c5f4221b88" by "_create_volume_from_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:25:01 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f9012617-02f7-498a-8547-134074562a10 tempest-VolumeDependencyTests-837474312 None] Lock "cinder-quobyte-82a561d3-2f7a-4a22-80c5-c9dc2205a7d9-796f9c54-eb27-42df-984a-46c5f4221b88" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:25:01 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f9012617-02f7-498a-8547-134074562a10 tempest-VolumeDependencyTests-837474312 None] Creating volume 796f9c54-eb27-42df-984a-46c5f4221b88 from snapshot 82a561d3-2f7a-4a22-80c5-c9dc2205a7d9 {{(pid=87234) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 10:25:01 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f9012617-02f7-498a-8547-134074562a10 tempest-VolumeDependencyTests-837474312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:25:01 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f9012617-02f7-498a-8547-134074562a10 tempest-VolumeDependencyTests-837474312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:25:01 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f9012617-02f7-498a-8547-134074562a10 tempest-VolumeDependencyTests-837474312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:25:01 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f9012617-02f7-498a-8547-134074562a10 tempest-VolumeDependencyTests-837474312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:25:01 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f9012617-02f7-498a-8547-134074562a10 tempest-VolumeDependencyTests-837474312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:25:01 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f9012617-02f7-498a-8547-134074562a10 tempest-VolumeDependencyTests-837474312 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:25:01 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f9012617-02f7-498a-8547-134074562a10 tempest-VolumeDependencyTests-837474312 None] Acquiring lock "cinder-quobyte-796f9c54-eb27-42df-984a-46c5f4221b88" by "_copy_volume_from_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:25:01 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f9012617-02f7-498a-8547-134074562a10 tempest-VolumeDependencyTests-837474312 None] Lock "cinder-quobyte-796f9c54-eb27-42df-984a-46c5f4221b88" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:25:01 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f9012617-02f7-498a-8547-134074562a10 tempest-VolumeDependencyTests-837474312 None] snapshot: 82a561d3-2f7a-4a22-80c5-c9dc2205a7d9, volume: 796f9c54-eb27-42df-984a-46c5f4221b88, {{(pid=87234) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 10:25:01 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f9012617-02f7-498a-8547-134074562a10 tempest-VolumeDependencyTests-837474312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:25:01 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f9012617-02f7-498a-8547-134074562a10 tempest-VolumeDependencyTests-837474312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:25:01 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f9012617-02f7-498a-8547-134074562a10 tempest-VolumeDependencyTests-837474312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:25:01 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f9012617-02f7-498a-8547-134074562a10 tempest-VolumeDependencyTests-837474312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:25:01 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f9012617-02f7-498a-8547-134074562a10 tempest-VolumeDependencyTests-837474312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:25:01 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6713135-4e50-41a0-bcc0-111466196660]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:25:01 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f9012617-02f7-498a-8547-134074562a10 tempest-VolumeDependencyTests-837474312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-489f40c1-1f5c-446b-9805-63b9e5029abf.82a561d3-2f7a-4a22-80c5-c9dc2205a7d9 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:01 devstack sudo[105231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-489f40c1-1f5c-446b-9805-63b9e5029abf.82a561d3-2f7a-4a22-80c5-c9dc2205a7d9 Jul 10 10:25:01 devstack sudo[105231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:02 devstack sudo[105231]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f9012617-02f7-498a-8547-134074562a10 tempest-VolumeDependencyTests-837474312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-489f40c1-1f5c-446b-9805-63b9e5029abf.82a561d3-2f7a-4a22-80c5-c9dc2205a7d9" returned: 0 in 0.748s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:02 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-f9012617-02f7-498a-8547-134074562a10 tempest-VolumeDependencyTests-837474312 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-489f40c1-1f5c-446b-9805-63b9e5029abf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 10:25:02 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f9012617-02f7-498a-8547-134074562a10 tempest-VolumeDependencyTests-837474312 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-489f40c1-1f5c-446b-9805-63b9e5029abf {{(pid=87234) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 10:25:02 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f9012617-02f7-498a-8547-134074562a10 tempest-VolumeDependencyTests-837474312 None] Creating direct copy from snapshot {{(pid=87234) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 10:25:02 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc042e8-c95f-4fbe-90e2-9165ed050468]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:25:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f9012617-02f7-498a-8547-134074562a10 tempest-VolumeDependencyTests-837474312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-489f40c1-1f5c-446b-9805-63b9e5029abf {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:02 devstack sudo[105237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-489f40c1-1f5c-446b-9805-63b9e5029abf Jul 10 10:25:02 devstack sudo[105237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:03 devstack sudo[105237]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f9012617-02f7-498a-8547-134074562a10 tempest-VolumeDependencyTests-837474312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-489f40c1-1f5c-446b-9805-63b9e5029abf" returned: 0 in 0.763s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:03 devstack cinder-volume[87234]: DEBUG cinder.utils [None req-f9012617-02f7-498a-8547-134074562a10 tempest-VolumeDependencyTests-837474312 None] Path /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-796f9c54-eb27-42df-984a-46c5f4221b88 not found in is_blk_device check {{(pid=87234) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 10:25:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f9012617-02f7-498a-8547-134074562a10 tempest-VolumeDependencyTests-837474312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-489f40c1-1f5c-446b-9805-63b9e5029abf /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-796f9c54-eb27-42df-984a-46c5f4221b88 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:03 devstack sudo[105561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-489f40c1-1f5c-446b-9805-63b9e5029abf /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-796f9c54-eb27-42df-984a-46c5f4221b88 Jul 10 10:25:03 devstack sudo[105561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:07 devstack sudo[105561]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f9012617-02f7-498a-8547-134074562a10 tempest-VolumeDependencyTests-837474312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-489f40c1-1f5c-446b-9805-63b9e5029abf /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-796f9c54-eb27-42df-984a-46c5f4221b88" returned: 0 in 4.535s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:07 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d952cc-9c4c-4d4e-a30a-86882558381e]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:25:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f9012617-02f7-498a-8547-134074562a10 tempest-VolumeDependencyTests-837474312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-489f40c1-1f5c-446b-9805-63b9e5029abf {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:07 devstack sudo[105586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-489f40c1-1f5c-446b-9805-63b9e5029abf Jul 10 10:25:07 devstack sudo[105586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:08 devstack sudo[105586]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:08 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f9012617-02f7-498a-8547-134074562a10 tempest-VolumeDependencyTests-837474312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-489f40c1-1f5c-446b-9805-63b9e5029abf" returned: 0 in 0.945s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:08 devstack cinder-volume[87234]: DEBUG cinder.image.image_utils [None req-f9012617-02f7-498a-8547-134074562a10 tempest-VolumeDependencyTests-837474312 None] Image conversion details: src /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-489f40c1-1f5c-446b-9805-63b9e5029abf, size 1024.00 MB, duration 4.54 sec, destination /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-796f9c54-eb27-42df-984a-46c5f4221b88 {{(pid=87234) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 10:25:08 devstack cinder-volume[87234]: INFO cinder.image.image_utils [None req-f9012617-02f7-498a-8547-134074562a10 tempest-VolumeDependencyTests-837474312 None] Converted 1024.00 MB image at 225.73 MB/s Jul 10 10:25:08 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-f9012617-02f7-498a-8547-134074562a10 tempest-VolumeDependencyTests-837474312 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-796f9c54-eb27-42df-984a-46c5f4221b88 is being set with open permissions: ugo+rw Jul 10 10:25:08 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f9012617-02f7-498a-8547-134074562a10 tempest-VolumeDependencyTests-837474312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-796f9c54-eb27-42df-984a-46c5f4221b88 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:08 devstack sudo[105591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-796f9c54-eb27-42df-984a-46c5f4221b88 Jul 10 10:25:08 devstack sudo[105591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:09 devstack sudo[105591]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:09 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f9012617-02f7-498a-8547-134074562a10 tempest-VolumeDependencyTests-837474312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-796f9c54-eb27-42df-984a-46c5f4221b88" returned: 0 in 0.625s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:09 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f9012617-02f7-498a-8547-134074562a10 tempest-VolumeDependencyTests-837474312 None] Lock "cinder-quobyte-796f9c54-eb27-42df-984a-46c5f4221b88" released by "_copy_volume_from_snapshot" :: held 7.707s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:25:09 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f9012617-02f7-498a-8547-134074562a10 tempest-VolumeDependencyTests-837474312 None] Lock "cinder-quobyte-82a561d3-2f7a-4a22-80c5-c9dc2205a7d9-796f9c54-eb27-42df-984a-46c5f4221b88" released by "_create_volume_from_snapshot" :: held 7.736s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:25:09 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f9012617-02f7-498a-8547-134074562a10 tempest-VolumeDependencyTests-837474312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.753s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:25:09 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f9012617-02f7-498a-8547-134074562a10 tempest-VolumeDependencyTests-837474312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a7ae849-5fb2-4f6a-8638-c0d386ad0477) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-796f9c54-eb27-42df-984a-46c5f4221b88', 'volume_size': 1, 'snapshot_id': '82a561d3-2f7a-4a22-80c5-c9dc2205a7d9'}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:09 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f9012617-02f7-498a-8547-134074562a10 tempest-VolumeDependencyTests-837474312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2adfe7c-b733-4f59-8299-a6d5b577a6ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:09 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-f9012617-02f7-498a-8547-134074562a10 tempest-VolumeDependencyTests-837474312 None] Volume volume-796f9c54-eb27-42df-984a-46c5f4221b88 (796f9c54-eb27-42df-984a-46c5f4221b88): created successfully Jul 10 10:25:09 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f9012617-02f7-498a-8547-134074562a10 tempest-VolumeDependencyTests-837474312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2adfe7c-b733-4f59-8299-a6d5b577a6ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:09 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f9012617-02f7-498a-8547-134074562a10 tempest-VolumeDependencyTests-837474312 None] Flow 'volume_create_manager' (81a2d820-b860-4175-93ae-fa5c5aaf6470) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:25:09 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-f9012617-02f7-498a-8547-134074562a10 tempest-VolumeDependencyTests-837474312 None] Created volume successfully. Jul 10 10:25:09 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-0394103e-020b-4b14-ade9-b5eafa9355b5 tempest-VolumeDependencyTests-837474312 None] Acquiring lock "cinder-82a561d3-2f7a-4a22-80c5-c9dc2205a7d9-delete_snapshot" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:25:09 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-0394103e-020b-4b14-ade9-b5eafa9355b5 tempest-VolumeDependencyTests-837474312 None] Lock "cinder-82a561d3-2f7a-4a22-80c5-c9dc2205a7d9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:25:09 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-0394103e-020b-4b14-ade9-b5eafa9355b5 tempest-VolumeDependencyTests-837474312 None] Acquiring lock "cinder-quobyte-489f40c1-1f5c-446b-9805-63b9e5029abf" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:25:09 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-0394103e-020b-4b14-ade9-b5eafa9355b5 tempest-VolumeDependencyTests-837474312 None] Lock "cinder-quobyte-489f40c1-1f5c-446b-9805-63b9e5029abf" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:25:09 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-0394103e-020b-4b14-ade9-b5eafa9355b5 tempest-VolumeDependencyTests-837474312 None] Acquiring lock "cinder-quobyte-82a561d3-2f7a-4a22-80c5-c9dc2205a7d9" by "_delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:25:09 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-0394103e-020b-4b14-ade9-b5eafa9355b5 tempest-VolumeDependencyTests-837474312 None] Lock "cinder-quobyte-82a561d3-2f7a-4a22-80c5-c9dc2205a7d9" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:25:09 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-0394103e-020b-4b14-ade9-b5eafa9355b5 tempest-VolumeDependencyTests-837474312 None] Deleting offline snapshot 82a561d3-2f7a-4a22-80c5-c9dc2205a7d9 of volume 489f40c1-1f5c-446b-9805-63b9e5029abf {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 10:25:10 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-0394103e-020b-4b14-ade9-b5eafa9355b5 tempest-VolumeDependencyTests-837474312 None] snapshot_file for this snap is: volume-489f40c1-1f5c-446b-9805-63b9e5029abf.82a561d3-2f7a-4a22-80c5-c9dc2205a7d9 {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 10:25:10 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3cf73a8-2355-47d5-a127-435d34b96faf]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:25:10 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0394103e-020b-4b14-ade9-b5eafa9355b5 tempest-VolumeDependencyTests-837474312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-489f40c1-1f5c-446b-9805-63b9e5029abf.82a561d3-2f7a-4a22-80c5-c9dc2205a7d9 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:10 devstack sudo[105594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-489f40c1-1f5c-446b-9805-63b9e5029abf.82a561d3-2f7a-4a22-80c5-c9dc2205a7d9 Jul 10 10:25:10 devstack sudo[105594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:10 devstack sudo[105594]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:10 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0394103e-020b-4b14-ade9-b5eafa9355b5 tempest-VolumeDependencyTests-837474312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-489f40c1-1f5c-446b-9805-63b9e5029abf.82a561d3-2f7a-4a22-80c5-c9dc2205a7d9" returned: 0 in 0.760s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:10 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-0394103e-020b-4b14-ade9-b5eafa9355b5 tempest-VolumeDependencyTests-837474312 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-489f40c1-1f5c-446b-9805-63b9e5029abf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 10:25:10 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[beaafae6-fc44-48f6-abe6-2110e0b6d72e]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:25:10 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0394103e-020b-4b14-ade9-b5eafa9355b5 tempest-VolumeDependencyTests-837474312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-489f40c1-1f5c-446b-9805-63b9e5029abf {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:10 devstack sudo[105599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-489f40c1-1f5c-446b-9805-63b9e5029abf Jul 10 10:25:10 devstack sudo[105599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:11 devstack sudo[105599]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:11 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0394103e-020b-4b14-ade9-b5eafa9355b5 tempest-VolumeDependencyTests-837474312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-489f40c1-1f5c-446b-9805-63b9e5029abf" returned: 0 in 0.727s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:11 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0394103e-020b-4b14-ade9-b5eafa9355b5 tempest-VolumeDependencyTests-837474312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-489f40c1-1f5c-446b-9805-63b9e5029abf.82a561d3-2f7a-4a22-80c5-c9dc2205a7d9 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:11 devstack sudo[105604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-489f40c1-1f5c-446b-9805-63b9e5029abf.82a561d3-2f7a-4a22-80c5-c9dc2205a7d9 Jul 10 10:25:11 devstack sudo[105604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:12 devstack sudo[105604]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0394103e-020b-4b14-ade9-b5eafa9355b5 tempest-VolumeDependencyTests-837474312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-489f40c1-1f5c-446b-9805-63b9e5029abf.82a561d3-2f7a-4a22-80c5-c9dc2205a7d9" returned: 0 in 0.726s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0394103e-020b-4b14-ade9-b5eafa9355b5 tempest-VolumeDependencyTests-837474312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-489f40c1-1f5c-446b-9805-63b9e5029abf.82a561d3-2f7a-4a22-80c5-c9dc2205a7d9 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:12 devstack sudo[105610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-489f40c1-1f5c-446b-9805-63b9e5029abf.82a561d3-2f7a-4a22-80c5-c9dc2205a7d9 Jul 10 10:25:12 devstack sudo[105610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:12 devstack sudo[105610]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-0394103e-020b-4b14-ade9-b5eafa9355b5 tempest-VolumeDependencyTests-837474312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-489f40c1-1f5c-446b-9805-63b9e5029abf.82a561d3-2f7a-4a22-80c5-c9dc2205a7d9" returned: 0 in 0.627s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:12 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-0394103e-020b-4b14-ade9-b5eafa9355b5 tempest-VolumeDependencyTests-837474312 None] Lock "cinder-quobyte-82a561d3-2f7a-4a22-80c5-c9dc2205a7d9" released by "_delete_snapshot" :: held 2.938s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:25:12 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-0394103e-020b-4b14-ade9-b5eafa9355b5 tempest-VolumeDependencyTests-837474312 None] Lock "cinder-quobyte-489f40c1-1f5c-446b-9805-63b9e5029abf" released by "delete_snapshot" :: held 2.959s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:25:12 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-0394103e-020b-4b14-ade9-b5eafa9355b5 tempest-VolumeDependencyTests-837474312 None] Created reservations ['46f27728-f4f6-4b85-9b81-196c5c919616', '133daf28-71d0-46b4-a99b-87fde96865ac', '584068c7-e626-4310-80b6-7d6eeb682735', 'c94f2114-193a-4bb4-a6d6-fab54aaca826'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:25:13 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-0394103e-020b-4b14-ade9-b5eafa9355b5 tempest-VolumeDependencyTests-837474312 None] Delete snapshot completed successfully. Jul 10 10:25:13 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-0394103e-020b-4b14-ade9-b5eafa9355b5 tempest-VolumeDependencyTests-837474312 None] Lock "cinder-82a561d3-2f7a-4a22-80c5-c9dc2205a7d9-delete_snapshot" released by "delete_snapshot" :: held 3.082s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:25:13 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-70ad04ce-14c0-4a52-b960-04331e2fd043 tempest-VolumeDependencyTests-837474312 None] Acquiring lock "cinder-489f40c1-1f5c-446b-9805-63b9e5029abf-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:25:13 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-70ad04ce-14c0-4a52-b960-04331e2fd043 tempest-VolumeDependencyTests-837474312 None] Lock "cinder-489f40c1-1f5c-446b-9805-63b9e5029abf-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:25:13 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-70ad04ce-14c0-4a52-b960-04331e2fd043 tempest-VolumeDependencyTests-837474312 None] Acquiring lock "cinder-quobyte-489f40c1-1f5c-446b-9805-63b9e5029abf" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:25:13 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-70ad04ce-14c0-4a52-b960-04331e2fd043 tempest-VolumeDependencyTests-837474312 None] Lock "cinder-quobyte-489f40c1-1f5c-446b-9805-63b9e5029abf" acquired by "delete_volume" :: waited 0.015s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:25:13 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[e93b1572-e7c9-4b2a-9558-e77f06eb6f4b]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:25:13 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-70ad04ce-14c0-4a52-b960-04331e2fd043 tempest-VolumeDependencyTests-837474312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-489f40c1-1f5c-446b-9805-63b9e5029abf {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:13 devstack sudo[105613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-489f40c1-1f5c-446b-9805-63b9e5029abf Jul 10 10:25:13 devstack sudo[105613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:13 devstack sudo[105613]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:13 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-70ad04ce-14c0-4a52-b960-04331e2fd043 tempest-VolumeDependencyTests-837474312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-489f40c1-1f5c-446b-9805-63b9e5029abf" returned: 0 in 0.753s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:13 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-70ad04ce-14c0-4a52-b960-04331e2fd043 tempest-VolumeDependencyTests-837474312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-489f40c1-1f5c-446b-9805-63b9e5029abf {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:13 devstack sudo[105618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-489f40c1-1f5c-446b-9805-63b9e5029abf Jul 10 10:25:14 devstack sudo[105618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:14 devstack sudo[105618]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:14 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-70ad04ce-14c0-4a52-b960-04331e2fd043 tempest-VolumeDependencyTests-837474312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-489f40c1-1f5c-446b-9805-63b9e5029abf" returned: 0 in 0.656s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:14 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-70ad04ce-14c0-4a52-b960-04331e2fd043 tempest-VolumeDependencyTests-837474312 None] Lock "cinder-quobyte-489f40c1-1f5c-446b-9805-63b9e5029abf" released by "delete_volume" :: held 1.467s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:25:14 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-70ad04ce-14c0-4a52-b960-04331e2fd043 tempest-VolumeDependencyTests-837474312 None] Created reservations ['8e189f46-d981-41d9-8f05-ee9771747168', '8733056e-df08-422e-864f-07e6870635e5', 'ff87df2a-d053-4f85-80c7-76443b56fafa', '5baa87dc-e671-45af-9141-56a086439d55'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:25:14 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-70ad04ce-14c0-4a52-b960-04331e2fd043 tempest-VolumeDependencyTests-837474312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:25:14 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-70ad04ce-14c0-4a52-b960-04331e2fd043 tempest-VolumeDependencyTests-837474312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:25:14 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-70ad04ce-14c0-4a52-b960-04331e2fd043 tempest-VolumeDependencyTests-837474312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:25:14 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-70ad04ce-14c0-4a52-b960-04331e2fd043 tempest-VolumeDependencyTests-837474312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:25:14 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-70ad04ce-14c0-4a52-b960-04331e2fd043 tempest-VolumeDependencyTests-837474312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:25:14 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-70ad04ce-14c0-4a52-b960-04331e2fd043 tempest-VolumeDependencyTests-837474312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:14 devstack sudo[105621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:25:14 devstack sudo[105621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:15 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f2328f68-b549-4fac-b6f6-f1e5e5be3486 tempest-VolumeDependencyTests-837474312 None] Acquiring lock "cinder-796f9c54-eb27-42df-984a-46c5f4221b88-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:25:15 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f2328f68-b549-4fac-b6f6-f1e5e5be3486 tempest-VolumeDependencyTests-837474312 None] Lock "cinder-796f9c54-eb27-42df-984a-46c5f4221b88-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:25:15 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f2328f68-b549-4fac-b6f6-f1e5e5be3486 tempest-VolumeDependencyTests-837474312 None] Acquiring lock "cinder-quobyte-796f9c54-eb27-42df-984a-46c5f4221b88" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:25:15 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f2328f68-b549-4fac-b6f6-f1e5e5be3486 tempest-VolumeDependencyTests-837474312 None] Lock "cinder-quobyte-796f9c54-eb27-42df-984a-46c5f4221b88" acquired by "delete_volume" :: waited 0.018s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:25:15 devstack sudo[105621]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:15 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-70ad04ce-14c0-4a52-b960-04331e2fd043 tempest-VolumeDependencyTests-837474312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.688s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:15 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-70ad04ce-14c0-4a52-b960-04331e2fd043 tempest-VolumeDependencyTests-837474312 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:25:15 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[5beb9600-f938-453e-9751-a814857d422e]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:25:15 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f2328f68-b549-4fac-b6f6-f1e5e5be3486 tempest-VolumeDependencyTests-837474312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-796f9c54-eb27-42df-984a-46c5f4221b88 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:15 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-70ad04ce-14c0-4a52-b960-04331e2fd043 tempest-VolumeDependencyTests-837474312 None] Deleted volume successfully. Jul 10 10:25:15 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-70ad04ce-14c0-4a52-b960-04331e2fd043 tempest-VolumeDependencyTests-837474312 None] Lock "cinder-489f40c1-1f5c-446b-9805-63b9e5029abf-delete_volume" released by "delete_volume" :: held 2.344s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:25:15 devstack sudo[105624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-796f9c54-eb27-42df-984a-46c5f4221b88 Jul 10 10:25:15 devstack sudo[105624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:16 devstack sudo[105624]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f2328f68-b549-4fac-b6f6-f1e5e5be3486 tempest-VolumeDependencyTests-837474312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-796f9c54-eb27-42df-984a-46c5f4221b88" returned: 0 in 0.748s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f2328f68-b549-4fac-b6f6-f1e5e5be3486 tempest-VolumeDependencyTests-837474312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-796f9c54-eb27-42df-984a-46c5f4221b88 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:16 devstack sudo[105629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-796f9c54-eb27-42df-984a-46c5f4221b88 Jul 10 10:25:16 devstack sudo[105629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:16 devstack sudo[105629]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f2328f68-b549-4fac-b6f6-f1e5e5be3486 tempest-VolumeDependencyTests-837474312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-796f9c54-eb27-42df-984a-46c5f4221b88" returned: 0 in 0.667s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:16 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f2328f68-b549-4fac-b6f6-f1e5e5be3486 tempest-VolumeDependencyTests-837474312 None] Lock "cinder-quobyte-796f9c54-eb27-42df-984a-46c5f4221b88" released by "delete_volume" :: held 1.460s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:25:16 devstack cinder-volume[87234]: DEBUG dbcounter [-] [87234] Writing DB stats cinder:UPDATE=95,cinder:SELECT=66,cinder:INSERT=24,cinder:DELETE=11 {{(pid=87234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 10:25:16 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-f2328f68-b549-4fac-b6f6-f1e5e5be3486 tempest-VolumeDependencyTests-837474312 None] Created reservations ['a4123409-bb9a-4ea2-9261-74129e99c8c3', '9a58950c-26a3-4bb9-8a48-35e2e5a44d00', '13630bef-26f1-416b-a38d-49f3de39e797', '77997880-3f90-42d1-b2bd-789440308592'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:25:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f2328f68-b549-4fac-b6f6-f1e5e5be3486 tempest-VolumeDependencyTests-837474312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:25:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f2328f68-b549-4fac-b6f6-f1e5e5be3486 tempest-VolumeDependencyTests-837474312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:25:16 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f2328f68-b549-4fac-b6f6-f1e5e5be3486 tempest-VolumeDependencyTests-837474312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:25:16 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f2328f68-b549-4fac-b6f6-f1e5e5be3486 tempest-VolumeDependencyTests-837474312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:25:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f2328f68-b549-4fac-b6f6-f1e5e5be3486 tempest-VolumeDependencyTests-837474312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:25:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f2328f68-b549-4fac-b6f6-f1e5e5be3486 tempest-VolumeDependencyTests-837474312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:17 devstack sudo[105632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:25:17 devstack sudo[105632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:17 devstack sudo[105632]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f2328f68-b549-4fac-b6f6-f1e5e5be3486 tempest-VolumeDependencyTests-837474312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.701s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:17 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-f2328f68-b549-4fac-b6f6-f1e5e5be3486 tempest-VolumeDependencyTests-837474312 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:25:17 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-f2328f68-b549-4fac-b6f6-f1e5e5be3486 tempest-VolumeDependencyTests-837474312 None] Deleted volume successfully. Jul 10 10:25:17 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f2328f68-b549-4fac-b6f6-f1e5e5be3486 tempest-VolumeDependencyTests-837474312 None] Lock "cinder-796f9c54-eb27-42df-984a-46c5f4221b88-delete_volume" released by "delete_volume" :: held 2.369s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:25:26 devstack cinder-volume[87234]: DEBUG dbcounter [-] [87234] Writing DB stats cinder:SELECT=82,cinder:UPDATE=101,cinder:INSERT=25,cinder:DELETE=6 {{(pid=87234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 10:25:27 devstack cinder-volume[87234]: DEBUG dbcounter [-] [87234] Writing DB stats cinder:UPDATE=6,cinder:SELECT=1,cinder:DELETE=1 {{(pid=87234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 10:25:29 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-526e7d24-dc55-42e9-ab2b-06b0735c0085 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:25:29 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-526e7d24-dc55-42e9-ab2b-06b0735c0085 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Flow 'volume_create_manager' (a5f8a76a-9e84-49f7-8ae5-16a11504eb26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:25:29 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-526e7d24-dc55-42e9-ab2b-06b0735c0085 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f2fd67e-5001-4bed-b6b7-683fa83d4324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:29 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-526e7d24-dc55-42e9-ab2b-06b0735c0085 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f2fd67e-5001-4bed-b6b7-683fa83d4324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:25:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-424819928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d4d8ebf-8102-42df-903b-377756eadd41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1448037a8e8f422b96decde515288dce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:25:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:25:29Z,use_quota=True,user_id='29180988cbdd4e27bf6f3f24fd8a42ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:29 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-526e7d24-dc55-42e9-ab2b-06b0735c0085 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (879007ba-40cd-4a1b-b617-1f6e85bc67f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:29 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-526e7d24-dc55-42e9-ab2b-06b0735c0085 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (879007ba-40cd-4a1b-b617-1f6e85bc67f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:29 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-526e7d24-dc55-42e9-ab2b-06b0735c0085 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ada70828-d18c-4253-9280-245c6c740156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:29 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-526e7d24-dc55-42e9-ab2b-06b0735c0085 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ada70828-d18c-4253-9280-245c6c740156) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d4d8ebf-8102-42df-903b-377756eadd41', 'volume_name': 'volume-1d4d8ebf-8102-42df-903b-377756eadd41', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:29 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-526e7d24-dc55-42e9-ab2b-06b0735c0085 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dad9ac87-3ff2-4631-b14c-2a5f5ddc05aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:29 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-526e7d24-dc55-42e9-ab2b-06b0735c0085 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dad9ac87-3ff2-4631-b14c-2a5f5ddc05aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:29 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-526e7d24-dc55-42e9-ab2b-06b0735c0085 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c495081b-6775-4add-80b7-a228a1385208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:29 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-526e7d24-dc55-42e9-ab2b-06b0735c0085 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Volume 1d4d8ebf-8102-42df-903b-377756eadd41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d4d8ebf-8102-42df-903b-377756eadd41', 'volume_size': 1} Jul 10 10:25:29 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-526e7d24-dc55-42e9-ab2b-06b0735c0085 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:25:29 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-526e7d24-dc55-42e9-ab2b-06b0735c0085 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:25:29 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-526e7d24-dc55-42e9-ab2b-06b0735c0085 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:25:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-424819928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d4d8ebf-8102-42df-903b-377756eadd41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1448037a8e8f422b96decde515288dce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:25:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:25:29Z,use_quota=True,user_id='29180988cbdd4e27bf6f3f24fd8a42ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:25:29 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-526e7d24-dc55-42e9-ab2b-06b0735c0085 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Creating volume 1d4d8ebf-8102-42df-903b-377756eadd41 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:25:29 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-526e7d24-dc55-42e9-ab2b-06b0735c0085 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:25:29 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-526e7d24-dc55-42e9-ab2b-06b0735c0085 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:25:29 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-526e7d24-dc55-42e9-ab2b-06b0735c0085 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:25:29 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-526e7d24-dc55-42e9-ab2b-06b0735c0085 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:25:29 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-526e7d24-dc55-42e9-ab2b-06b0735c0085 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:25:29 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-526e7d24-dc55-42e9-ab2b-06b0735c0085 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:25:29 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-526e7d24-dc55-42e9-ab2b-06b0735c0085 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:25:29 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-526e7d24-dc55-42e9-ab2b-06b0735c0085 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-1d4d8ebf-8102-42df-903b-377756eadd41 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:29 devstack sudo[105800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-1d4d8ebf-8102-42df-903b-377756eadd41 1073741824 Jul 10 10:25:29 devstack sudo[105800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:29 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-10221221-2b2c-498e-812a-6cce0f901677 tempest-CreateVolumesFromImageTest-798832591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:25:29 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-10221221-2b2c-498e-812a-6cce0f901677 tempest-CreateVolumesFromImageTest-798832591 None] Flow 'volume_create_manager' (0b0af672-6aa0-49f2-b18b-9b6e8cc874be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:25:29 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-10221221-2b2c-498e-812a-6cce0f901677 tempest-CreateVolumesFromImageTest-798832591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4faaddd7-d206-4634-8caf-5a8ead37aaac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:29 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-10221221-2b2c-498e-812a-6cce0f901677 tempest-CreateVolumesFromImageTest-798832591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4faaddd7-d206-4634-8caf-5a8ead37aaac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:25:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1985846189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1faf1621-06da-4c24-ac8c-643988c03e31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='602f4521df62430f99852cd50f91eb70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:25:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:25:29Z,use_quota=True,user_id='99312feeffe74486aa37c6590f9128e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:29 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-10221221-2b2c-498e-812a-6cce0f901677 tempest-CreateVolumesFromImageTest-798832591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c0255f3-1ae3-4412-8cb5-7a8ce11fdaf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:29 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-10221221-2b2c-498e-812a-6cce0f901677 tempest-CreateVolumesFromImageTest-798832591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c0255f3-1ae3-4412-8cb5-7a8ce11fdaf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:29 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-10221221-2b2c-498e-812a-6cce0f901677 tempest-CreateVolumesFromImageTest-798832591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9b2c48c-ca68-45d5-b3db-740a0d5467dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:29 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-10221221-2b2c-498e-812a-6cce0f901677 tempest-CreateVolumesFromImageTest-798832591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9b2c48c-ca68-45d5-b3db-740a0d5467dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1faf1621-06da-4c24-ac8c-643988c03e31', 'volume_name': 'volume-1faf1621-06da-4c24-ac8c-643988c03e31', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:29 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-10221221-2b2c-498e-812a-6cce0f901677 tempest-CreateVolumesFromImageTest-798832591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8475cb2c-ec64-451c-935d-6c6e9190e585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:29 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-10221221-2b2c-498e-812a-6cce0f901677 tempest-CreateVolumesFromImageTest-798832591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8475cb2c-ec64-451c-935d-6c6e9190e585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:29 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-10221221-2b2c-498e-812a-6cce0f901677 tempest-CreateVolumesFromImageTest-798832591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (741cb66a-4ae2-45aa-a8f2-3108afbe2e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:29 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-10221221-2b2c-498e-812a-6cce0f901677 tempest-CreateVolumesFromImageTest-798832591 None] Volume 1faf1621-06da-4c24-ac8c-643988c03e31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1faf1621-06da-4c24-ac8c-643988c03e31', 'volume_size': 1} Jul 10 10:25:29 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-10221221-2b2c-498e-812a-6cce0f901677 tempest-CreateVolumesFromImageTest-798832591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:25:29 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3a32266-ba8a-4d4d-ae41-351846c65eff tempest-CreateVolumesFromImageTest-798832591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:25:29 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c3a32266-ba8a-4d4d-ae41-351846c65eff tempest-CreateVolumesFromImageTest-798832591 None] Flow 'volume_create_manager' (31722add-7d42-47e7-8c74-1ef9cc658b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:25:29 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c3a32266-ba8a-4d4d-ae41-351846c65eff tempest-CreateVolumesFromImageTest-798832591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98f1f7aa-0ed3-4036-9f84-8c7a6e0c00ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:29 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c3a32266-ba8a-4d4d-ae41-351846c65eff tempest-CreateVolumesFromImageTest-798832591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98f1f7aa-0ed3-4036-9f84-8c7a6e0c00ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:25:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1398327613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cc562ce-c640-41cf-bedd-69dd0fd6f63d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='602f4521df62430f99852cd50f91eb70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:25:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:25:30Z,use_quota=True,user_id='99312feeffe74486aa37c6590f9128e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:29 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c3a32266-ba8a-4d4d-ae41-351846c65eff tempest-CreateVolumesFromImageTest-798832591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e94a7581-4ef0-443a-a265-108c78deffc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:30 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c3a32266-ba8a-4d4d-ae41-351846c65eff tempest-CreateVolumesFromImageTest-798832591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e94a7581-4ef0-443a-a265-108c78deffc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:30 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c3a32266-ba8a-4d4d-ae41-351846c65eff tempest-CreateVolumesFromImageTest-798832591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7879b3e-fb9a-409b-bb5f-85983532fae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:30 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c3a32266-ba8a-4d4d-ae41-351846c65eff tempest-CreateVolumesFromImageTest-798832591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7879b3e-fb9a-409b-bb5f-85983532fae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cc562ce-c640-41cf-bedd-69dd0fd6f63d', 'volume_name': 'volume-3cc562ce-c640-41cf-bedd-69dd0fd6f63d', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:30 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c3a32266-ba8a-4d4d-ae41-351846c65eff tempest-CreateVolumesFromImageTest-798832591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61b7a92f-ca99-4d1a-8b10-e1e99991c1f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:30 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c3a32266-ba8a-4d4d-ae41-351846c65eff tempest-CreateVolumesFromImageTest-798832591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61b7a92f-ca99-4d1a-8b10-e1e99991c1f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:30 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c3a32266-ba8a-4d4d-ae41-351846c65eff tempest-CreateVolumesFromImageTest-798832591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f7e22b9-011a-491d-82a0-89f0bf376c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:30 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-c3a32266-ba8a-4d4d-ae41-351846c65eff tempest-CreateVolumesFromImageTest-798832591 None] Volume 3cc562ce-c640-41cf-bedd-69dd0fd6f63d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cc562ce-c640-41cf-bedd-69dd0fd6f63d', 'volume_size': 1} Jul 10 10:25:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-c3a32266-ba8a-4d4d-ae41-351846c65eff tempest-CreateVolumesFromImageTest-798832591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:25:30 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce2cedc1-ea8d-46a0-aeac-673fc0c8272d tempest-CreateVolumesFromSnapshotTest-1391512244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:25:30 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ce2cedc1-ea8d-46a0-aeac-673fc0c8272d tempest-CreateVolumesFromSnapshotTest-1391512244 None] Flow 'volume_create_manager' (3822db02-f651-480f-bd07-7af872daf640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:25:30 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ce2cedc1-ea8d-46a0-aeac-673fc0c8272d tempest-CreateVolumesFromSnapshotTest-1391512244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fdba3d7-5eb7-4a04-94d8-7763442eaa0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:30 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ce2cedc1-ea8d-46a0-aeac-673fc0c8272d tempest-CreateVolumesFromSnapshotTest-1391512244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fdba3d7-5eb7-4a04-94d8-7763442eaa0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:25:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-226910749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=715d38e9-d5e9-45cc-b836-3c447cca2e66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c822827c5ee424dbb75caf8e22eea34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:25:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:25:30Z,use_quota=True,user_id='88918e620d724190bac3e76e27b732ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:30 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ce2cedc1-ea8d-46a0-aeac-673fc0c8272d tempest-CreateVolumesFromSnapshotTest-1391512244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d48c7356-adf7-4f2f-a61e-dfc25a388b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:30 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ce2cedc1-ea8d-46a0-aeac-673fc0c8272d tempest-CreateVolumesFromSnapshotTest-1391512244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d48c7356-adf7-4f2f-a61e-dfc25a388b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:30 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ce2cedc1-ea8d-46a0-aeac-673fc0c8272d tempest-CreateVolumesFromSnapshotTest-1391512244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5acb576-5c48-4147-92f8-2b1862de33a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:30 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ce2cedc1-ea8d-46a0-aeac-673fc0c8272d tempest-CreateVolumesFromSnapshotTest-1391512244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5acb576-5c48-4147-92f8-2b1862de33a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '715d38e9-d5e9-45cc-b836-3c447cca2e66', 'volume_name': 'volume-715d38e9-d5e9-45cc-b836-3c447cca2e66', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:30 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ce2cedc1-ea8d-46a0-aeac-673fc0c8272d tempest-CreateVolumesFromSnapshotTest-1391512244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a872b6a8-9e10-4bb0-ac20-f519fc6e0ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:30 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ce2cedc1-ea8d-46a0-aeac-673fc0c8272d tempest-CreateVolumesFromSnapshotTest-1391512244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a872b6a8-9e10-4bb0-ac20-f519fc6e0ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:30 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ce2cedc1-ea8d-46a0-aeac-673fc0c8272d tempest-CreateVolumesFromSnapshotTest-1391512244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c996744b-b234-4d9f-8d9b-cb4de85bf5d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:30 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-ce2cedc1-ea8d-46a0-aeac-673fc0c8272d tempest-CreateVolumesFromSnapshotTest-1391512244 None] Volume 715d38e9-d5e9-45cc-b836-3c447cca2e66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-715d38e9-d5e9-45cc-b836-3c447cca2e66', 'volume_size': 1} Jul 10 10:25:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-ce2cedc1-ea8d-46a0-aeac-673fc0c8272d tempest-CreateVolumesFromSnapshotTest-1391512244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:25:30 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ac7e948-2017-4e1a-b070-ff684be3db82 tempest-CreateVolumesFromImageTest-798832591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:25:30 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1ac7e948-2017-4e1a-b070-ff684be3db82 tempest-CreateVolumesFromImageTest-798832591 None] Flow 'volume_create_manager' (3161cafc-310c-4b7b-bf0d-c06639fbf674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:25:30 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1ac7e948-2017-4e1a-b070-ff684be3db82 tempest-CreateVolumesFromImageTest-798832591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e903f3c-b2ab-4353-af22-f19d0201585d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:30 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1ac7e948-2017-4e1a-b070-ff684be3db82 tempest-CreateVolumesFromImageTest-798832591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e903f3c-b2ab-4353-af22-f19d0201585d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:25:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-622784530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6b70c0f-63a6-4c51-b1b8-3c272a234697,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='602f4521df62430f99852cd50f91eb70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:25:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:25:30Z,use_quota=True,user_id='99312feeffe74486aa37c6590f9128e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:30 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1ac7e948-2017-4e1a-b070-ff684be3db82 tempest-CreateVolumesFromImageTest-798832591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89eee2d4-e330-4119-bf31-fcfe3473cf2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:30 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1ac7e948-2017-4e1a-b070-ff684be3db82 tempest-CreateVolumesFromImageTest-798832591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89eee2d4-e330-4119-bf31-fcfe3473cf2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:30 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1ac7e948-2017-4e1a-b070-ff684be3db82 tempest-CreateVolumesFromImageTest-798832591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ab933cc-6cd2-45d8-afa4-fc512b0ab610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:30 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1ac7e948-2017-4e1a-b070-ff684be3db82 tempest-CreateVolumesFromImageTest-798832591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ab933cc-6cd2-45d8-afa4-fc512b0ab610) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6b70c0f-63a6-4c51-b1b8-3c272a234697', 'volume_name': 'volume-b6b70c0f-63a6-4c51-b1b8-3c272a234697', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:30 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1ac7e948-2017-4e1a-b070-ff684be3db82 tempest-CreateVolumesFromImageTest-798832591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fa96cb8-f10a-4cae-98a8-64a8365ba423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:30 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1ac7e948-2017-4e1a-b070-ff684be3db82 tempest-CreateVolumesFromImageTest-798832591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fa96cb8-f10a-4cae-98a8-64a8365ba423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:30 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1ac7e948-2017-4e1a-b070-ff684be3db82 tempest-CreateVolumesFromImageTest-798832591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb516b0e-e23d-42c0-b313-c512d356d2c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:30 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-1ac7e948-2017-4e1a-b070-ff684be3db82 tempest-CreateVolumesFromImageTest-798832591 None] Volume b6b70c0f-63a6-4c51-b1b8-3c272a234697: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6b70c0f-63a6-4c51-b1b8-3c272a234697', 'volume_size': 1} Jul 10 10:25:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-1ac7e948-2017-4e1a-b070-ff684be3db82 tempest-CreateVolumesFromImageTest-798832591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:25:30 devstack sudo[105800]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-526e7d24-dc55-42e9-ab2b-06b0735c0085 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-1d4d8ebf-8102-42df-903b-377756eadd41 1073741824" returned: 0 in 1.292s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-526e7d24-dc55-42e9-ab2b-06b0735c0085 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-1d4d8ebf-8102-42df-903b-377756eadd41 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:30 devstack sudo[105812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-1d4d8ebf-8102-42df-903b-377756eadd41 Jul 10 10:25:30 devstack sudo[105812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:30 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba91a7a1-733b-4400-bd06-51fe9a1c0467 tempest-CreateVolumesFromImageTest-798832591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:25:30 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ba91a7a1-733b-4400-bd06-51fe9a1c0467 tempest-CreateVolumesFromImageTest-798832591 None] Flow 'volume_create_manager' (2a7311ac-1bec-4751-928c-57160d8e4565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:25:30 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ba91a7a1-733b-4400-bd06-51fe9a1c0467 tempest-CreateVolumesFromImageTest-798832591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6160e3a-f803-47e1-9c7c-22e7e8cde885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:30 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ba91a7a1-733b-4400-bd06-51fe9a1c0467 tempest-CreateVolumesFromImageTest-798832591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6160e3a-f803-47e1-9c7c-22e7e8cde885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:25:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1683525377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=847d5d30-3366-4d9c-a04b-fd69e5bce5e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='602f4521df62430f99852cd50f91eb70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:25:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:25:31Z,use_quota=True,user_id='99312feeffe74486aa37c6590f9128e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:30 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ba91a7a1-733b-4400-bd06-51fe9a1c0467 tempest-CreateVolumesFromImageTest-798832591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c6cbeaf-eb80-418f-84ff-1ccd35923b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:30 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ba91a7a1-733b-4400-bd06-51fe9a1c0467 tempest-CreateVolumesFromImageTest-798832591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c6cbeaf-eb80-418f-84ff-1ccd35923b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:30 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ba91a7a1-733b-4400-bd06-51fe9a1c0467 tempest-CreateVolumesFromImageTest-798832591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e58bf35c-2841-4bae-b635-c349762745f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:30 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ba91a7a1-733b-4400-bd06-51fe9a1c0467 tempest-CreateVolumesFromImageTest-798832591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e58bf35c-2841-4bae-b635-c349762745f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '847d5d30-3366-4d9c-a04b-fd69e5bce5e9', 'volume_name': 'volume-847d5d30-3366-4d9c-a04b-fd69e5bce5e9', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:30 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ba91a7a1-733b-4400-bd06-51fe9a1c0467 tempest-CreateVolumesFromImageTest-798832591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4e9e525-6cd2-465c-acd1-9d1b73c4e92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:30 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ba91a7a1-733b-4400-bd06-51fe9a1c0467 tempest-CreateVolumesFromImageTest-798832591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4e9e525-6cd2-465c-acd1-9d1b73c4e92c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:30 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ba91a7a1-733b-4400-bd06-51fe9a1c0467 tempest-CreateVolumesFromImageTest-798832591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47947d55-5cc4-4c53-9f86-7192f7d1859c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:30 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-ba91a7a1-733b-4400-bd06-51fe9a1c0467 tempest-CreateVolumesFromImageTest-798832591 None] Volume 847d5d30-3366-4d9c-a04b-fd69e5bce5e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-847d5d30-3366-4d9c-a04b-fd69e5bce5e9', 'volume_size': 1} Jul 10 10:25:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-ba91a7a1-733b-4400-bd06-51fe9a1c0467 tempest-CreateVolumesFromImageTest-798832591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:25:31 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0f53595-5903-4e72-ae8c-164508b98327 tempest-CreateVolumesFromImageTest-798832591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:25:31 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-d0f53595-5903-4e72-ae8c-164508b98327 tempest-CreateVolumesFromImageTest-798832591 None] Flow 'volume_create_manager' (40c94269-45b5-4349-ab88-b28713eebc56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:25:31 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-d0f53595-5903-4e72-ae8c-164508b98327 tempest-CreateVolumesFromImageTest-798832591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0ce4ad3-16be-49f4-b21f-268be12548d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:31 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-d0f53595-5903-4e72-ae8c-164508b98327 tempest-CreateVolumesFromImageTest-798832591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0ce4ad3-16be-49f4-b21f-268be12548d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:25:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-158285068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7010b487-1a05-4ec4-8cca-8ca141f2d678,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='602f4521df62430f99852cd50f91eb70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:25:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:25:31Z,use_quota=True,user_id='99312feeffe74486aa37c6590f9128e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:31 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-d0f53595-5903-4e72-ae8c-164508b98327 tempest-CreateVolumesFromImageTest-798832591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5c71d25-72cc-490a-aa6c-f1187e40ec9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:31 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-d0f53595-5903-4e72-ae8c-164508b98327 tempest-CreateVolumesFromImageTest-798832591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5c71d25-72cc-490a-aa6c-f1187e40ec9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:31 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-d0f53595-5903-4e72-ae8c-164508b98327 tempest-CreateVolumesFromImageTest-798832591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dc38ec5-6327-4a10-8ac1-e3d850c8faa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:31 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-d0f53595-5903-4e72-ae8c-164508b98327 tempest-CreateVolumesFromImageTest-798832591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dc38ec5-6327-4a10-8ac1-e3d850c8faa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7010b487-1a05-4ec4-8cca-8ca141f2d678', 'volume_name': 'volume-7010b487-1a05-4ec4-8cca-8ca141f2d678', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:31 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-d0f53595-5903-4e72-ae8c-164508b98327 tempest-CreateVolumesFromImageTest-798832591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53ad97ab-2b3d-4066-9529-eccf605663c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:31 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-d0f53595-5903-4e72-ae8c-164508b98327 tempest-CreateVolumesFromImageTest-798832591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53ad97ab-2b3d-4066-9529-eccf605663c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:31 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-d0f53595-5903-4e72-ae8c-164508b98327 tempest-CreateVolumesFromImageTest-798832591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4de01059-ae64-4431-8475-c860e384aed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:31 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-d0f53595-5903-4e72-ae8c-164508b98327 tempest-CreateVolumesFromImageTest-798832591 None] Volume 7010b487-1a05-4ec4-8cca-8ca141f2d678: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7010b487-1a05-4ec4-8cca-8ca141f2d678', 'volume_size': 1} Jul 10 10:25:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-d0f53595-5903-4e72-ae8c-164508b98327 tempest-CreateVolumesFromImageTest-798832591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:25:31 devstack sudo[105812]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-526e7d24-dc55-42e9-ab2b-06b0735c0085 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-1d4d8ebf-8102-42df-903b-377756eadd41" returned: 0 in 0.805s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:31 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-526e7d24-dc55-42e9-ab2b-06b0735c0085 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] <== create_volume: return (2149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:25:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-526e7d24-dc55-42e9-ab2b-06b0735c0085 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.152s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:25:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-10221221-2b2c-498e-812a-6cce0f901677 tempest-CreateVolumesFromImageTest-798832591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.967s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:25:31 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-10221221-2b2c-498e-812a-6cce0f901677 tempest-CreateVolumesFromImageTest-798832591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:25:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1985846189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1faf1621-06da-4c24-ac8c-643988c03e31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='602f4521df62430f99852cd50f91eb70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:25:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:25:29Z,use_quota=True,user_id='99312feeffe74486aa37c6590f9128e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:25:31 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-10221221-2b2c-498e-812a-6cce0f901677 tempest-CreateVolumesFromImageTest-798832591 None] Creating volume 1faf1621-06da-4c24-ac8c-643988c03e31 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:25:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-10221221-2b2c-498e-812a-6cce0f901677 tempest-CreateVolumesFromImageTest-798832591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:25:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-10221221-2b2c-498e-812a-6cce0f901677 tempest-CreateVolumesFromImageTest-798832591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:25:31 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-10221221-2b2c-498e-812a-6cce0f901677 tempest-CreateVolumesFromImageTest-798832591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:25:31 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-10221221-2b2c-498e-812a-6cce0f901677 tempest-CreateVolumesFromImageTest-798832591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:25:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-10221221-2b2c-498e-812a-6cce0f901677 tempest-CreateVolumesFromImageTest-798832591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:25:31 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-10221221-2b2c-498e-812a-6cce0f901677 tempest-CreateVolumesFromImageTest-798832591 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:25:31 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-10221221-2b2c-498e-812a-6cce0f901677 tempest-CreateVolumesFromImageTest-798832591 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:25:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-10221221-2b2c-498e-812a-6cce0f901677 tempest-CreateVolumesFromImageTest-798832591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-1faf1621-06da-4c24-ac8c-643988c03e31 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:31 devstack sudo[105815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-1faf1621-06da-4c24-ac8c-643988c03e31 1073741824 Jul 10 10:25:31 devstack sudo[105815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:31 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-526e7d24-dc55-42e9-ab2b-06b0735c0085 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c495081b-6775-4add-80b7-a228a1385208) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d4d8ebf-8102-42df-903b-377756eadd41', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:31 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-526e7d24-dc55-42e9-ab2b-06b0735c0085 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67b95444-6786-4cbd-9563-b33414a26d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:31 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-526e7d24-dc55-42e9-ab2b-06b0735c0085 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Volume volume-1d4d8ebf-8102-42df-903b-377756eadd41 (1d4d8ebf-8102-42df-903b-377756eadd41): created successfully Jul 10 10:25:31 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-526e7d24-dc55-42e9-ab2b-06b0735c0085 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67b95444-6786-4cbd-9563-b33414a26d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:31 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-526e7d24-dc55-42e9-ab2b-06b0735c0085 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Flow 'volume_create_manager' (a5f8a76a-9e84-49f7-8ae5-16a11504eb26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:25:31 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-526e7d24-dc55-42e9-ab2b-06b0735c0085 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Created volume successfully. Jul 10 10:25:32 devstack sudo[105815]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:32 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-10221221-2b2c-498e-812a-6cce0f901677 tempest-CreateVolumesFromImageTest-798832591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-1faf1621-06da-4c24-ac8c-643988c03e31 1073741824" returned: 0 in 0.891s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:32 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-10221221-2b2c-498e-812a-6cce0f901677 tempest-CreateVolumesFromImageTest-798832591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-1faf1621-06da-4c24-ac8c-643988c03e31 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:32 devstack sudo[105821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-1faf1621-06da-4c24-ac8c-643988c03e31 Jul 10 10:25:32 devstack sudo[105821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:33 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-9616b67f-6b91-4eb6-89ae-7584de7132e8 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:25:33 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9616b67f-6b91-4eb6-89ae-7584de7132e8 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Flow 'volume_create_manager' (01ffc758-38b7-4be9-bdf7-a30c3bffe417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:25:33 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9616b67f-6b91-4eb6-89ae-7584de7132e8 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23744463-038d-4802-a424-98a1fe368b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:33 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9616b67f-6b91-4eb6-89ae-7584de7132e8 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23744463-038d-4802-a424-98a1fe368b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:25:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-197438091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4823decc-80d5-4829-b21d-766721004b74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1448037a8e8f422b96decde515288dce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:25:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:25:33Z,use_quota=True,user_id='29180988cbdd4e27bf6f3f24fd8a42ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:33 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9616b67f-6b91-4eb6-89ae-7584de7132e8 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7402fb33-7f87-410b-bc2c-522f52835404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:33 devstack sudo[105821]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:33 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9616b67f-6b91-4eb6-89ae-7584de7132e8 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7402fb33-7f87-410b-bc2c-522f52835404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:33 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9616b67f-6b91-4eb6-89ae-7584de7132e8 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4b54343-9cab-4ccc-901d-b1941c4c98ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:33 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9616b67f-6b91-4eb6-89ae-7584de7132e8 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4b54343-9cab-4ccc-901d-b1941c4c98ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4823decc-80d5-4829-b21d-766721004b74', 'volume_name': 'volume-4823decc-80d5-4829-b21d-766721004b74', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:33 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9616b67f-6b91-4eb6-89ae-7584de7132e8 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8de3783f-3019-40f4-8fb9-70246c72b91b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:33 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9616b67f-6b91-4eb6-89ae-7584de7132e8 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8de3783f-3019-40f4-8fb9-70246c72b91b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:33 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9616b67f-6b91-4eb6-89ae-7584de7132e8 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15bb1e04-9225-4ec1-861f-2f41c3ab6b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:33 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-9616b67f-6b91-4eb6-89ae-7584de7132e8 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Volume 4823decc-80d5-4829-b21d-766721004b74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4823decc-80d5-4829-b21d-766721004b74', 'volume_size': 1} Jul 10 10:25:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-9616b67f-6b91-4eb6-89ae-7584de7132e8 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:25:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-10221221-2b2c-498e-812a-6cce0f901677 tempest-CreateVolumesFromImageTest-798832591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-1faf1621-06da-4c24-ac8c-643988c03e31" returned: 0 in 0.796s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:33 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-10221221-2b2c-498e-812a-6cce0f901677 tempest-CreateVolumesFromImageTest-798832591 None] <== create_volume: return (1732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:25:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-10221221-2b2c-498e-812a-6cce0f901677 tempest-CreateVolumesFromImageTest-798832591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.735s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:25:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-c3a32266-ba8a-4d4d-ae41-351846c65eff tempest-CreateVolumesFromImageTest-798832591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.276s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:25:33 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-c3a32266-ba8a-4d4d-ae41-351846c65eff tempest-CreateVolumesFromImageTest-798832591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:25:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1398327613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cc562ce-c640-41cf-bedd-69dd0fd6f63d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='602f4521df62430f99852cd50f91eb70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:25:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:25:30Z,use_quota=True,user_id='99312feeffe74486aa37c6590f9128e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:25:33 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-c3a32266-ba8a-4d4d-ae41-351846c65eff tempest-CreateVolumesFromImageTest-798832591 None] Creating volume 3cc562ce-c640-41cf-bedd-69dd0fd6f63d {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:25:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-c3a32266-ba8a-4d4d-ae41-351846c65eff tempest-CreateVolumesFromImageTest-798832591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:25:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-c3a32266-ba8a-4d4d-ae41-351846c65eff tempest-CreateVolumesFromImageTest-798832591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:25:33 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-c3a32266-ba8a-4d4d-ae41-351846c65eff tempest-CreateVolumesFromImageTest-798832591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:25:33 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-c3a32266-ba8a-4d4d-ae41-351846c65eff tempest-CreateVolumesFromImageTest-798832591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:25:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-c3a32266-ba8a-4d4d-ae41-351846c65eff tempest-CreateVolumesFromImageTest-798832591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:25:33 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-c3a32266-ba8a-4d4d-ae41-351846c65eff tempest-CreateVolumesFromImageTest-798832591 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:25:33 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-c3a32266-ba8a-4d4d-ae41-351846c65eff tempest-CreateVolumesFromImageTest-798832591 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:25:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c3a32266-ba8a-4d4d-ae41-351846c65eff tempest-CreateVolumesFromImageTest-798832591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3cc562ce-c640-41cf-bedd-69dd0fd6f63d 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:33 devstack sudo[105824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3cc562ce-c640-41cf-bedd-69dd0fd6f63d 1073741824 Jul 10 10:25:33 devstack sudo[105824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:33 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-10221221-2b2c-498e-812a-6cce0f901677 tempest-CreateVolumesFromImageTest-798832591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (741cb66a-4ae2-45aa-a8f2-3108afbe2e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1faf1621-06da-4c24-ac8c-643988c03e31', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:33 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-10221221-2b2c-498e-812a-6cce0f901677 tempest-CreateVolumesFromImageTest-798832591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a37f00c5-c0b5-426e-aa55-d8044e157a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:33 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-10221221-2b2c-498e-812a-6cce0f901677 tempest-CreateVolumesFromImageTest-798832591 None] Volume volume-1faf1621-06da-4c24-ac8c-643988c03e31 (1faf1621-06da-4c24-ac8c-643988c03e31): created successfully Jul 10 10:25:33 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-10221221-2b2c-498e-812a-6cce0f901677 tempest-CreateVolumesFromImageTest-798832591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a37f00c5-c0b5-426e-aa55-d8044e157a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:33 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-10221221-2b2c-498e-812a-6cce0f901677 tempest-CreateVolumesFromImageTest-798832591 None] Flow 'volume_create_manager' (0b0af672-6aa0-49f2-b18b-9b6e8cc874be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:25:33 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-10221221-2b2c-498e-812a-6cce0f901677 tempest-CreateVolumesFromImageTest-798832591 None] Created volume successfully. Jul 10 10:25:33 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-f84a488f-9f7d-43c5-ad6c-7f0527c5c18f tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:25:33 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f84a488f-9f7d-43c5-ad6c-7f0527c5c18f tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] Flow 'volume_create_manager' (bc7f6115-b3d0-494d-90a9-f872c2b9784f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:25:33 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f84a488f-9f7d-43c5-ad6c-7f0527c5c18f tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86623713-7fcf-4121-81a2-bf84a1b4f767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:33 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f84a488f-9f7d-43c5-ad6c-7f0527c5c18f tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86623713-7fcf-4121-81a2-bf84a1b4f767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:25:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1efa7389-2eea-4e00-842b-fe58f43f97a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dd61292b677493eb06770c25cf013e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:25:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:25:33Z,use_quota=True,user_id='406e949db1654aadbf446405065f85be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac0eaabe-a3de-42ba-935d-a7f2bd0fa457),volume_type_id=ac0eaabe-a3de-42ba-935d-a7f2bd0fa457)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:33 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f84a488f-9f7d-43c5-ad6c-7f0527c5c18f tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52583d1d-2a5b-4e0c-910c-0f36796c58ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:33 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f84a488f-9f7d-43c5-ad6c-7f0527c5c18f tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52583d1d-2a5b-4e0c-910c-0f36796c58ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:33 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f84a488f-9f7d-43c5-ad6c-7f0527c5c18f tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08c3af5a-052f-4443-bf6e-43eb25db4cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:33 devstack cinder-volume[87234]: DEBUG cinder.image.glance [None req-f84a488f-9f7d-43c5-ad6c-7f0527c5c18f tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] Creating Keystone auth plugin from conf {{(pid=87234) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 10:25:33 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3006cfe-3759-4dc8-9379-95245af118be tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:25:33 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-b3006cfe-3759-4dc8-9379-95245af118be tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Flow 'volume_create_manager' (4a02609c-6638-4bb1-82b1-31b28162f3d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:25:33 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-b3006cfe-3759-4dc8-9379-95245af118be tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c939f075-915d-439c-8311-38972dc8c4ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:33 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-b3006cfe-3759-4dc8-9379-95245af118be tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c939f075-915d-439c-8311-38972dc8c4ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:25:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-10200742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9ba87b4-1660-4b73-b6eb-874bc63c5d38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1448037a8e8f422b96decde515288dce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:25:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:25:34Z,use_quota=True,user_id='29180988cbdd4e27bf6f3f24fd8a42ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:33 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-b3006cfe-3759-4dc8-9379-95245af118be tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2ca9fa0-926a-4153-b76e-e70b66a26243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:33 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-b3006cfe-3759-4dc8-9379-95245af118be tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2ca9fa0-926a-4153-b76e-e70b66a26243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:33 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-b3006cfe-3759-4dc8-9379-95245af118be tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67c6c026-806a-46f2-b8f7-ff5f33e79e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:33 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-b3006cfe-3759-4dc8-9379-95245af118be tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67c6c026-806a-46f2-b8f7-ff5f33e79e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9ba87b4-1660-4b73-b6eb-874bc63c5d38', 'volume_name': 'volume-c9ba87b4-1660-4b73-b6eb-874bc63c5d38', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:33 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-b3006cfe-3759-4dc8-9379-95245af118be tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6144fb4-8a8e-48f1-abe0-598063fea529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:33 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-b3006cfe-3759-4dc8-9379-95245af118be tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6144fb4-8a8e-48f1-abe0-598063fea529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:33 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-b3006cfe-3759-4dc8-9379-95245af118be tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84e7213c-243d-464d-a34f-0d5b5405a813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:33 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-b3006cfe-3759-4dc8-9379-95245af118be tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Volume c9ba87b4-1660-4b73-b6eb-874bc63c5d38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9ba87b4-1660-4b73-b6eb-874bc63c5d38', 'volume_size': 1} Jul 10 10:25:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-b3006cfe-3759-4dc8-9379-95245af118be tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:25:33 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-4157fb56-bc4e-490d-b6ed-fb3b795420d4 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:25:33 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4157fb56-bc4e-490d-b6ed-fb3b795420d4 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Flow 'volume_create_manager' (21868470-3e65-4d9f-ad57-6af3a5461624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:25:33 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4157fb56-bc4e-490d-b6ed-fb3b795420d4 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dca05ef0-47f2-4e32-9607-ffa9399c027e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:34 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4157fb56-bc4e-490d-b6ed-fb3b795420d4 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dca05ef0-47f2-4e32-9607-ffa9399c027e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:25:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1137130056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfbd1947-bbe3-44d8-9d8f-f243ea048db8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1448037a8e8f422b96decde515288dce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:25:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:25:34Z,use_quota=True,user_id='29180988cbdd4e27bf6f3f24fd8a42ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:34 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4157fb56-bc4e-490d-b6ed-fb3b795420d4 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35cf5219-4087-4c9d-85a2-6be737e7439e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:34 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4157fb56-bc4e-490d-b6ed-fb3b795420d4 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35cf5219-4087-4c9d-85a2-6be737e7439e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:34 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4157fb56-bc4e-490d-b6ed-fb3b795420d4 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5e7ec10-d4de-433e-93b0-39a1fc54d3e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:34 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4157fb56-bc4e-490d-b6ed-fb3b795420d4 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5e7ec10-d4de-433e-93b0-39a1fc54d3e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfbd1947-bbe3-44d8-9d8f-f243ea048db8', 'volume_name': 'volume-bfbd1947-bbe3-44d8-9d8f-f243ea048db8', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:34 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4157fb56-bc4e-490d-b6ed-fb3b795420d4 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f05bd176-8e5f-4714-85fc-b408bdcaf2b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:34 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4157fb56-bc4e-490d-b6ed-fb3b795420d4 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f05bd176-8e5f-4714-85fc-b408bdcaf2b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:34 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4157fb56-bc4e-490d-b6ed-fb3b795420d4 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0042b766-863a-474b-b243-02ac4bdd5a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:34 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-4157fb56-bc4e-490d-b6ed-fb3b795420d4 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Volume bfbd1947-bbe3-44d8-9d8f-f243ea048db8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfbd1947-bbe3-44d8-9d8f-f243ea048db8', 'volume_size': 1} Jul 10 10:25:34 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-4157fb56-bc4e-490d-b6ed-fb3b795420d4 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:25:34 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f84a488f-9f7d-43c5-ad6c-7f0527c5c18f tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08c3af5a-052f-4443-bf6e-43eb25db4cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1efa7389-2eea-4e00-842b-fe58f43f97a5', 'volume_name': 'volume-1efa7389-2eea-4e00-842b-fe58f43f97a5', 'volume_size': 1, 'image_id': '6444dfb8-852a-4472-bc3d-099a8e69db28', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6444dfb8-852a-4472-bc3d-099a8e69db28', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '897d1d418e3f56fda7b59f50c16ca7ff', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3dd61292b677493eb06770c25cf013e2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '48c48d41d4ece64cbcf59c0a5c21c926bd15f497023e974a2b79c9977f1a56b0cce9404802e7c0f57cfd9636b0b66f528b18d22b64cd2b5bbd8af746aa9c8e34', 'id': '6444dfb8-852a-4472-bc3d-099a8e69db28', 'created_at': datetime.datetime(2026, 7, 10, 8, 25, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 8, 25, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6444dfb8-852a-4472-bc3d-099a8e69db28/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:34 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f84a488f-9f7d-43c5-ad6c-7f0527c5c18f tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a176db7c-fef9-409a-98f9-4503153ba20f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:34 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f84a488f-9f7d-43c5-ad6c-7f0527c5c18f tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a176db7c-fef9-409a-98f9-4503153ba20f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:34 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f84a488f-9f7d-43c5-ad6c-7f0527c5c18f tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f97fa3da-bb02-4b61-b7a0-b2a2eec9a2c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:34 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-f84a488f-9f7d-43c5-ad6c-7f0527c5c18f tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] Volume 1efa7389-2eea-4e00-842b-fe58f43f97a5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1efa7389-2eea-4e00-842b-fe58f43f97a5', 'volume_size': 1, 'image_id': '6444dfb8-852a-4472-bc3d-099a8e69db28', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6444dfb8-852a-4472-bc3d-099a8e69db28', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '897d1d418e3f56fda7b59f50c16ca7ff', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3dd61292b677493eb06770c25cf013e2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '48c48d41d4ece64cbcf59c0a5c21c926bd15f497023e974a2b79c9977f1a56b0cce9404802e7c0f57cfd9636b0b66f528b18d22b64cd2b5bbd8af746aa9c8e34', 'id': '6444dfb8-852a-4472-bc3d-099a8e69db28', 'created_at': datetime.datetime(2026, 7, 10, 8, 25, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 8, 25, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6444dfb8-852a-4472-bc3d-099a8e69db28/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 10 10:25:34 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-f84a488f-9f7d-43c5-ad6c-7f0527c5c18f tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] Trying to clone 1efa7389-2eea-4e00-842b-fe58f43f97a5 from image 6444dfb8-852a-4472-bc3d-099a8e69db28 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6444dfb8-852a-4472-bc3d-099a8e69db28', 'metadata': {}}]). {{(pid=87234) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 10:25:34 devstack cinder-volume[87234]: DEBUG cinder.image.image_utils [None req-f84a488f-9f7d-43c5-ad6c-7f0527c5c18f tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6444dfb8-852a-4472-bc3d-099a8e69db28_huvgt8dfdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87234) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 10:25:34 devstack cinder-volume[87234]: INFO cinder.image.image_utils [None req-f84a488f-9f7d-43c5-ad6c-7f0527c5c18f tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] Image download 0.00 MB at 0.00 MB/s Jul 10 10:25:34 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e2fbe64-a731-4e61-a698-79c486406193]: (4, 'raw') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:25:34 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f84a488f-9f7d-43c5-ad6c-7f0527c5c18f tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6444dfb8-852a-4472-bc3d-099a8e69db28_huvgt8dfdevstack@QuobyteHD {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:34 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f7e1bcb-ab3b-4f1f-8f2d-72ba2f9ba6e9 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:25:34 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8f7e1bcb-ab3b-4f1f-8f2d-72ba2f9ba6e9 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Flow 'volume_create_manager' (7ac670bd-21cc-4a10-9494-11b5b632af3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:25:34 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8f7e1bcb-ab3b-4f1f-8f2d-72ba2f9ba6e9 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2506a39-0edc-41e3-a9e1-cf791bedf176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:34 devstack sudo[105824]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:34 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8f7e1bcb-ab3b-4f1f-8f2d-72ba2f9ba6e9 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2506a39-0edc-41e3-a9e1-cf791bedf176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:25:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-27693341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18a80723-6272-47d1-bf7f-f6e0a4b68316,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1448037a8e8f422b96decde515288dce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:25:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:25:34Z,use_quota=True,user_id='29180988cbdd4e27bf6f3f24fd8a42ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:34 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8f7e1bcb-ab3b-4f1f-8f2d-72ba2f9ba6e9 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ef00729-1e26-4b4d-8543-e7a94de65d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:34 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8f7e1bcb-ab3b-4f1f-8f2d-72ba2f9ba6e9 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ef00729-1e26-4b4d-8543-e7a94de65d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:34 devstack sudo[105830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6444dfb8-852a-4472-bc3d-099a8e69db28_huvgt8dfdevstack@QuobyteHD Jul 10 10:25:34 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8f7e1bcb-ab3b-4f1f-8f2d-72ba2f9ba6e9 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e89b511d-75e3-4332-bba7-36748bdcc245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:34 devstack sudo[105830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:34 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8f7e1bcb-ab3b-4f1f-8f2d-72ba2f9ba6e9 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e89b511d-75e3-4332-bba7-36748bdcc245) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18a80723-6272-47d1-bf7f-f6e0a4b68316', 'volume_name': 'volume-18a80723-6272-47d1-bf7f-f6e0a4b68316', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:34 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8f7e1bcb-ab3b-4f1f-8f2d-72ba2f9ba6e9 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c6bbcb5-92e6-4b19-9093-d827f4123ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:34 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8f7e1bcb-ab3b-4f1f-8f2d-72ba2f9ba6e9 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c6bbcb5-92e6-4b19-9093-d827f4123ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:34 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8f7e1bcb-ab3b-4f1f-8f2d-72ba2f9ba6e9 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f27cb50-7fd0-4449-a710-8e3ecee437ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:34 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-8f7e1bcb-ab3b-4f1f-8f2d-72ba2f9ba6e9 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Volume 18a80723-6272-47d1-bf7f-f6e0a4b68316: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18a80723-6272-47d1-bf7f-f6e0a4b68316', 'volume_size': 1} Jul 10 10:25:34 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-8f7e1bcb-ab3b-4f1f-8f2d-72ba2f9ba6e9 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:25:34 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c3a32266-ba8a-4d4d-ae41-351846c65eff tempest-CreateVolumesFromImageTest-798832591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3cc562ce-c640-41cf-bedd-69dd0fd6f63d 1073741824" returned: 0 in 1.129s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:34 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c3a32266-ba8a-4d4d-ae41-351846c65eff tempest-CreateVolumesFromImageTest-798832591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3cc562ce-c640-41cf-bedd-69dd0fd6f63d {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:34 devstack sudo[105832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3cc562ce-c640-41cf-bedd-69dd0fd6f63d Jul 10 10:25:34 devstack sudo[105832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:34 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-647ebeb6-4ff2-4a3d-9ebd-68365447a2e3 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:25:34 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-647ebeb6-4ff2-4a3d-9ebd-68365447a2e3 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Flow 'volume_create_manager' (552bcf78-a648-41af-bc7f-d2483dbacd50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:25:34 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-647ebeb6-4ff2-4a3d-9ebd-68365447a2e3 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f8faeb8-75e7-4caf-a25e-43059c87ddc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:34 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-647ebeb6-4ff2-4a3d-9ebd-68365447a2e3 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f8faeb8-75e7-4caf-a25e-43059c87ddc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:25:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1669260140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28e30761-d990-40f5-9315-376265c42f20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1448037a8e8f422b96decde515288dce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:25:35Z,use_quota=True,user_id='29180988cbdd4e27bf6f3f24fd8a42ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:34 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-647ebeb6-4ff2-4a3d-9ebd-68365447a2e3 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc542706-1e1d-4bad-aa99-afef37a9575e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:34 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-647ebeb6-4ff2-4a3d-9ebd-68365447a2e3 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc542706-1e1d-4bad-aa99-afef37a9575e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:34 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-647ebeb6-4ff2-4a3d-9ebd-68365447a2e3 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e44c8c0a-c6bf-4057-bb2b-d59eac5829b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:34 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-647ebeb6-4ff2-4a3d-9ebd-68365447a2e3 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e44c8c0a-c6bf-4057-bb2b-d59eac5829b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28e30761-d990-40f5-9315-376265c42f20', 'volume_name': 'volume-28e30761-d990-40f5-9315-376265c42f20', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:34 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-647ebeb6-4ff2-4a3d-9ebd-68365447a2e3 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (252b9c49-bcaa-4696-9029-f1b5dc74b999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:34 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-647ebeb6-4ff2-4a3d-9ebd-68365447a2e3 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (252b9c49-bcaa-4696-9029-f1b5dc74b999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:34 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-647ebeb6-4ff2-4a3d-9ebd-68365447a2e3 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bf9524e-9cdd-42fd-a4b5-7b015bdf0218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:34 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-647ebeb6-4ff2-4a3d-9ebd-68365447a2e3 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Volume 28e30761-d990-40f5-9315-376265c42f20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28e30761-d990-40f5-9315-376265c42f20', 'volume_size': 1} Jul 10 10:25:34 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-647ebeb6-4ff2-4a3d-9ebd-68365447a2e3 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:25:35 devstack sudo[105830]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:35 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f84a488f-9f7d-43c5-ad6c-7f0527c5c18f tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6444dfb8-852a-4472-bc3d-099a8e69db28_huvgt8dfdevstack@QuobyteHD" returned: 0 in 0.880s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:35 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f84a488f-9f7d-43c5-ad6c-7f0527c5c18f tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6444dfb8-852a-4472-bc3d-099a8e69db28_huvgt8dfdevstack@QuobyteHD {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:35 devstack sudo[105832]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:35 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c3a32266-ba8a-4d4d-ae41-351846c65eff tempest-CreateVolumesFromImageTest-798832591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3cc562ce-c640-41cf-bedd-69dd0fd6f63d" returned: 0 in 0.766s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:35 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-c3a32266-ba8a-4d4d-ae41-351846c65eff tempest-CreateVolumesFromImageTest-798832591 None] <== create_volume: return (1944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:25:35 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-c3a32266-ba8a-4d4d-ae41-351846c65eff tempest-CreateVolumesFromImageTest-798832591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.947s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:25:35 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-ce2cedc1-ea8d-46a0-aeac-673fc0c8272d tempest-CreateVolumesFromSnapshotTest-1391512244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.937s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:25:35 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-ce2cedc1-ea8d-46a0-aeac-673fc0c8272d tempest-CreateVolumesFromSnapshotTest-1391512244 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:25:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-226910749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=715d38e9-d5e9-45cc-b836-3c447cca2e66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c822827c5ee424dbb75caf8e22eea34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:25:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:25:30Z,use_quota=True,user_id='88918e620d724190bac3e76e27b732ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:25:35 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-ce2cedc1-ea8d-46a0-aeac-673fc0c8272d tempest-CreateVolumesFromSnapshotTest-1391512244 None] Creating volume 715d38e9-d5e9-45cc-b836-3c447cca2e66 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:25:35 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-ce2cedc1-ea8d-46a0-aeac-673fc0c8272d tempest-CreateVolumesFromSnapshotTest-1391512244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:25:35 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-ce2cedc1-ea8d-46a0-aeac-673fc0c8272d tempest-CreateVolumesFromSnapshotTest-1391512244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:25:35 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-ce2cedc1-ea8d-46a0-aeac-673fc0c8272d tempest-CreateVolumesFromSnapshotTest-1391512244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:25:35 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-ce2cedc1-ea8d-46a0-aeac-673fc0c8272d tempest-CreateVolumesFromSnapshotTest-1391512244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:25:35 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-ce2cedc1-ea8d-46a0-aeac-673fc0c8272d tempest-CreateVolumesFromSnapshotTest-1391512244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:25:35 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-ce2cedc1-ea8d-46a0-aeac-673fc0c8272d tempest-CreateVolumesFromSnapshotTest-1391512244 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:25:35 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-ce2cedc1-ea8d-46a0-aeac-673fc0c8272d tempest-CreateVolumesFromSnapshotTest-1391512244 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:25:35 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ce2cedc1-ea8d-46a0-aeac-673fc0c8272d tempest-CreateVolumesFromSnapshotTest-1391512244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-715d38e9-d5e9-45cc-b836-3c447cca2e66 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:35 devstack sudo[105837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6444dfb8-852a-4472-bc3d-099a8e69db28_huvgt8dfdevstack@QuobyteHD Jul 10 10:25:35 devstack sudo[105837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:35 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c3a32266-ba8a-4d4d-ae41-351846c65eff tempest-CreateVolumesFromImageTest-798832591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f7e22b9-011a-491d-82a0-89f0bf376c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cc562ce-c640-41cf-bedd-69dd0fd6f63d', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:35 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c3a32266-ba8a-4d4d-ae41-351846c65eff tempest-CreateVolumesFromImageTest-798832591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aba5539-c3a0-434a-bdbb-b6669d7a05b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:35 devstack sudo[105839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-715d38e9-d5e9-45cc-b836-3c447cca2e66 1073741824 Jul 10 10:25:35 devstack sudo[105839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:35 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-c3a32266-ba8a-4d4d-ae41-351846c65eff tempest-CreateVolumesFromImageTest-798832591 None] Volume volume-3cc562ce-c640-41cf-bedd-69dd0fd6f63d (3cc562ce-c640-41cf-bedd-69dd0fd6f63d): created successfully Jul 10 10:25:35 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c3a32266-ba8a-4d4d-ae41-351846c65eff tempest-CreateVolumesFromImageTest-798832591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aba5539-c3a0-434a-bdbb-b6669d7a05b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:35 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c3a32266-ba8a-4d4d-ae41-351846c65eff tempest-CreateVolumesFromImageTest-798832591 None] Flow 'volume_create_manager' (31722add-7d42-47e7-8c74-1ef9cc658b28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:25:35 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-c3a32266-ba8a-4d4d-ae41-351846c65eff tempest-CreateVolumesFromImageTest-798832591 None] Created volume successfully. Jul 10 10:25:35 devstack sudo[105837]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:35 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f84a488f-9f7d-43c5-ad6c-7f0527c5c18f tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6444dfb8-852a-4472-bc3d-099a8e69db28_huvgt8dfdevstack@QuobyteHD" returned: 1 in 0.781s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:35 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f84a488f-9f7d-43c5-ad6c-7f0527c5c18f tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6444dfb8-852a-4472-bc3d-099a8e69db28_huvgt8dfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 10:25:35 devstack cinder-volume[87234]: DEBUG cinder.image.image_utils [None req-f84a488f-9f7d-43c5-ad6c-7f0527c5c18f tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] Temporary image 6444dfb8-852a-4472-bc3d-099a8e69db28 is fetched for user 406e949db1654aadbf446405065f85be. {{(pid=87234) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 10:25:36 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[a793a68b-3dcc-4769-9356-6dfbb74d30b8]: (4, 'raw') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:25:36 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f84a488f-9f7d-43c5-ad6c-7f0527c5c18f tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6444dfb8-852a-4472-bc3d-099a8e69db28_huvgt8dfdevstack@QuobyteHD {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:36 devstack sudo[105847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6444dfb8-852a-4472-bc3d-099a8e69db28_huvgt8dfdevstack@QuobyteHD Jul 10 10:25:36 devstack sudo[105847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:36 devstack sudo[105839]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:36 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ce2cedc1-ea8d-46a0-aeac-673fc0c8272d tempest-CreateVolumesFromSnapshotTest-1391512244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-715d38e9-d5e9-45cc-b836-3c447cca2e66 1073741824" returned: 0 in 0.887s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:36 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ce2cedc1-ea8d-46a0-aeac-673fc0c8272d tempest-CreateVolumesFromSnapshotTest-1391512244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-715d38e9-d5e9-45cc-b836-3c447cca2e66 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:36 devstack sudo[105849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-715d38e9-d5e9-45cc-b836-3c447cca2e66 Jul 10 10:25:36 devstack sudo[105849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:36 devstack sudo[105847]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:36 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f84a488f-9f7d-43c5-ad6c-7f0527c5c18f tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6444dfb8-852a-4472-bc3d-099a8e69db28_huvgt8dfdevstack@QuobyteHD" returned: 0 in 0.730s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:36 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f84a488f-9f7d-43c5-ad6c-7f0527c5c18f tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6444dfb8-852a-4472-bc3d-099a8e69db28_huvgt8dfdevstack@QuobyteHD {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:36 devstack sudo[105854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6444dfb8-852a-4472-bc3d-099a8e69db28_huvgt8dfdevstack@QuobyteHD Jul 10 10:25:36 devstack sudo[105854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:36 devstack sudo[105849]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:36 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ce2cedc1-ea8d-46a0-aeac-673fc0c8272d tempest-CreateVolumesFromSnapshotTest-1391512244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-715d38e9-d5e9-45cc-b836-3c447cca2e66" returned: 0 in 0.678s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:36 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-ce2cedc1-ea8d-46a0-aeac-673fc0c8272d tempest-CreateVolumesFromSnapshotTest-1391512244 None] <== create_volume: return (1608ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:25:36 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-ce2cedc1-ea8d-46a0-aeac-673fc0c8272d tempest-CreateVolumesFromSnapshotTest-1391512244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.611s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:25:36 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-1ac7e948-2017-4e1a-b070-ff684be3db82 tempest-CreateVolumesFromImageTest-798832591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.333s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:25:36 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-1ac7e948-2017-4e1a-b070-ff684be3db82 tempest-CreateVolumesFromImageTest-798832591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:25:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-622784530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6b70c0f-63a6-4c51-b1b8-3c272a234697,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='602f4521df62430f99852cd50f91eb70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:25:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:25:30Z,use_quota=True,user_id='99312feeffe74486aa37c6590f9128e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:25:36 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-1ac7e948-2017-4e1a-b070-ff684be3db82 tempest-CreateVolumesFromImageTest-798832591 None] Creating volume b6b70c0f-63a6-4c51-b1b8-3c272a234697 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:25:36 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-1ac7e948-2017-4e1a-b070-ff684be3db82 tempest-CreateVolumesFromImageTest-798832591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:25:36 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-1ac7e948-2017-4e1a-b070-ff684be3db82 tempest-CreateVolumesFromImageTest-798832591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:25:36 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-1ac7e948-2017-4e1a-b070-ff684be3db82 tempest-CreateVolumesFromImageTest-798832591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:25:36 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-1ac7e948-2017-4e1a-b070-ff684be3db82 tempest-CreateVolumesFromImageTest-798832591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:25:36 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-1ac7e948-2017-4e1a-b070-ff684be3db82 tempest-CreateVolumesFromImageTest-798832591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:25:36 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-1ac7e948-2017-4e1a-b070-ff684be3db82 tempest-CreateVolumesFromImageTest-798832591 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:25:36 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-1ac7e948-2017-4e1a-b070-ff684be3db82 tempest-CreateVolumesFromImageTest-798832591 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:25:36 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1ac7e948-2017-4e1a-b070-ff684be3db82 tempest-CreateVolumesFromImageTest-798832591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b6b70c0f-63a6-4c51-b1b8-3c272a234697 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:36 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ce2cedc1-ea8d-46a0-aeac-673fc0c8272d tempest-CreateVolumesFromSnapshotTest-1391512244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c996744b-b234-4d9f-8d9b-cb4de85bf5d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-715d38e9-d5e9-45cc-b836-3c447cca2e66', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:36 devstack sudo[105856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b6b70c0f-63a6-4c51-b1b8-3c272a234697 1073741824 Jul 10 10:25:36 devstack sudo[105856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:36 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ce2cedc1-ea8d-46a0-aeac-673fc0c8272d tempest-CreateVolumesFromSnapshotTest-1391512244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (771356ff-b971-40f0-ada0-f6451ce4d522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:36 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-ce2cedc1-ea8d-46a0-aeac-673fc0c8272d tempest-CreateVolumesFromSnapshotTest-1391512244 None] Volume volume-715d38e9-d5e9-45cc-b836-3c447cca2e66 (715d38e9-d5e9-45cc-b836-3c447cca2e66): created successfully Jul 10 10:25:36 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ce2cedc1-ea8d-46a0-aeac-673fc0c8272d tempest-CreateVolumesFromSnapshotTest-1391512244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (771356ff-b971-40f0-ada0-f6451ce4d522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:36 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ce2cedc1-ea8d-46a0-aeac-673fc0c8272d tempest-CreateVolumesFromSnapshotTest-1391512244 None] Flow 'volume_create_manager' (3822db02-f651-480f-bd07-7af872daf640) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:25:37 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-ce2cedc1-ea8d-46a0-aeac-673fc0c8272d tempest-CreateVolumesFromSnapshotTest-1391512244 None] Created volume successfully. Jul 10 10:25:37 devstack sudo[105854]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:37 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f84a488f-9f7d-43c5-ad6c-7f0527c5c18f tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6444dfb8-852a-4472-bc3d-099a8e69db28_huvgt8dfdevstack@QuobyteHD" returned: 1 in 0.732s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:37 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f84a488f-9f7d-43c5-ad6c-7f0527c5c18f tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6444dfb8-852a-4472-bc3d-099a8e69db28_huvgt8dfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 10:25:37 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f84a488f-9f7d-43c5-ad6c-7f0527c5c18f tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:25:37 devstack sudo[105856]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:37 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1ac7e948-2017-4e1a-b070-ff684be3db82 tempest-CreateVolumesFromImageTest-798832591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b6b70c0f-63a6-4c51-b1b8-3c272a234697 1073741824" returned: 0 in 0.896s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:37 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1ac7e948-2017-4e1a-b070-ff684be3db82 tempest-CreateVolumesFromImageTest-798832591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b6b70c0f-63a6-4c51-b1b8-3c272a234697 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:37 devstack sudo[105866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b6b70c0f-63a6-4c51-b1b8-3c272a234697 Jul 10 10:25:37 devstack sudo[105866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-ed59b2da-1519-4db6-9a98-03ea28ad7fc4 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:25:38 devstack sudo[105866]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1ac7e948-2017-4e1a-b070-ff684be3db82 tempest-CreateVolumesFromImageTest-798832591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b6b70c0f-63a6-4c51-b1b8-3c272a234697" returned: 0 in 0.672s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:38 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-1ac7e948-2017-4e1a-b070-ff684be3db82 tempest-CreateVolumesFromImageTest-798832591 None] <== create_volume: return (1610ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:25:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-1ac7e948-2017-4e1a-b070-ff684be3db82 tempest-CreateVolumesFromImageTest-798832591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.615s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:25:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-ba91a7a1-733b-4400-bd06-51fe9a1c0467 tempest-CreateVolumesFromImageTest-798832591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.534s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:25:38 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-ba91a7a1-733b-4400-bd06-51fe9a1c0467 tempest-CreateVolumesFromImageTest-798832591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:25:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1683525377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=847d5d30-3366-4d9c-a04b-fd69e5bce5e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='602f4521df62430f99852cd50f91eb70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:25:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:25:31Z,use_quota=True,user_id='99312feeffe74486aa37c6590f9128e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:25:38 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-ba91a7a1-733b-4400-bd06-51fe9a1c0467 tempest-CreateVolumesFromImageTest-798832591 None] Creating volume 847d5d30-3366-4d9c-a04b-fd69e5bce5e9 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:25:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-ba91a7a1-733b-4400-bd06-51fe9a1c0467 tempest-CreateVolumesFromImageTest-798832591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:25:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-ba91a7a1-733b-4400-bd06-51fe9a1c0467 tempest-CreateVolumesFromImageTest-798832591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:25:38 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-ba91a7a1-733b-4400-bd06-51fe9a1c0467 tempest-CreateVolumesFromImageTest-798832591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:25:38 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-ba91a7a1-733b-4400-bd06-51fe9a1c0467 tempest-CreateVolumesFromImageTest-798832591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:25:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-ba91a7a1-733b-4400-bd06-51fe9a1c0467 tempest-CreateVolumesFromImageTest-798832591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:25:38 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-ba91a7a1-733b-4400-bd06-51fe9a1c0467 tempest-CreateVolumesFromImageTest-798832591 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:25:38 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-ba91a7a1-733b-4400-bd06-51fe9a1c0467 tempest-CreateVolumesFromImageTest-798832591 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:25:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ba91a7a1-733b-4400-bd06-51fe9a1c0467 tempest-CreateVolumesFromImageTest-798832591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-847d5d30-3366-4d9c-a04b-fd69e5bce5e9 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:38 devstack sudo[105869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-847d5d30-3366-4d9c-a04b-fd69e5bce5e9 1073741824 Jul 10 10:25:38 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1ac7e948-2017-4e1a-b070-ff684be3db82 tempest-CreateVolumesFromImageTest-798832591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb516b0e-e23d-42c0-b313-c512d356d2c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6b70c0f-63a6-4c51-b1b8-3c272a234697', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:38 devstack sudo[105869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:38 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1ac7e948-2017-4e1a-b070-ff684be3db82 tempest-CreateVolumesFromImageTest-798832591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f8530fe-d86b-48b2-aff0-2325db61925b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:38 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-1ac7e948-2017-4e1a-b070-ff684be3db82 tempest-CreateVolumesFromImageTest-798832591 None] Volume volume-b6b70c0f-63a6-4c51-b1b8-3c272a234697 (b6b70c0f-63a6-4c51-b1b8-3c272a234697): created successfully Jul 10 10:25:38 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1ac7e948-2017-4e1a-b070-ff684be3db82 tempest-CreateVolumesFromImageTest-798832591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f8530fe-d86b-48b2-aff0-2325db61925b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:38 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-1ac7e948-2017-4e1a-b070-ff684be3db82 tempest-CreateVolumesFromImageTest-798832591 None] Flow 'volume_create_manager' (3161cafc-310c-4b7b-bf0d-c06639fbf674) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:25:38 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-1ac7e948-2017-4e1a-b070-ff684be3db82 tempest-CreateVolumesFromImageTest-798832591 None] Created volume successfully. Jul 10 10:25:39 devstack sudo[105869]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:39 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ba91a7a1-733b-4400-bd06-51fe9a1c0467 tempest-CreateVolumesFromImageTest-798832591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-847d5d30-3366-4d9c-a04b-fd69e5bce5e9 1073741824" returned: 0 in 0.812s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:39 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ba91a7a1-733b-4400-bd06-51fe9a1c0467 tempest-CreateVolumesFromImageTest-798832591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-847d5d30-3366-4d9c-a04b-fd69e5bce5e9 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:39 devstack sudo[105874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-847d5d30-3366-4d9c-a04b-fd69e5bce5e9 Jul 10 10:25:39 devstack sudo[105874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:40 devstack sudo[105874]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ba91a7a1-733b-4400-bd06-51fe9a1c0467 tempest-CreateVolumesFromImageTest-798832591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-847d5d30-3366-4d9c-a04b-fd69e5bce5e9" returned: 0 in 0.636s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:40 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-ba91a7a1-733b-4400-bd06-51fe9a1c0467 tempest-CreateVolumesFromImageTest-798832591 None] <== create_volume: return (1485ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:25:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-ba91a7a1-733b-4400-bd06-51fe9a1c0467 tempest-CreateVolumesFromImageTest-798832591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.488s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:25:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-d0f53595-5903-4e72-ae8c-164508b98327 tempest-CreateVolumesFromImageTest-798832591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.683s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:25:40 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-d0f53595-5903-4e72-ae8c-164508b98327 tempest-CreateVolumesFromImageTest-798832591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:25:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-158285068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7010b487-1a05-4ec4-8cca-8ca141f2d678,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='602f4521df62430f99852cd50f91eb70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:25:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:25:31Z,use_quota=True,user_id='99312feeffe74486aa37c6590f9128e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:25:40 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-d0f53595-5903-4e72-ae8c-164508b98327 tempest-CreateVolumesFromImageTest-798832591 None] Creating volume 7010b487-1a05-4ec4-8cca-8ca141f2d678 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:25:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-d0f53595-5903-4e72-ae8c-164508b98327 tempest-CreateVolumesFromImageTest-798832591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:25:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-d0f53595-5903-4e72-ae8c-164508b98327 tempest-CreateVolumesFromImageTest-798832591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:25:40 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-d0f53595-5903-4e72-ae8c-164508b98327 tempest-CreateVolumesFromImageTest-798832591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:25:40 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-d0f53595-5903-4e72-ae8c-164508b98327 tempest-CreateVolumesFromImageTest-798832591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:25:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-d0f53595-5903-4e72-ae8c-164508b98327 tempest-CreateVolumesFromImageTest-798832591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:25:40 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-d0f53595-5903-4e72-ae8c-164508b98327 tempest-CreateVolumesFromImageTest-798832591 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:25:40 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-d0f53595-5903-4e72-ae8c-164508b98327 tempest-CreateVolumesFromImageTest-798832591 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:25:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-d0f53595-5903-4e72-ae8c-164508b98327 tempest-CreateVolumesFromImageTest-798832591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7010b487-1a05-4ec4-8cca-8ca141f2d678 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:40 devstack sudo[105877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7010b487-1a05-4ec4-8cca-8ca141f2d678 1073741824 Jul 10 10:25:40 devstack sudo[105877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:40 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ba91a7a1-733b-4400-bd06-51fe9a1c0467 tempest-CreateVolumesFromImageTest-798832591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47947d55-5cc4-4c53-9f86-7192f7d1859c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-847d5d30-3366-4d9c-a04b-fd69e5bce5e9', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:40 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ba91a7a1-733b-4400-bd06-51fe9a1c0467 tempest-CreateVolumesFromImageTest-798832591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a06babee-70e7-4e50-b5b2-c05a74d9142e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:40 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-ba91a7a1-733b-4400-bd06-51fe9a1c0467 tempest-CreateVolumesFromImageTest-798832591 None] Volume volume-847d5d30-3366-4d9c-a04b-fd69e5bce5e9 (847d5d30-3366-4d9c-a04b-fd69e5bce5e9): created successfully Jul 10 10:25:40 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ba91a7a1-733b-4400-bd06-51fe9a1c0467 tempest-CreateVolumesFromImageTest-798832591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a06babee-70e7-4e50-b5b2-c05a74d9142e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:40 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-ba91a7a1-733b-4400-bd06-51fe9a1c0467 tempest-CreateVolumesFromImageTest-798832591 None] Flow 'volume_create_manager' (2a7311ac-1bec-4751-928c-57160d8e4565) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:25:40 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-ba91a7a1-733b-4400-bd06-51fe9a1c0467 tempest-CreateVolumesFromImageTest-798832591 None] Created volume successfully. Jul 10 10:25:40 devstack sudo[105877]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-d0f53595-5903-4e72-ae8c-164508b98327 tempest-CreateVolumesFromImageTest-798832591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7010b487-1a05-4ec4-8cca-8ca141f2d678 1073741824" returned: 0 in 0.795s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-d0f53595-5903-4e72-ae8c-164508b98327 tempest-CreateVolumesFromImageTest-798832591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7010b487-1a05-4ec4-8cca-8ca141f2d678 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:40 devstack sudo[105882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7010b487-1a05-4ec4-8cca-8ca141f2d678 Jul 10 10:25:40 devstack sudo[105882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:41 devstack sudo[105882]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-d0f53595-5903-4e72-ae8c-164508b98327 tempest-CreateVolumesFromImageTest-798832591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7010b487-1a05-4ec4-8cca-8ca141f2d678" returned: 0 in 0.636s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:41 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-d0f53595-5903-4e72-ae8c-164508b98327 tempest-CreateVolumesFromImageTest-798832591 None] <== create_volume: return (1470ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:25:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-d0f53595-5903-4e72-ae8c-164508b98327 tempest-CreateVolumesFromImageTest-798832591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.473s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:25:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-9616b67f-6b91-4eb6-89ae-7584de7132e8 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.163s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:25:41 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-9616b67f-6b91-4eb6-89ae-7584de7132e8 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:25:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-197438091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4823decc-80d5-4829-b21d-766721004b74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1448037a8e8f422b96decde515288dce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:25:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:25:33Z,use_quota=True,user_id='29180988cbdd4e27bf6f3f24fd8a42ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:25:41 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-9616b67f-6b91-4eb6-89ae-7584de7132e8 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Creating volume 4823decc-80d5-4829-b21d-766721004b74 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:25:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-9616b67f-6b91-4eb6-89ae-7584de7132e8 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:25:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-9616b67f-6b91-4eb6-89ae-7584de7132e8 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:25:41 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-9616b67f-6b91-4eb6-89ae-7584de7132e8 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:25:41 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-9616b67f-6b91-4eb6-89ae-7584de7132e8 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:25:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-9616b67f-6b91-4eb6-89ae-7584de7132e8 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:25:41 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-9616b67f-6b91-4eb6-89ae-7584de7132e8 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:25:41 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-9616b67f-6b91-4eb6-89ae-7584de7132e8 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:25:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9616b67f-6b91-4eb6-89ae-7584de7132e8 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-4823decc-80d5-4829-b21d-766721004b74 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:41 devstack sudo[105885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-4823decc-80d5-4829-b21d-766721004b74 1073741824 Jul 10 10:25:41 devstack sudo[105885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:41 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-d0f53595-5903-4e72-ae8c-164508b98327 tempest-CreateVolumesFromImageTest-798832591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4de01059-ae64-4431-8475-c860e384aed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7010b487-1a05-4ec4-8cca-8ca141f2d678', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:41 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-d0f53595-5903-4e72-ae8c-164508b98327 tempest-CreateVolumesFromImageTest-798832591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb6f91da-4367-4a18-b192-ca1c97884182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:41 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-d0f53595-5903-4e72-ae8c-164508b98327 tempest-CreateVolumesFromImageTest-798832591 None] Volume volume-7010b487-1a05-4ec4-8cca-8ca141f2d678 (7010b487-1a05-4ec4-8cca-8ca141f2d678): created successfully Jul 10 10:25:41 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-d0f53595-5903-4e72-ae8c-164508b98327 tempest-CreateVolumesFromImageTest-798832591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb6f91da-4367-4a18-b192-ca1c97884182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:41 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-d0f53595-5903-4e72-ae8c-164508b98327 tempest-CreateVolumesFromImageTest-798832591 None] Flow 'volume_create_manager' (40c94269-45b5-4349-ab88-b28713eebc56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:25:41 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-d0f53595-5903-4e72-ae8c-164508b98327 tempest-CreateVolumesFromImageTest-798832591 None] Created volume successfully. Jul 10 10:25:42 devstack cinder-volume[87234]: DEBUG oslo_service.periodic_task [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 10:25:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:25:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:25:42 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:25:42 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:25:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:25:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:42 devstack sudo[105890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:25:42 devstack sudo[105890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:42 devstack sudo[105885]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9616b67f-6b91-4eb6-89ae-7584de7132e8 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-4823decc-80d5-4829-b21d-766721004b74 1073741824" returned: 0 in 0.848s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9616b67f-6b91-4eb6-89ae-7584de7132e8 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-4823decc-80d5-4829-b21d-766721004b74 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:42 devstack sudo[105893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-4823decc-80d5-4829-b21d-766721004b74 Jul 10 10:25:42 devstack sudo[105893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:42 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-48f45808-0252-42c8-a5b6-e2c06a854de1 tempest-CreateVolumesFromImageTest-798832591 None] Acquiring lock "cinder-7010b487-1a05-4ec4-8cca-8ca141f2d678-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:25:42 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-48f45808-0252-42c8-a5b6-e2c06a854de1 tempest-CreateVolumesFromImageTest-798832591 None] Lock "cinder-7010b487-1a05-4ec4-8cca-8ca141f2d678-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:25:42 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-48f45808-0252-42c8-a5b6-e2c06a854de1 tempest-CreateVolumesFromImageTest-798832591 None] Acquiring lock "cinder-quobyte-7010b487-1a05-4ec4-8cca-8ca141f2d678" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:25:42 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-48f45808-0252-42c8-a5b6-e2c06a854de1 tempest-CreateVolumesFromImageTest-798832591 None] Lock "cinder-quobyte-7010b487-1a05-4ec4-8cca-8ca141f2d678" acquired by "delete_volume" :: waited 0.019s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:25:42 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9531c9c-c6d7-49ba-ac5b-5f6ec9d06de8]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:25:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-48f45808-0252-42c8-a5b6-e2c06a854de1 tempest-CreateVolumesFromImageTest-798832591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7010b487-1a05-4ec4-8cca-8ca141f2d678 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:42 devstack sudo[105895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7010b487-1a05-4ec4-8cca-8ca141f2d678 Jul 10 10:25:42 devstack sudo[105895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:42 devstack sudo[105890]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.689s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:42 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:25:42 devstack cinder-volume[87234]: DEBUG oslo_service.periodic_task [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Running periodic task VolumeManager._thread_info {{(pid=87234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 10:25:42 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] thread count: 28 {{(pid=87234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 10:25:42 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] thread info: [<_MainThread(MainThread, started 131600773742720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 10:25:43 devstack sudo[105893]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9616b67f-6b91-4eb6-89ae-7584de7132e8 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-4823decc-80d5-4829-b21d-766721004b74" returned: 0 in 0.706s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:43 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-9616b67f-6b91-4eb6-89ae-7584de7132e8 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] <== create_volume: return (1621ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:25:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-9616b67f-6b91-4eb6-89ae-7584de7132e8 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.624s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:25:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-b3006cfe-3759-4dc8-9379-95245af118be tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.367s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:25:43 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-b3006cfe-3759-4dc8-9379-95245af118be tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:25:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-10200742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9ba87b4-1660-4b73-b6eb-874bc63c5d38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1448037a8e8f422b96decde515288dce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:25:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:25:34Z,use_quota=True,user_id='29180988cbdd4e27bf6f3f24fd8a42ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:25:43 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-b3006cfe-3759-4dc8-9379-95245af118be tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Creating volume c9ba87b4-1660-4b73-b6eb-874bc63c5d38 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:25:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-b3006cfe-3759-4dc8-9379-95245af118be tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:25:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-b3006cfe-3759-4dc8-9379-95245af118be tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:25:43 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-b3006cfe-3759-4dc8-9379-95245af118be tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:25:43 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-b3006cfe-3759-4dc8-9379-95245af118be tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:25:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-b3006cfe-3759-4dc8-9379-95245af118be tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:25:43 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-b3006cfe-3759-4dc8-9379-95245af118be tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:25:43 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-b3006cfe-3759-4dc8-9379-95245af118be tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:25:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-b3006cfe-3759-4dc8-9379-95245af118be tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c9ba87b4-1660-4b73-b6eb-874bc63c5d38 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:43 devstack sudo[105899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c9ba87b4-1660-4b73-b6eb-874bc63c5d38 1073741824 Jul 10 10:25:43 devstack sudo[105899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:43 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9616b67f-6b91-4eb6-89ae-7584de7132e8 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15bb1e04-9225-4ec1-861f-2f41c3ab6b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4823decc-80d5-4829-b21d-766721004b74', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:43 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9616b67f-6b91-4eb6-89ae-7584de7132e8 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c51dae3d-3e23-402d-aa17-1eebb97727ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:43 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-9616b67f-6b91-4eb6-89ae-7584de7132e8 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Volume volume-4823decc-80d5-4829-b21d-766721004b74 (4823decc-80d5-4829-b21d-766721004b74): created successfully Jul 10 10:25:43 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9616b67f-6b91-4eb6-89ae-7584de7132e8 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c51dae3d-3e23-402d-aa17-1eebb97727ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:43 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9616b67f-6b91-4eb6-89ae-7584de7132e8 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Flow 'volume_create_manager' (01ffc758-38b7-4be9-bdf7-a30c3bffe417) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:25:43 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-9616b67f-6b91-4eb6-89ae-7584de7132e8 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Created volume successfully. Jul 10 10:25:43 devstack sudo[105895]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-48f45808-0252-42c8-a5b6-e2c06a854de1 tempest-CreateVolumesFromImageTest-798832591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7010b487-1a05-4ec4-8cca-8ca141f2d678" returned: 0 in 0.821s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-48f45808-0252-42c8-a5b6-e2c06a854de1 tempest-CreateVolumesFromImageTest-798832591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7010b487-1a05-4ec4-8cca-8ca141f2d678 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:43 devstack sudo[105904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7010b487-1a05-4ec4-8cca-8ca141f2d678 Jul 10 10:25:43 devstack sudo[105904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:44 devstack sudo[105899]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-b3006cfe-3759-4dc8-9379-95245af118be tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c9ba87b4-1660-4b73-b6eb-874bc63c5d38 1073741824" returned: 0 in 0.867s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-b3006cfe-3759-4dc8-9379-95245af118be tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c9ba87b4-1660-4b73-b6eb-874bc63c5d38 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:44 devstack sudo[105910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c9ba87b4-1660-4b73-b6eb-874bc63c5d38 Jul 10 10:25:44 devstack sudo[105910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:44 devstack sudo[105904]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-48f45808-0252-42c8-a5b6-e2c06a854de1 tempest-CreateVolumesFromImageTest-798832591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7010b487-1a05-4ec4-8cca-8ca141f2d678" returned: 0 in 0.694s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:44 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-48f45808-0252-42c8-a5b6-e2c06a854de1 tempest-CreateVolumesFromImageTest-798832591 None] Lock "cinder-quobyte-7010b487-1a05-4ec4-8cca-8ca141f2d678" released by "delete_volume" :: held 1.568s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:25:44 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-48f45808-0252-42c8-a5b6-e2c06a854de1 tempest-CreateVolumesFromImageTest-798832591 None] Created reservations ['7872289c-e785-4890-8def-1179f9473b95', 'cd085022-6f78-4d93-bc1c-4a617b0efbc1', '3cbcb7ca-f8a3-408f-a98a-5db8df3a7e3e', '09372d74-5834-4347-8fc8-d27b2e74e47f'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:25:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-48f45808-0252-42c8-a5b6-e2c06a854de1 tempest-CreateVolumesFromImageTest-798832591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:25:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-48f45808-0252-42c8-a5b6-e2c06a854de1 tempest-CreateVolumesFromImageTest-798832591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:25:44 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-48f45808-0252-42c8-a5b6-e2c06a854de1 tempest-CreateVolumesFromImageTest-798832591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:25:44 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-48f45808-0252-42c8-a5b6-e2c06a854de1 tempest-CreateVolumesFromImageTest-798832591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:25:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-48f45808-0252-42c8-a5b6-e2c06a854de1 tempest-CreateVolumesFromImageTest-798832591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:25:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-48f45808-0252-42c8-a5b6-e2c06a854de1 tempest-CreateVolumesFromImageTest-798832591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:44 devstack sudo[105912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:25:44 devstack sudo[105912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:44 devstack sudo[105910]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-b3006cfe-3759-4dc8-9379-95245af118be tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c9ba87b4-1660-4b73-b6eb-874bc63c5d38" returned: 0 in 0.637s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:44 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-b3006cfe-3759-4dc8-9379-95245af118be tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] <== create_volume: return (1550ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:25:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-b3006cfe-3759-4dc8-9379-95245af118be tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.554s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:25:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-4157fb56-bc4e-490d-b6ed-fb3b795420d4 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.627s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:25:44 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-4157fb56-bc4e-490d-b6ed-fb3b795420d4 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:25:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1137130056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfbd1947-bbe3-44d8-9d8f-f243ea048db8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1448037a8e8f422b96decde515288dce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:25:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:25:34Z,use_quota=True,user_id='29180988cbdd4e27bf6f3f24fd8a42ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:25:44 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-4157fb56-bc4e-490d-b6ed-fb3b795420d4 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Creating volume bfbd1947-bbe3-44d8-9d8f-f243ea048db8 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:25:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-4157fb56-bc4e-490d-b6ed-fb3b795420d4 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:25:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-4157fb56-bc4e-490d-b6ed-fb3b795420d4 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:25:44 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-4157fb56-bc4e-490d-b6ed-fb3b795420d4 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:25:44 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-4157fb56-bc4e-490d-b6ed-fb3b795420d4 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:25:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-4157fb56-bc4e-490d-b6ed-fb3b795420d4 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:25:44 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-4157fb56-bc4e-490d-b6ed-fb3b795420d4 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:25:44 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-4157fb56-bc4e-490d-b6ed-fb3b795420d4 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:25:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4157fb56-bc4e-490d-b6ed-fb3b795420d4 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-bfbd1947-bbe3-44d8-9d8f-f243ea048db8 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:44 devstack sudo[105915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-bfbd1947-bbe3-44d8-9d8f-f243ea048db8 1073741824 Jul 10 10:25:44 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-b3006cfe-3759-4dc8-9379-95245af118be tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84e7213c-243d-464d-a34f-0d5b5405a813) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9ba87b4-1660-4b73-b6eb-874bc63c5d38', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:44 devstack sudo[105915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:44 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-b3006cfe-3759-4dc8-9379-95245af118be tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b31d1c16-61a7-48fa-aa7d-a0ef2f30f1c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:44 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-aa7bae44-6e93-42d8-bf18-44b31bd77c93 tempest-CreateVolumesFromImageTest-798832591 None] Acquiring lock "cinder-847d5d30-3366-4d9c-a04b-fd69e5bce5e9-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:25:44 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-b3006cfe-3759-4dc8-9379-95245af118be tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Volume volume-c9ba87b4-1660-4b73-b6eb-874bc63c5d38 (c9ba87b4-1660-4b73-b6eb-874bc63c5d38): created successfully Jul 10 10:25:44 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-b3006cfe-3759-4dc8-9379-95245af118be tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b31d1c16-61a7-48fa-aa7d-a0ef2f30f1c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:44 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-b3006cfe-3759-4dc8-9379-95245af118be tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Flow 'volume_create_manager' (4a02609c-6638-4bb1-82b1-31b28162f3d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:25:44 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-aa7bae44-6e93-42d8-bf18-44b31bd77c93 tempest-CreateVolumesFromImageTest-798832591 None] Lock "cinder-847d5d30-3366-4d9c-a04b-fd69e5bce5e9-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:25:44 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-b3006cfe-3759-4dc8-9379-95245af118be tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Created volume successfully. Jul 10 10:25:44 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-aa7bae44-6e93-42d8-bf18-44b31bd77c93 tempest-CreateVolumesFromImageTest-798832591 None] Acquiring lock "cinder-quobyte-847d5d30-3366-4d9c-a04b-fd69e5bce5e9" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:25:44 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-aa7bae44-6e93-42d8-bf18-44b31bd77c93 tempest-CreateVolumesFromImageTest-798832591 None] Lock "cinder-quobyte-847d5d30-3366-4d9c-a04b-fd69e5bce5e9" acquired by "delete_volume" :: waited 0.019s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:25:44 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[5abb910a-ac1d-48c6-b946-6f26d8f7e9c0]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:25:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-aa7bae44-6e93-42d8-bf18-44b31bd77c93 tempest-CreateVolumesFromImageTest-798832591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-847d5d30-3366-4d9c-a04b-fd69e5bce5e9 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:45 devstack sudo[105912]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-48f45808-0252-42c8-a5b6-e2c06a854de1 tempest-CreateVolumesFromImageTest-798832591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.717s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:45 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-48f45808-0252-42c8-a5b6-e2c06a854de1 tempest-CreateVolumesFromImageTest-798832591 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:25:45 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-48f45808-0252-42c8-a5b6-e2c06a854de1 tempest-CreateVolumesFromImageTest-798832591 None] Deleted volume successfully. Jul 10 10:25:45 devstack sudo[105918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-847d5d30-3366-4d9c-a04b-fd69e5bce5e9 Jul 10 10:25:45 devstack sudo[105918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:45 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-48f45808-0252-42c8-a5b6-e2c06a854de1 tempest-CreateVolumesFromImageTest-798832591 None] Lock "cinder-7010b487-1a05-4ec4-8cca-8ca141f2d678-delete_volume" released by "delete_volume" :: held 2.557s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:25:45 devstack sudo[105915]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4157fb56-bc4e-490d-b6ed-fb3b795420d4 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-bfbd1947-bbe3-44d8-9d8f-f243ea048db8 1073741824" returned: 0 in 0.996s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:45 devstack sudo[105918]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-aa7bae44-6e93-42d8-bf18-44b31bd77c93 tempest-CreateVolumesFromImageTest-798832591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-847d5d30-3366-4d9c-a04b-fd69e5bce5e9" returned: 0 in 0.835s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-aa7bae44-6e93-42d8-bf18-44b31bd77c93 tempest-CreateVolumesFromImageTest-798832591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-847d5d30-3366-4d9c-a04b-fd69e5bce5e9 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4157fb56-bc4e-490d-b6ed-fb3b795420d4 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-bfbd1947-bbe3-44d8-9d8f-f243ea048db8 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:45 devstack sudo[105927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-847d5d30-3366-4d9c-a04b-fd69e5bce5e9 Jul 10 10:25:45 devstack sudo[105927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:45 devstack sudo[105929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-bfbd1947-bbe3-44d8-9d8f-f243ea048db8 Jul 10 10:25:45 devstack sudo[105929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:46 devstack sudo[105927]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-aa7bae44-6e93-42d8-bf18-44b31bd77c93 tempest-CreateVolumesFromImageTest-798832591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-847d5d30-3366-4d9c-a04b-fd69e5bce5e9" returned: 0 in 0.672s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:46 devstack sudo[105929]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:46 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-aa7bae44-6e93-42d8-bf18-44b31bd77c93 tempest-CreateVolumesFromImageTest-798832591 None] Lock "cinder-quobyte-847d5d30-3366-4d9c-a04b-fd69e5bce5e9" released by "delete_volume" :: held 1.552s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:25:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4157fb56-bc4e-490d-b6ed-fb3b795420d4 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-bfbd1947-bbe3-44d8-9d8f-f243ea048db8" returned: 0 in 0.667s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:46 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-4157fb56-bc4e-490d-b6ed-fb3b795420d4 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] <== create_volume: return (1724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:25:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-4157fb56-bc4e-490d-b6ed-fb3b795420d4 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.728s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:25:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-8f7e1bcb-ab3b-4f1f-8f2d-72ba2f9ba6e9 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.941s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:25:46 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-8f7e1bcb-ab3b-4f1f-8f2d-72ba2f9ba6e9 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:25:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-27693341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18a80723-6272-47d1-bf7f-f6e0a4b68316,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1448037a8e8f422b96decde515288dce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:25:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:25:34Z,use_quota=True,user_id='29180988cbdd4e27bf6f3f24fd8a42ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:25:46 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-8f7e1bcb-ab3b-4f1f-8f2d-72ba2f9ba6e9 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Creating volume 18a80723-6272-47d1-bf7f-f6e0a4b68316 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:25:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-8f7e1bcb-ab3b-4f1f-8f2d-72ba2f9ba6e9 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:25:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-8f7e1bcb-ab3b-4f1f-8f2d-72ba2f9ba6e9 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:25:46 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-8f7e1bcb-ab3b-4f1f-8f2d-72ba2f9ba6e9 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:25:46 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-8f7e1bcb-ab3b-4f1f-8f2d-72ba2f9ba6e9 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:25:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-8f7e1bcb-ab3b-4f1f-8f2d-72ba2f9ba6e9 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:25:46 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-8f7e1bcb-ab3b-4f1f-8f2d-72ba2f9ba6e9 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:25:46 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-8f7e1bcb-ab3b-4f1f-8f2d-72ba2f9ba6e9 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:25:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-8f7e1bcb-ab3b-4f1f-8f2d-72ba2f9ba6e9 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-18a80723-6272-47d1-bf7f-f6e0a4b68316 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:46 devstack sudo[105933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-18a80723-6272-47d1-bf7f-f6e0a4b68316 1073741824 Jul 10 10:25:46 devstack sudo[105933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:46 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4157fb56-bc4e-490d-b6ed-fb3b795420d4 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0042b766-863a-474b-b243-02ac4bdd5a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfbd1947-bbe3-44d8-9d8f-f243ea048db8', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:46 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4157fb56-bc4e-490d-b6ed-fb3b795420d4 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0c672dd-a8ff-4cf6-91a7-1f78462f3bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:46 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-4157fb56-bc4e-490d-b6ed-fb3b795420d4 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Volume volume-bfbd1947-bbe3-44d8-9d8f-f243ea048db8 (bfbd1947-bbe3-44d8-9d8f-f243ea048db8): created successfully Jul 10 10:25:46 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4157fb56-bc4e-490d-b6ed-fb3b795420d4 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0c672dd-a8ff-4cf6-91a7-1f78462f3bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:46 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4157fb56-bc4e-490d-b6ed-fb3b795420d4 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Flow 'volume_create_manager' (21868470-3e65-4d9f-ad57-6af3a5461624) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:25:46 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-4157fb56-bc4e-490d-b6ed-fb3b795420d4 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Created volume successfully. Jul 10 10:25:46 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-aa7bae44-6e93-42d8-bf18-44b31bd77c93 tempest-CreateVolumesFromImageTest-798832591 None] Created reservations ['20816959-dda0-40c9-a9ae-d182f6c8f43a', '2e40878e-d7c2-4f2e-a1e5-49cc8d5c46d7', 'c50ad2fc-95e4-4bb9-a554-ad9641c7bfc6', '844bb2e4-649c-425e-be8a-de428c182b61'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:25:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-aa7bae44-6e93-42d8-bf18-44b31bd77c93 tempest-CreateVolumesFromImageTest-798832591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:25:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-aa7bae44-6e93-42d8-bf18-44b31bd77c93 tempest-CreateVolumesFromImageTest-798832591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:25:46 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-aa7bae44-6e93-42d8-bf18-44b31bd77c93 tempest-CreateVolumesFromImageTest-798832591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:25:46 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-aa7bae44-6e93-42d8-bf18-44b31bd77c93 tempest-CreateVolumesFromImageTest-798832591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:25:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-aa7bae44-6e93-42d8-bf18-44b31bd77c93 tempest-CreateVolumesFromImageTest-798832591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:25:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-aa7bae44-6e93-42d8-bf18-44b31bd77c93 tempest-CreateVolumesFromImageTest-798832591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:46 devstack sudo[105935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:25:46 devstack sudo[105935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:46 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-cbd78190-9ae8-4748-ac73-01919ea67175 tempest-CreateVolumesFromImageTest-798832591 None] Acquiring lock "cinder-b6b70c0f-63a6-4c51-b1b8-3c272a234697-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:25:47 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-cbd78190-9ae8-4748-ac73-01919ea67175 tempest-CreateVolumesFromImageTest-798832591 None] Lock "cinder-b6b70c0f-63a6-4c51-b1b8-3c272a234697-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:25:47 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-cbd78190-9ae8-4748-ac73-01919ea67175 tempest-CreateVolumesFromImageTest-798832591 None] Acquiring lock "cinder-quobyte-b6b70c0f-63a6-4c51-b1b8-3c272a234697" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:25:47 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-cbd78190-9ae8-4748-ac73-01919ea67175 tempest-CreateVolumesFromImageTest-798832591 None] Lock "cinder-quobyte-b6b70c0f-63a6-4c51-b1b8-3c272a234697" acquired by "delete_volume" :: waited 0.016s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:25:47 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[26cea436-1011-41a0-ae35-9f6e7f0dd45e]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:25:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-cbd78190-9ae8-4748-ac73-01919ea67175 tempest-CreateVolumesFromImageTest-798832591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b6b70c0f-63a6-4c51-b1b8-3c272a234697 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:47 devstack sudo[105940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b6b70c0f-63a6-4c51-b1b8-3c272a234697 Jul 10 10:25:47 devstack sudo[105940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:47 devstack sudo[105935]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-aa7bae44-6e93-42d8-bf18-44b31bd77c93 tempest-CreateVolumesFromImageTest-798832591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.683s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:47 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-aa7bae44-6e93-42d8-bf18-44b31bd77c93 tempest-CreateVolumesFromImageTest-798832591 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:25:47 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-aa7bae44-6e93-42d8-bf18-44b31bd77c93 tempest-CreateVolumesFromImageTest-798832591 None] Deleted volume successfully. Jul 10 10:25:47 devstack sudo[105933]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:47 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-aa7bae44-6e93-42d8-bf18-44b31bd77c93 tempest-CreateVolumesFromImageTest-798832591 None] Lock "cinder-847d5d30-3366-4d9c-a04b-fd69e5bce5e9-delete_volume" released by "delete_volume" :: held 2.531s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:25:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-8f7e1bcb-ab3b-4f1f-8f2d-72ba2f9ba6e9 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-18a80723-6272-47d1-bf7f-f6e0a4b68316 1073741824" returned: 0 in 0.887s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-8f7e1bcb-ab3b-4f1f-8f2d-72ba2f9ba6e9 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-18a80723-6272-47d1-bf7f-f6e0a4b68316 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:47 devstack sudo[105944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-18a80723-6272-47d1-bf7f-f6e0a4b68316 Jul 10 10:25:47 devstack sudo[105944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:47 devstack sudo[105940]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-cbd78190-9ae8-4748-ac73-01919ea67175 tempest-CreateVolumesFromImageTest-798832591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b6b70c0f-63a6-4c51-b1b8-3c272a234697" returned: 0 in 0.790s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-cbd78190-9ae8-4748-ac73-01919ea67175 tempest-CreateVolumesFromImageTest-798832591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b6b70c0f-63a6-4c51-b1b8-3c272a234697 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:47 devstack sudo[105951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b6b70c0f-63a6-4c51-b1b8-3c272a234697 Jul 10 10:25:47 devstack sudo[105951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:48 devstack sudo[105944]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-8f7e1bcb-ab3b-4f1f-8f2d-72ba2f9ba6e9 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-18a80723-6272-47d1-bf7f-f6e0a4b68316" returned: 0 in 0.672s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:48 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-8f7e1bcb-ab3b-4f1f-8f2d-72ba2f9ba6e9 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] <== create_volume: return (1598ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:25:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-8f7e1bcb-ab3b-4f1f-8f2d-72ba2f9ba6e9 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.601s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:25:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-647ebeb6-4ff2-4a3d-9ebd-68365447a2e3 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.069s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:25:48 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-647ebeb6-4ff2-4a3d-9ebd-68365447a2e3 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:25:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1669260140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28e30761-d990-40f5-9315-376265c42f20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1448037a8e8f422b96decde515288dce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:25:35Z,use_quota=True,user_id='29180988cbdd4e27bf6f3f24fd8a42ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:25:48 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-647ebeb6-4ff2-4a3d-9ebd-68365447a2e3 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Creating volume 28e30761-d990-40f5-9315-376265c42f20 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:25:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-647ebeb6-4ff2-4a3d-9ebd-68365447a2e3 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:25:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-647ebeb6-4ff2-4a3d-9ebd-68365447a2e3 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:25:48 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-647ebeb6-4ff2-4a3d-9ebd-68365447a2e3 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:25:48 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-647ebeb6-4ff2-4a3d-9ebd-68365447a2e3 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:25:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-647ebeb6-4ff2-4a3d-9ebd-68365447a2e3 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:25:48 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-647ebeb6-4ff2-4a3d-9ebd-68365447a2e3 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:25:48 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-647ebeb6-4ff2-4a3d-9ebd-68365447a2e3 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:25:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-647ebeb6-4ff2-4a3d-9ebd-68365447a2e3 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-28e30761-d990-40f5-9315-376265c42f20 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:48 devstack sudo[105953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-28e30761-d990-40f5-9315-376265c42f20 1073741824 Jul 10 10:25:48 devstack sudo[105953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:48 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8f7e1bcb-ab3b-4f1f-8f2d-72ba2f9ba6e9 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f27cb50-7fd0-4449-a710-8e3ecee437ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18a80723-6272-47d1-bf7f-f6e0a4b68316', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:48 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8f7e1bcb-ab3b-4f1f-8f2d-72ba2f9ba6e9 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f07fa7a-2cf9-4e9c-989d-d8c0d9ce3e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:48 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-8f7e1bcb-ab3b-4f1f-8f2d-72ba2f9ba6e9 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Volume volume-18a80723-6272-47d1-bf7f-f6e0a4b68316 (18a80723-6272-47d1-bf7f-f6e0a4b68316): created successfully Jul 10 10:25:48 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8f7e1bcb-ab3b-4f1f-8f2d-72ba2f9ba6e9 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f07fa7a-2cf9-4e9c-989d-d8c0d9ce3e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:48 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8f7e1bcb-ab3b-4f1f-8f2d-72ba2f9ba6e9 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Flow 'volume_create_manager' (7ac670bd-21cc-4a10-9494-11b5b632af3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:25:48 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-8f7e1bcb-ab3b-4f1f-8f2d-72ba2f9ba6e9 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Created volume successfully. Jul 10 10:25:48 devstack sudo[105951]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-cbd78190-9ae8-4748-ac73-01919ea67175 tempest-CreateVolumesFromImageTest-798832591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b6b70c0f-63a6-4c51-b1b8-3c272a234697" returned: 0 in 0.704s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:48 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-cbd78190-9ae8-4748-ac73-01919ea67175 tempest-CreateVolumesFromImageTest-798832591 None] Lock "cinder-quobyte-b6b70c0f-63a6-4c51-b1b8-3c272a234697" released by "delete_volume" :: held 1.545s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:25:48 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-cbd78190-9ae8-4748-ac73-01919ea67175 tempest-CreateVolumesFromImageTest-798832591 None] Created reservations ['16151bca-2a8b-4d2f-ac1e-11d7228af24f', '96d6baea-4628-4fcd-8458-6e8d9e61e95e', '4f5fed94-214f-47f5-bb41-49cf9544da42', '2a6fbd34-2038-474c-8810-63001646a17a'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:25:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-cbd78190-9ae8-4748-ac73-01919ea67175 tempest-CreateVolumesFromImageTest-798832591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:25:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-cbd78190-9ae8-4748-ac73-01919ea67175 tempest-CreateVolumesFromImageTest-798832591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:25:48 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-cbd78190-9ae8-4748-ac73-01919ea67175 tempest-CreateVolumesFromImageTest-798832591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:25:48 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-cbd78190-9ae8-4748-ac73-01919ea67175 tempest-CreateVolumesFromImageTest-798832591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:25:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-cbd78190-9ae8-4748-ac73-01919ea67175 tempest-CreateVolumesFromImageTest-798832591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:25:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-cbd78190-9ae8-4748-ac73-01919ea67175 tempest-CreateVolumesFromImageTest-798832591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:48 devstack sudo[105960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:25:48 devstack sudo[105960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:48 devstack sudo[105953]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-647ebeb6-4ff2-4a3d-9ebd-68365447a2e3 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-28e30761-d990-40f5-9315-376265c42f20 1073741824" returned: 0 in 0.884s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-647ebeb6-4ff2-4a3d-9ebd-68365447a2e3 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-28e30761-d990-40f5-9315-376265c42f20 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:48 devstack sudo[105962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-28e30761-d990-40f5-9315-376265c42f20 Jul 10 10:25:48 devstack sudo[105962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:49 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-eb227584-6e11-4dc2-bb42-54d3cde9c199 tempest-CreateVolumesFromImageTest-798832591 None] Acquiring lock "cinder-3cc562ce-c640-41cf-bedd-69dd0fd6f63d-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:25:49 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-eb227584-6e11-4dc2-bb42-54d3cde9c199 tempest-CreateVolumesFromImageTest-798832591 None] Lock "cinder-3cc562ce-c640-41cf-bedd-69dd0fd6f63d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:25:49 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-eb227584-6e11-4dc2-bb42-54d3cde9c199 tempest-CreateVolumesFromImageTest-798832591 None] Acquiring lock "cinder-quobyte-3cc562ce-c640-41cf-bedd-69dd0fd6f63d" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:25:49 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-eb227584-6e11-4dc2-bb42-54d3cde9c199 tempest-CreateVolumesFromImageTest-798832591 None] Lock "cinder-quobyte-3cc562ce-c640-41cf-bedd-69dd0fd6f63d" acquired by "delete_volume" :: waited 0.022s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:25:49 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ea6264-c066-4869-8c60-d59424ff91f0]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:25:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-eb227584-6e11-4dc2-bb42-54d3cde9c199 tempest-CreateVolumesFromImageTest-798832591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3cc562ce-c640-41cf-bedd-69dd0fd6f63d {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:49 devstack sudo[105960]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-cbd78190-9ae8-4748-ac73-01919ea67175 tempest-CreateVolumesFromImageTest-798832591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.684s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:49 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-cbd78190-9ae8-4748-ac73-01919ea67175 tempest-CreateVolumesFromImageTest-798832591 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:25:49 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-cbd78190-9ae8-4748-ac73-01919ea67175 tempest-CreateVolumesFromImageTest-798832591 None] Deleted volume successfully. Jul 10 10:25:49 devstack sudo[105965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3cc562ce-c640-41cf-bedd-69dd0fd6f63d Jul 10 10:25:49 devstack sudo[105965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:49 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-cbd78190-9ae8-4748-ac73-01919ea67175 tempest-CreateVolumesFromImageTest-798832591 None] Lock "cinder-b6b70c0f-63a6-4c51-b1b8-3c272a234697-delete_volume" released by "delete_volume" :: held 2.487s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:25:49 devstack sudo[105962]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-647ebeb6-4ff2-4a3d-9ebd-68365447a2e3 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-28e30761-d990-40f5-9315-376265c42f20" returned: 0 in 0.650s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:49 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-647ebeb6-4ff2-4a3d-9ebd-68365447a2e3 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] <== create_volume: return (1578ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:25:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-647ebeb6-4ff2-4a3d-9ebd-68365447a2e3 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.584s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:25:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f84a488f-9f7d-43c5-ad6c-7f0527c5c18f tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.098s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:25:49 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f84a488f-9f7d-43c5-ad6c-7f0527c5c18f tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:25:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1efa7389-2eea-4e00-842b-fe58f43f97a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dd61292b677493eb06770c25cf013e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:25:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:25:33Z,use_quota=True,user_id='406e949db1654aadbf446405065f85be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac0eaabe-a3de-42ba-935d-a7f2bd0fa457),volume_type_id=ac0eaabe-a3de-42ba-935d-a7f2bd0fa457)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:25:49 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-f84a488f-9f7d-43c5-ad6c-7f0527c5c18f tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] Creating volume 1efa7389-2eea-4e00-842b-fe58f43f97a5 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:25:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f84a488f-9f7d-43c5-ad6c-7f0527c5c18f tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:25:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f84a488f-9f7d-43c5-ad6c-7f0527c5c18f tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:25:49 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f84a488f-9f7d-43c5-ad6c-7f0527c5c18f tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:25:49 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f84a488f-9f7d-43c5-ad6c-7f0527c5c18f tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:25:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f84a488f-9f7d-43c5-ad6c-7f0527c5c18f tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:25:49 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f84a488f-9f7d-43c5-ad6c-7f0527c5c18f tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:25:49 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-f84a488f-9f7d-43c5-ad6c-7f0527c5c18f tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:25:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f84a488f-9f7d-43c5-ad6c-7f0527c5c18f tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-1efa7389-2eea-4e00-842b-fe58f43f97a5 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:49 devstack sudo[105968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-1efa7389-2eea-4e00-842b-fe58f43f97a5 1073741824 Jul 10 10:25:49 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-647ebeb6-4ff2-4a3d-9ebd-68365447a2e3 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bf9524e-9cdd-42fd-a4b5-7b015bdf0218) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28e30761-d990-40f5-9315-376265c42f20', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:49 devstack sudo[105968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:49 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-647ebeb6-4ff2-4a3d-9ebd-68365447a2e3 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e422c5f7-2938-41b6-8a26-d3cbed298b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:49 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-647ebeb6-4ff2-4a3d-9ebd-68365447a2e3 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Volume volume-28e30761-d990-40f5-9315-376265c42f20 (28e30761-d990-40f5-9315-376265c42f20): created successfully Jul 10 10:25:49 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-647ebeb6-4ff2-4a3d-9ebd-68365447a2e3 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e422c5f7-2938-41b6-8a26-d3cbed298b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:49 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-647ebeb6-4ff2-4a3d-9ebd-68365447a2e3 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Flow 'volume_create_manager' (552bcf78-a648-41af-bc7f-d2483dbacd50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:25:49 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-647ebeb6-4ff2-4a3d-9ebd-68365447a2e3 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Created volume successfully. Jul 10 10:25:50 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-bd985c3c-ef48-40d8-887f-2ffe5a5e0abe tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Acquiring lock "cinder-28e30761-d990-40f5-9315-376265c42f20-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:25:50 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-bd985c3c-ef48-40d8-887f-2ffe5a5e0abe tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Lock "cinder-28e30761-d990-40f5-9315-376265c42f20-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:25:50 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-bd985c3c-ef48-40d8-887f-2ffe5a5e0abe tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Acquiring lock "cinder-quobyte-28e30761-d990-40f5-9315-376265c42f20" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:25:50 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-bd985c3c-ef48-40d8-887f-2ffe5a5e0abe tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Lock "cinder-quobyte-28e30761-d990-40f5-9315-376265c42f20" acquired by "delete_volume" :: waited 0.016s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:25:50 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b0eb3d-f0ef-4813-ae0a-df720136610c]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:25:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-bd985c3c-ef48-40d8-887f-2ffe5a5e0abe tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-28e30761-d990-40f5-9315-376265c42f20 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:50 devstack sudo[105965]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-eb227584-6e11-4dc2-bb42-54d3cde9c199 tempest-CreateVolumesFromImageTest-798832591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3cc562ce-c640-41cf-bedd-69dd0fd6f63d" returned: 0 in 0.861s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-eb227584-6e11-4dc2-bb42-54d3cde9c199 tempest-CreateVolumesFromImageTest-798832591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3cc562ce-c640-41cf-bedd-69dd0fd6f63d {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:50 devstack sudo[105973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-28e30761-d990-40f5-9315-376265c42f20 Jul 10 10:25:50 devstack sudo[105973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:50 devstack sudo[105977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3cc562ce-c640-41cf-bedd-69dd0fd6f63d Jul 10 10:25:50 devstack sudo[105977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:50 devstack sudo[105968]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f84a488f-9f7d-43c5-ad6c-7f0527c5c18f tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-1efa7389-2eea-4e00-842b-fe58f43f97a5 1073741824" returned: 0 in 0.890s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f84a488f-9f7d-43c5-ad6c-7f0527c5c18f tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-1efa7389-2eea-4e00-842b-fe58f43f97a5 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:50 devstack sudo[105981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-1efa7389-2eea-4e00-842b-fe58f43f97a5 Jul 10 10:25:50 devstack sudo[105981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:50 devstack sudo[105977]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-eb227584-6e11-4dc2-bb42-54d3cde9c199 tempest-CreateVolumesFromImageTest-798832591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3cc562ce-c640-41cf-bedd-69dd0fd6f63d" returned: 0 in 0.657s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:50 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-eb227584-6e11-4dc2-bb42-54d3cde9c199 tempest-CreateVolumesFromImageTest-798832591 None] Lock "cinder-quobyte-3cc562ce-c640-41cf-bedd-69dd0fd6f63d" released by "delete_volume" :: held 1.563s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:25:50 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-eb227584-6e11-4dc2-bb42-54d3cde9c199 tempest-CreateVolumesFromImageTest-798832591 None] Created reservations ['5349d237-7bdb-489e-9a7c-2c8bbed3163a', 'ec5ea417-8d72-4974-897a-fc73d7f1947d', 'b99fb775-b902-4634-8c5e-4f8b1442be34', '30569380-4314-45fa-965a-bf0a6eb04551'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:25:51 devstack sudo[105973]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-bd985c3c-ef48-40d8-887f-2ffe5a5e0abe tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-28e30761-d990-40f5-9315-376265c42f20" returned: 0 in 0.883s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-eb227584-6e11-4dc2-bb42-54d3cde9c199 tempest-CreateVolumesFromImageTest-798832591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:25:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-eb227584-6e11-4dc2-bb42-54d3cde9c199 tempest-CreateVolumesFromImageTest-798832591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:25:51 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-eb227584-6e11-4dc2-bb42-54d3cde9c199 tempest-CreateVolumesFromImageTest-798832591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:25:51 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-eb227584-6e11-4dc2-bb42-54d3cde9c199 tempest-CreateVolumesFromImageTest-798832591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:25:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-eb227584-6e11-4dc2-bb42-54d3cde9c199 tempest-CreateVolumesFromImageTest-798832591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:25:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-eb227584-6e11-4dc2-bb42-54d3cde9c199 tempest-CreateVolumesFromImageTest-798832591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-bd985c3c-ef48-40d8-887f-2ffe5a5e0abe tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-28e30761-d990-40f5-9315-376265c42f20 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:51 devstack sudo[105987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:25:51 devstack sudo[105987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:51 devstack sudo[105988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-28e30761-d990-40f5-9315-376265c42f20 Jul 10 10:25:51 devstack sudo[105988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:51 devstack sudo[105981]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f84a488f-9f7d-43c5-ad6c-7f0527c5c18f tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-1efa7389-2eea-4e00-842b-fe58f43f97a5" returned: 0 in 0.682s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:51 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f84a488f-9f7d-43c5-ad6c-7f0527c5c18f tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] <== create_volume: return (1636ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:25:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f84a488f-9f7d-43c5-ad6c-7f0527c5c18f tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.640s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:25:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-ed59b2da-1519-4db6-9a98-03ea28ad7fc4 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 13.078s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:25:51 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-ed59b2da-1519-4db6-9a98-03ea28ad7fc4 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Creating offline snapshot 5d1e389b-f9b8-4a6b-85f5-7699d97c5827 of volume 715d38e9-d5e9-45cc-b836-3c447cca2e66 {{(pid=87234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 10:25:51 devstack cinder-volume[87234]: DEBUG cinder.volume.volume_utils [None req-f84a488f-9f7d-43c5-ad6c-7f0527c5c18f tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] Attempting download of 6444dfb8-852a-4472-bc3d-099a8e69db28 ((None, [{'url': 'file:///opt/stack/data/glance/images/6444dfb8-852a-4472-bc3d-099a8e69db28', 'metadata': {}}])) to volume 1efa7389-2eea-4e00-842b-fe58f43f97a5. {{(pid=87234) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 10:25:51 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[e27bbb11-52e3-4879-b8ce-34c9df1dbb76]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:25:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ed59b2da-1519-4db6-9a98-03ea28ad7fc4 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-715d38e9-d5e9-45cc-b836-3c447cca2e66 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:51 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50b20bb-2f4f-4e6f-afcc-3d961fa3297f]: (4, 'raw') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:25:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f84a488f-9f7d-43c5-ad6c-7f0527c5c18f tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6444dfb8-852a-4472-bc3d-099a8e69db28_l8d3jpk1 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:51 devstack sudo[105992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-715d38e9-d5e9-45cc-b836-3c447cca2e66 Jul 10 10:25:51 devstack sudo[105992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:51 devstack sudo[105993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6444dfb8-852a-4472-bc3d-099a8e69db28_l8d3jpk1 Jul 10 10:25:51 devstack sudo[105993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:51 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-dc78ac6b-0060-4898-a411-0241b566c985 tempest-CreateVolumesFromImageTest-798832591 None] Acquiring lock "cinder-1faf1621-06da-4c24-ac8c-643988c03e31-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:25:51 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-dc78ac6b-0060-4898-a411-0241b566c985 tempest-CreateVolumesFromImageTest-798832591 None] Lock "cinder-1faf1621-06da-4c24-ac8c-643988c03e31-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:25:51 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-dc78ac6b-0060-4898-a411-0241b566c985 tempest-CreateVolumesFromImageTest-798832591 None] Acquiring lock "cinder-quobyte-1faf1621-06da-4c24-ac8c-643988c03e31" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:25:51 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-dc78ac6b-0060-4898-a411-0241b566c985 tempest-CreateVolumesFromImageTest-798832591 None] Lock "cinder-quobyte-1faf1621-06da-4c24-ac8c-643988c03e31" acquired by "delete_volume" :: waited 0.043s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:25:51 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[f872f471-3fad-4df7-acd9-4e5e7788a72b]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:25:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-dc78ac6b-0060-4898-a411-0241b566c985 tempest-CreateVolumesFromImageTest-798832591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-1faf1621-06da-4c24-ac8c-643988c03e31 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:51 devstack sudo[105988]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-bd985c3c-ef48-40d8-887f-2ffe5a5e0abe tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-28e30761-d990-40f5-9315-376265c42f20" returned: 0 in 0.847s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:51 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-bd985c3c-ef48-40d8-887f-2ffe5a5e0abe tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Lock "cinder-quobyte-28e30761-d990-40f5-9315-376265c42f20" released by "delete_volume" :: held 1.807s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:25:51 devstack sudo[105998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-1faf1621-06da-4c24-ac8c-643988c03e31 Jul 10 10:25:51 devstack sudo[105998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:51 devstack sudo[105987]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-eb227584-6e11-4dc2-bb42-54d3cde9c199 tempest-CreateVolumesFromImageTest-798832591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.934s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:51 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-eb227584-6e11-4dc2-bb42-54d3cde9c199 tempest-CreateVolumesFromImageTest-798832591 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:25:51 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-eb227584-6e11-4dc2-bb42-54d3cde9c199 tempest-CreateVolumesFromImageTest-798832591 None] Deleted volume successfully. Jul 10 10:25:52 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-bd985c3c-ef48-40d8-887f-2ffe5a5e0abe tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Created reservations ['6eef3ed2-6d08-4a18-a004-1b4e399e7a27', 'bc2348a8-1873-4cff-ada8-6cfcf23ac907', '4d1cc653-46ff-44f7-8b6d-1718a9f03f15', 'fa46cb9d-7e5b-44a1-b48c-cc5edb0924c8'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:25:52 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-eb227584-6e11-4dc2-bb42-54d3cde9c199 tempest-CreateVolumesFromImageTest-798832591 None] Lock "cinder-3cc562ce-c640-41cf-bedd-69dd0fd6f63d-delete_volume" released by "delete_volume" :: held 2.741s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:25:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-bd985c3c-ef48-40d8-887f-2ffe5a5e0abe tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:25:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-bd985c3c-ef48-40d8-887f-2ffe5a5e0abe tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:25:52 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-bd985c3c-ef48-40d8-887f-2ffe5a5e0abe tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:25:52 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-bd985c3c-ef48-40d8-887f-2ffe5a5e0abe tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:25:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-bd985c3c-ef48-40d8-887f-2ffe5a5e0abe tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:25:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-bd985c3c-ef48-40d8-887f-2ffe5a5e0abe tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:52 devstack sudo[106000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:25:52 devstack sudo[106000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:52 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-00587c09-d8ee-4d7e-9607-0b7a013d832f tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Acquiring lock "cinder-18a80723-6272-47d1-bf7f-f6e0a4b68316-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:25:52 devstack sudo[105993]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f84a488f-9f7d-43c5-ad6c-7f0527c5c18f tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6444dfb8-852a-4472-bc3d-099a8e69db28_l8d3jpk1" returned: 0 in 0.987s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f84a488f-9f7d-43c5-ad6c-7f0527c5c18f tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6444dfb8-852a-4472-bc3d-099a8e69db28_l8d3jpk1 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:52 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-00587c09-d8ee-4d7e-9607-0b7a013d832f tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Lock "cinder-18a80723-6272-47d1-bf7f-f6e0a4b68316-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:25:52 devstack sudo[105992]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ed59b2da-1519-4db6-9a98-03ea28ad7fc4 tempest-CreateVolumesFromSnapshotTest-1391512244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-715d38e9-d5e9-45cc-b836-3c447cca2e66" returned: 0 in 1.106s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ed59b2da-1519-4db6-9a98-03ea28ad7fc4 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-715d38e9-d5e9-45cc-b836-3c447cca2e66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-715d38e9-d5e9-45cc-b836-3c447cca2e66.5d1e389b-f9b8-4a6b-85f5-7699d97c5827 1G {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:52 devstack sudo[106008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-715d38e9-d5e9-45cc-b836-3c447cca2e66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-715d38e9-d5e9-45cc-b836-3c447cca2e66.5d1e389b-f9b8-4a6b-85f5-7699d97c5827 1G Jul 10 10:25:52 devstack sudo[106008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:52 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-00587c09-d8ee-4d7e-9607-0b7a013d832f tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Acquiring lock "cinder-quobyte-18a80723-6272-47d1-bf7f-f6e0a4b68316" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:25:52 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-00587c09-d8ee-4d7e-9607-0b7a013d832f tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Lock "cinder-quobyte-18a80723-6272-47d1-bf7f-f6e0a4b68316" acquired by "delete_volume" :: waited 0.016s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:25:52 devstack sudo[106007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6444dfb8-852a-4472-bc3d-099a8e69db28_l8d3jpk1 Jul 10 10:25:52 devstack sudo[106007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:52 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e00106-45ea-418e-8af3-b089773d3568]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:25:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-00587c09-d8ee-4d7e-9607-0b7a013d832f tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-18a80723-6272-47d1-bf7f-f6e0a4b68316 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:52 devstack sudo[106011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-18a80723-6272-47d1-bf7f-f6e0a4b68316 Jul 10 10:25:52 devstack sudo[106011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:52 devstack sudo[106000]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-bd985c3c-ef48-40d8-887f-2ffe5a5e0abe tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.884s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:52 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-bd985c3c-ef48-40d8-887f-2ffe5a5e0abe tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:25:52 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-bd985c3c-ef48-40d8-887f-2ffe5a5e0abe tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Deleted volume successfully. Jul 10 10:25:53 devstack sudo[105998]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-dc78ac6b-0060-4898-a411-0241b566c985 tempest-CreateVolumesFromImageTest-798832591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-1faf1621-06da-4c24-ac8c-643988c03e31" returned: 0 in 1.231s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-dc78ac6b-0060-4898-a411-0241b566c985 tempest-CreateVolumesFromImageTest-798832591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-1faf1621-06da-4c24-ac8c-643988c03e31 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:53 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-bd985c3c-ef48-40d8-887f-2ffe5a5e0abe tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Lock "cinder-28e30761-d990-40f5-9315-376265c42f20-delete_volume" released by "delete_volume" :: held 2.974s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:25:53 devstack sudo[106017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-1faf1621-06da-4c24-ac8c-643988c03e31 Jul 10 10:25:53 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:53 devstack sudo[106007]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f84a488f-9f7d-43c5-ad6c-7f0527c5c18f tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6444dfb8-852a-4472-bc3d-099a8e69db28_l8d3jpk1" returned: 1 in 1.005s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f84a488f-9f7d-43c5-ad6c-7f0527c5c18f tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6444dfb8-852a-4472-bc3d-099a8e69db28_l8d3jpk1' failed. Not Retrying. {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 10:25:53 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd21b3c4-dcb2-4d7a-82fe-495f2c37d0cf]: (4, 'raw') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:25:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f84a488f-9f7d-43c5-ad6c-7f0527c5c18f tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6444dfb8-852a-4472-bc3d-099a8e69db28_huvgt8dfdevstack@QuobyteHD {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:53 devstack sudo[106008]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ed59b2da-1519-4db6-9a98-03ea28ad7fc4 tempest-CreateVolumesFromSnapshotTest-1391512244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-715d38e9-d5e9-45cc-b836-3c447cca2e66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-715d38e9-d5e9-45cc-b836-3c447cca2e66.5d1e389b-f9b8-4a6b-85f5-7699d97c5827 1G" returned: 0 in 0.978s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ed59b2da-1519-4db6-9a98-03ea28ad7fc4 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-715d38e9-d5e9-45cc-b836-3c447cca2e66 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-715d38e9-d5e9-45cc-b836-3c447cca2e66.5d1e389b-f9b8-4a6b-85f5-7699d97c5827 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:53 devstack sudo[106029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-715d38e9-d5e9-45cc-b836-3c447cca2e66 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-715d38e9-d5e9-45cc-b836-3c447cca2e66.5d1e389b-f9b8-4a6b-85f5-7699d97c5827 Jul 10 10:25:53 devstack sudo[106029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:53 devstack sudo[106027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6444dfb8-852a-4472-bc3d-099a8e69db28_huvgt8dfdevstack@QuobyteHD Jul 10 10:25:53 devstack sudo[106027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:53 devstack sudo[106011]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-00587c09-d8ee-4d7e-9607-0b7a013d832f tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-18a80723-6272-47d1-bf7f-f6e0a4b68316" returned: 0 in 1.003s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-00587c09-d8ee-4d7e-9607-0b7a013d832f tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-18a80723-6272-47d1-bf7f-f6e0a4b68316 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:53 devstack sudo[106032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-18a80723-6272-47d1-bf7f-f6e0a4b68316 Jul 10 10:25:53 devstack sudo[106032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:53 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-dc78ac6b-0060-4898-a411-0241b566c985 tempest-CreateVolumesFromImageTest-798832591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-1faf1621-06da-4c24-ac8c-643988c03e31" returned: 0 in 0.752s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:53 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-dc78ac6b-0060-4898-a411-0241b566c985 tempest-CreateVolumesFromImageTest-798832591 None] Lock "cinder-quobyte-1faf1621-06da-4c24-ac8c-643988c03e31" released by "delete_volume" :: held 2.067s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:25:53 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-dc78ac6b-0060-4898-a411-0241b566c985 tempest-CreateVolumesFromImageTest-798832591 None] Created reservations ['a9ea3d18-bfeb-4a10-9fb3-5e05e7df9e6c', '2bcc92ae-5e4a-4da9-8d31-7286c7709e28', '67f1a7a2-2103-4918-b045-4a0b697dd28d', '20c7384e-c5b5-4ea3-865f-fc81c51a8c29'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:25:54 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-dc78ac6b-0060-4898-a411-0241b566c985 tempest-CreateVolumesFromImageTest-798832591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:25:54 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-dc78ac6b-0060-4898-a411-0241b566c985 tempest-CreateVolumesFromImageTest-798832591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:25:54 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-dc78ac6b-0060-4898-a411-0241b566c985 tempest-CreateVolumesFromImageTest-798832591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:25:54 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-dc78ac6b-0060-4898-a411-0241b566c985 tempest-CreateVolumesFromImageTest-798832591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:25:54 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-dc78ac6b-0060-4898-a411-0241b566c985 tempest-CreateVolumesFromImageTest-798832591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:25:54 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-dc78ac6b-0060-4898-a411-0241b566c985 tempest-CreateVolumesFromImageTest-798832591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:54 devstack sudo[106035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:25:54 devstack sudo[106035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:54 devstack sudo[106027]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:54 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f84a488f-9f7d-43c5-ad6c-7f0527c5c18f tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6444dfb8-852a-4472-bc3d-099a8e69db28_huvgt8dfdevstack@QuobyteHD" returned: 0 in 0.836s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:54 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f84a488f-9f7d-43c5-ad6c-7f0527c5c18f tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6444dfb8-852a-4472-bc3d-099a8e69db28_huvgt8dfdevstack@QuobyteHD {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:54 devstack sudo[106029]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:54 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ed59b2da-1519-4db6-9a98-03ea28ad7fc4 tempest-CreateVolumesFromSnapshotTest-1391512244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-715d38e9-d5e9-45cc-b836-3c447cca2e66 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-715d38e9-d5e9-45cc-b836-3c447cca2e66.5d1e389b-f9b8-4a6b-85f5-7699d97c5827" returned: 0 in 0.821s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:54 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-ed59b2da-1519-4db6-9a98-03ea28ad7fc4 tempest-CreateVolumesFromSnapshotTest-1391512244 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-715d38e9-d5e9-45cc-b836-3c447cca2e66.5d1e389b-f9b8-4a6b-85f5-7699d97c5827 is being set with open permissions: ugo+rw Jul 10 10:25:54 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ed59b2da-1519-4db6-9a98-03ea28ad7fc4 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-715d38e9-d5e9-45cc-b836-3c447cca2e66.5d1e389b-f9b8-4a6b-85f5-7699d97c5827 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:54 devstack sudo[106045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-715d38e9-d5e9-45cc-b836-3c447cca2e66.5d1e389b-f9b8-4a6b-85f5-7699d97c5827 Jul 10 10:25:54 devstack sudo[106045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:54 devstack sudo[106044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6444dfb8-852a-4472-bc3d-099a8e69db28_huvgt8dfdevstack@QuobyteHD Jul 10 10:25:54 devstack sudo[106044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:54 devstack sudo[106032]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:54 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-00587c09-d8ee-4d7e-9607-0b7a013d832f tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-18a80723-6272-47d1-bf7f-f6e0a4b68316" returned: 0 in 0.809s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:54 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-00587c09-d8ee-4d7e-9607-0b7a013d832f tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Lock "cinder-quobyte-18a80723-6272-47d1-bf7f-f6e0a4b68316" released by "delete_volume" :: held 1.886s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:25:54 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-00587c09-d8ee-4d7e-9607-0b7a013d832f tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Created reservations ['536a0968-534a-4136-9dd1-805578dfad8c', 'e526f5cd-7e94-47c1-b5d2-1280f8573934', 'a0c8cda1-4071-4444-bd9f-b1fb47379b62', 'c4934234-7460-4a96-b1f5-8a94cb6f150f'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:25:54 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-00587c09-d8ee-4d7e-9607-0b7a013d832f tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:25:54 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-00587c09-d8ee-4d7e-9607-0b7a013d832f tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:25:54 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-00587c09-d8ee-4d7e-9607-0b7a013d832f tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:25:54 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-00587c09-d8ee-4d7e-9607-0b7a013d832f tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:25:54 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-00587c09-d8ee-4d7e-9607-0b7a013d832f tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:25:54 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-00587c09-d8ee-4d7e-9607-0b7a013d832f tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:54 devstack sudo[106048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:25:54 devstack sudo[106048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:54 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-193bfccc-c612-4260-80fc-5b30eead2a0f tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Acquiring lock "cinder-bfbd1947-bbe3-44d8-9d8f-f243ea048db8-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:25:54 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-193bfccc-c612-4260-80fc-5b30eead2a0f tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Lock "cinder-bfbd1947-bbe3-44d8-9d8f-f243ea048db8-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:25:54 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-193bfccc-c612-4260-80fc-5b30eead2a0f tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Acquiring lock "cinder-quobyte-bfbd1947-bbe3-44d8-9d8f-f243ea048db8" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:25:54 devstack sudo[106035]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:54 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-dc78ac6b-0060-4898-a411-0241b566c985 tempest-CreateVolumesFromImageTest-798832591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.834s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:54 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-dc78ac6b-0060-4898-a411-0241b566c985 tempest-CreateVolumesFromImageTest-798832591 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:25:54 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-dc78ac6b-0060-4898-a411-0241b566c985 tempest-CreateVolumesFromImageTest-798832591 None] Deleted volume successfully. Jul 10 10:25:54 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-193bfccc-c612-4260-80fc-5b30eead2a0f tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Lock "cinder-quobyte-bfbd1947-bbe3-44d8-9d8f-f243ea048db8" acquired by "delete_volume" :: waited 0.041s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:25:54 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8d39cd-ebed-4485-a0f6-fda7a4a164f2]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:25:54 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-193bfccc-c612-4260-80fc-5b30eead2a0f tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-bfbd1947-bbe3-44d8-9d8f-f243ea048db8 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:54 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-dc78ac6b-0060-4898-a411-0241b566c985 tempest-CreateVolumesFromImageTest-798832591 None] Lock "cinder-1faf1621-06da-4c24-ac8c-643988c03e31-delete_volume" released by "delete_volume" :: held 3.331s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:25:55 devstack sudo[106051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-bfbd1947-bbe3-44d8-9d8f-f243ea048db8 Jul 10 10:25:55 devstack sudo[106051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:55 devstack sudo[106045]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:55 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ed59b2da-1519-4db6-9a98-03ea28ad7fc4 tempest-CreateVolumesFromSnapshotTest-1391512244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-715d38e9-d5e9-45cc-b836-3c447cca2e66.5d1e389b-f9b8-4a6b-85f5-7699d97c5827" returned: 0 in 0.833s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:55 devstack sudo[106044]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:55 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ed59b2da-1519-4db6-9a98-03ea28ad7fc4 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-715d38e9-d5e9-45cc-b836-3c447cca2e66.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:55 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f84a488f-9f7d-43c5-ad6c-7f0527c5c18f tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6444dfb8-852a-4472-bc3d-099a8e69db28_huvgt8dfdevstack@QuobyteHD" returned: 1 in 0.938s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:55 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f84a488f-9f7d-43c5-ad6c-7f0527c5c18f tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6444dfb8-852a-4472-bc3d-099a8e69db28_huvgt8dfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 10:25:55 devstack cinder-volume[87234]: DEBUG cinder.image.image_utils [None req-f84a488f-9f7d-43c5-ad6c-7f0527c5c18f tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] 6444dfb8-852a-4472-bc3d-099a8e69db28 was raw, converting to raw {{(pid=87234) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 10:25:55 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f84a488f-9f7d-43c5-ad6c-7f0527c5c18f tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_6444dfb8-852a-4472-bc3d-099a8e69db28_huvgt8dfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-1efa7389-2eea-4e00-842b-fe58f43f97a5 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:55 devstack sudo[106057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-715d38e9-d5e9-45cc-b836-3c447cca2e66.info Jul 10 10:25:55 devstack sudo[106057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:55 devstack sudo[106058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_6444dfb8-852a-4472-bc3d-099a8e69db28_huvgt8dfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-1efa7389-2eea-4e00-842b-fe58f43f97a5 Jul 10 10:25:55 devstack sudo[106058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:55 devstack sudo[106048]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:55 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-00587c09-d8ee-4d7e-9607-0b7a013d832f tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.920s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:55 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-00587c09-d8ee-4d7e-9607-0b7a013d832f tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:25:55 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-00587c09-d8ee-4d7e-9607-0b7a013d832f tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Deleted volume successfully. Jul 10 10:25:55 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-00587c09-d8ee-4d7e-9607-0b7a013d832f tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Lock "cinder-18a80723-6272-47d1-bf7f-f6e0a4b68316-delete_volume" released by "delete_volume" :: held 3.058s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:25:55 devstack sudo[106051]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:55 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-193bfccc-c612-4260-80fc-5b30eead2a0f tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-bfbd1947-bbe3-44d8-9d8f-f243ea048db8" returned: 0 in 1.010s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:55 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-193bfccc-c612-4260-80fc-5b30eead2a0f tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-bfbd1947-bbe3-44d8-9d8f-f243ea048db8 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:55 devstack sudo[106069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-bfbd1947-bbe3-44d8-9d8f-f243ea048db8 Jul 10 10:25:55 devstack sudo[106069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:56 devstack sudo[106058]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f84a488f-9f7d-43c5-ad6c-7f0527c5c18f tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_6444dfb8-852a-4472-bc3d-099a8e69db28_huvgt8dfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-1efa7389-2eea-4e00-842b-fe58f43f97a5" returned: 0 in 0.949s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:56 devstack cinder-volume[87234]: DEBUG cinder.image.image_utils [None req-f84a488f-9f7d-43c5-ad6c-7f0527c5c18f tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6444dfb8-852a-4472-bc3d-099a8e69db28_huvgt8dfdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-1efa7389-2eea-4e00-842b-fe58f43f97a5 {{(pid=87234) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 10:25:56 devstack cinder-volume[87234]: INFO cinder.image.image_utils [None req-f84a488f-9f7d-43c5-ad6c-7f0527c5c18f tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] Converted 0.00 MB image at 0.00 MB/s Jul 10 10:25:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f84a488f-9f7d-43c5-ad6c-7f0527c5c18f tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-1efa7389-2eea-4e00-842b-fe58f43f97a5 1G {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:56 devstack sudo[106072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-1efa7389-2eea-4e00-842b-fe58f43f97a5 1G Jul 10 10:25:56 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:56 devstack sudo[106057]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ed59b2da-1519-4db6-9a98-03ea28ad7fc4 tempest-CreateVolumesFromSnapshotTest-1391512244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-715d38e9-d5e9-45cc-b836-3c447cca2e66.info" returned: 0 in 1.063s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:56 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-ed59b2da-1519-4db6-9a98-03ea28ad7fc4 tempest-CreateVolumesFromSnapshotTest-1391512244 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-715d38e9-d5e9-45cc-b836-3c447cca2e66.info is being set with open permissions: ugo+rw Jul 10 10:25:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ed59b2da-1519-4db6-9a98-03ea28ad7fc4 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-715d38e9-d5e9-45cc-b836-3c447cca2e66.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:56 devstack sudo[106074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-715d38e9-d5e9-45cc-b836-3c447cca2e66.info Jul 10 10:25:56 devstack sudo[106074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:56 devstack sudo[106069]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-193bfccc-c612-4260-80fc-5b30eead2a0f tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-bfbd1947-bbe3-44d8-9d8f-f243ea048db8" returned: 0 in 0.815s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:56 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-193bfccc-c612-4260-80fc-5b30eead2a0f tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Lock "cinder-quobyte-bfbd1947-bbe3-44d8-9d8f-f243ea048db8" released by "delete_volume" :: held 1.880s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:25:56 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-193bfccc-c612-4260-80fc-5b30eead2a0f tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Created reservations ['740ce584-475d-44ad-8042-6d908d1d5bee', '193fb461-7708-4185-9d10-6421c6d3a47e', 'ba6c347d-26f0-4f44-9228-b4cde76000c5', 'fbe3e0b6-2b0b-46e7-a9d5-ebe58c420c3b'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:25:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-193bfccc-c612-4260-80fc-5b30eead2a0f tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:25:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-193bfccc-c612-4260-80fc-5b30eead2a0f tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:25:56 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-193bfccc-c612-4260-80fc-5b30eead2a0f tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:25:56 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-193bfccc-c612-4260-80fc-5b30eead2a0f tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:25:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-193bfccc-c612-4260-80fc-5b30eead2a0f tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:25:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-193bfccc-c612-4260-80fc-5b30eead2a0f tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:56 devstack sudo[106082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:25:56 devstack sudo[106082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:57 devstack sudo[106074]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:57 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ed59b2da-1519-4db6-9a98-03ea28ad7fc4 tempest-CreateVolumesFromSnapshotTest-1391512244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-715d38e9-d5e9-45cc-b836-3c447cca2e66.info" returned: 0 in 0.842s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:57 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-ed59b2da-1519-4db6-9a98-03ea28ad7fc4 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.804s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:25:57 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:57 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-2771f4ff-27a0-407f-a184-0ceb6d8399dc tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Acquiring lock "cinder-c9ba87b4-1660-4b73-b6eb-874bc63c5d38-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:25:57 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f84a488f-9f7d-43c5-ad6c-7f0527c5c18f tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-1efa7389-2eea-4e00-842b-fe58f43f97a5 1G" returned: 0 in 1.013s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:57 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-ed59b2da-1519-4db6-9a98-03ea28ad7fc4 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Create snapshot completed successfully Jul 10 10:25:57 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-2771f4ff-27a0-407f-a184-0ceb6d8399dc tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Lock "cinder-c9ba87b4-1660-4b73-b6eb-874bc63c5d38-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:25:57 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e7ab94f-5c7a-4e6b-bd0f-ba3b6358942d]: (4, 'raw') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:25:57 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f84a488f-9f7d-43c5-ad6c-7f0527c5c18f tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-1efa7389-2eea-4e00-842b-fe58f43f97a5 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:57 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-2771f4ff-27a0-407f-a184-0ceb6d8399dc tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Acquiring lock "cinder-quobyte-c9ba87b4-1660-4b73-b6eb-874bc63c5d38" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:25:57 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-2771f4ff-27a0-407f-a184-0ceb6d8399dc tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Lock "cinder-quobyte-c9ba87b4-1660-4b73-b6eb-874bc63c5d38" acquired by "delete_volume" :: waited 0.023s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:25:57 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c2bfacb-4418-4fa8-a853-ac2b2d6d8c30]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:25:57 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-2771f4ff-27a0-407f-a184-0ceb6d8399dc tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c9ba87b4-1660-4b73-b6eb-874bc63c5d38 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:57 devstack sudo[106084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-1efa7389-2eea-4e00-842b-fe58f43f97a5 Jul 10 10:25:57 devstack sudo[106084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:57 devstack sudo[106085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c9ba87b4-1660-4b73-b6eb-874bc63c5d38 Jul 10 10:25:57 devstack sudo[106085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:57 devstack sudo[106082]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:57 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-193bfccc-c612-4260-80fc-5b30eead2a0f tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.799s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:57 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-193bfccc-c612-4260-80fc-5b30eead2a0f tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:25:57 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-193bfccc-c612-4260-80fc-5b30eead2a0f tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Deleted volume successfully. Jul 10 10:25:57 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-193bfccc-c612-4260-80fc-5b30eead2a0f tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Lock "cinder-bfbd1947-bbe3-44d8-9d8f-f243ea048db8-delete_volume" released by "delete_volume" :: held 3.005s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:25:58 devstack sudo[106084]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f84a488f-9f7d-43c5-ad6c-7f0527c5c18f tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-1efa7389-2eea-4e00-842b-fe58f43f97a5" returned: 0 in 0.945s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f84a488f-9f7d-43c5-ad6c-7f0527c5c18f tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-1efa7389-2eea-4e00-842b-fe58f43f97a5 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:58 devstack sudo[106085]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-2771f4ff-27a0-407f-a184-0ceb6d8399dc tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c9ba87b4-1660-4b73-b6eb-874bc63c5d38" returned: 0 in 0.916s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-2771f4ff-27a0-407f-a184-0ceb6d8399dc tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c9ba87b4-1660-4b73-b6eb-874bc63c5d38 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:58 devstack sudo[106096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c9ba87b4-1660-4b73-b6eb-874bc63c5d38 Jul 10 10:25:58 devstack sudo[106096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:58 devstack sudo[106095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-1efa7389-2eea-4e00-842b-fe58f43f97a5 Jul 10 10:25:58 devstack sudo[106095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:59 devstack sudo[106095]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:59 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f84a488f-9f7d-43c5-ad6c-7f0527c5c18f tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-1efa7389-2eea-4e00-842b-fe58f43f97a5" returned: 1 in 0.957s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:59 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f84a488f-9f7d-43c5-ad6c-7f0527c5c18f tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-1efa7389-2eea-4e00-842b-fe58f43f97a5' failed. Not Retrying. {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 10:25:59 devstack cinder-volume[87234]: DEBUG cinder.volume.volume_utils [None req-f84a488f-9f7d-43c5-ad6c-7f0527c5c18f tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] Downloaded image 6444dfb8-852a-4472-bc3d-099a8e69db28 ((None, [{'url': 'file:///opt/stack/data/glance/images/6444dfb8-852a-4472-bc3d-099a8e69db28', 'metadata': {}}])) to volume 1efa7389-2eea-4e00-842b-fe58f43f97a5 successfully. {{(pid=87234) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 10:25:59 devstack cinder-volume[87234]: DEBUG cinder.image.image_utils [None req-f84a488f-9f7d-43c5-ad6c-7f0527c5c18f tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] Temporary image 6444dfb8-852a-4472-bc3d-099a8e69db28 for user 406e949db1654aadbf446405065f85be is deleted. {{(pid=87234) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 10:25:59 devstack cinder-volume[87234]: DEBUG cinder.volume.volume_utils [None req-f84a488f-9f7d-43c5-ad6c-7f0527c5c18f tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] Marking volume 1efa7389-2eea-4e00-842b-fe58f43f97a5 as bootable. {{(pid=87234) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 10:25:59 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-f84a488f-9f7d-43c5-ad6c-7f0527c5c18f tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] Copying metadata from image 6444dfb8-852a-4472-bc3d-099a8e69db28 to 1efa7389-2eea-4e00-842b-fe58f43f97a5. {{(pid=87234) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 10:25:59 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-f84a488f-9f7d-43c5-ad6c-7f0527c5c18f tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] Creating volume glance metadata for volume 1efa7389-2eea-4e00-842b-fe58f43f97a5 backed by image 6444dfb8-852a-4472-bc3d-099a8e69db28 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '6444dfb8-852a-4472-bc3d-099a8e69db28', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '897d1d418e3f56fda7b59f50c16ca7ff', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87234) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 10:25:59 devstack sudo[106096]: pam_unix(sudo:session): session closed for user root Jul 10 10:25:59 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c179cab-0cb4-4764-9b4e-cd1860749adc tempest-VolumeDependencyTests-448903000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:25:59 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4c179cab-0cb4-4764-9b4e-cd1860749adc tempest-VolumeDependencyTests-448903000 None] Flow 'volume_create_manager' (2de1708e-8e5e-4c4e-9f26-6324eb39333e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:25:59 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4c179cab-0cb4-4764-9b4e-cd1860749adc tempest-VolumeDependencyTests-448903000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0da9cf1-661b-4ba9-8090-e81058dacdd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:59 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4c179cab-0cb4-4764-9b4e-cd1860749adc tempest-VolumeDependencyTests-448903000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0da9cf1-661b-4ba9-8090-e81058dacdd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:25:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1916308865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=034ce50d-a4a2-4925-9299-d4648ea77602,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f91a3417b09a4f6485c26909477081ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:25:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:25:59Z,use_quota=True,user_id='294ad27d4d1c49bbbb504f9ed2ca7b9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:59 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4c179cab-0cb4-4764-9b4e-cd1860749adc tempest-VolumeDependencyTests-448903000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f8ef0be-7c66-46fa-9167-52dbdbed0259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:59 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4c179cab-0cb4-4764-9b4e-cd1860749adc tempest-VolumeDependencyTests-448903000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f8ef0be-7c66-46fa-9167-52dbdbed0259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:59 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4c179cab-0cb4-4764-9b4e-cd1860749adc tempest-VolumeDependencyTests-448903000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f9f5591-011f-4318-b4ca-b5d66f6173bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:59 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4c179cab-0cb4-4764-9b4e-cd1860749adc tempest-VolumeDependencyTests-448903000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f9f5591-011f-4318-b4ca-b5d66f6173bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '034ce50d-a4a2-4925-9299-d4648ea77602', 'volume_name': 'volume-034ce50d-a4a2-4925-9299-d4648ea77602', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:59 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4c179cab-0cb4-4764-9b4e-cd1860749adc tempest-VolumeDependencyTests-448903000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cdaf349-f79e-475f-a75f-5028a3f77171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:59 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4c179cab-0cb4-4764-9b4e-cd1860749adc tempest-VolumeDependencyTests-448903000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cdaf349-f79e-475f-a75f-5028a3f77171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:59 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4c179cab-0cb4-4764-9b4e-cd1860749adc tempest-VolumeDependencyTests-448903000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1923ca80-4b4c-4e75-a943-c11499d156e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:59 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-4c179cab-0cb4-4764-9b4e-cd1860749adc tempest-VolumeDependencyTests-448903000 None] Volume 034ce50d-a4a2-4925-9299-d4648ea77602: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-034ce50d-a4a2-4925-9299-d4648ea77602', 'volume_size': 1} Jul 10 10:25:59 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-4c179cab-0cb4-4764-9b4e-cd1860749adc tempest-VolumeDependencyTests-448903000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:25:59 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-4c179cab-0cb4-4764-9b4e-cd1860749adc tempest-VolumeDependencyTests-448903000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:25:59 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-4c179cab-0cb4-4764-9b4e-cd1860749adc tempest-VolumeDependencyTests-448903000 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:25:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1916308865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=034ce50d-a4a2-4925-9299-d4648ea77602,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f91a3417b09a4f6485c26909477081ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:25:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:25:59Z,use_quota=True,user_id='294ad27d4d1c49bbbb504f9ed2ca7b9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:25:59 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-4c179cab-0cb4-4764-9b4e-cd1860749adc tempest-VolumeDependencyTests-448903000 None] Creating volume 034ce50d-a4a2-4925-9299-d4648ea77602 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:25:59 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-4c179cab-0cb4-4764-9b4e-cd1860749adc tempest-VolumeDependencyTests-448903000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:25:59 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-4c179cab-0cb4-4764-9b4e-cd1860749adc tempest-VolumeDependencyTests-448903000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:25:59 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-4c179cab-0cb4-4764-9b4e-cd1860749adc tempest-VolumeDependencyTests-448903000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:25:59 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-4c179cab-0cb4-4764-9b4e-cd1860749adc tempest-VolumeDependencyTests-448903000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:25:59 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-4c179cab-0cb4-4764-9b4e-cd1860749adc tempest-VolumeDependencyTests-448903000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:25:59 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-4c179cab-0cb4-4764-9b4e-cd1860749adc tempest-VolumeDependencyTests-448903000 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:25:59 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-4c179cab-0cb4-4764-9b4e-cd1860749adc tempest-VolumeDependencyTests-448903000 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:25:59 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4c179cab-0cb4-4764-9b4e-cd1860749adc tempest-VolumeDependencyTests-448903000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-034ce50d-a4a2-4925-9299-d4648ea77602 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:59 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-2771f4ff-27a0-407f-a184-0ceb6d8399dc tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-c9ba87b4-1660-4b73-b6eb-874bc63c5d38" returned: 0 in 1.012s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:25:59 devstack sudo[106107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-034ce50d-a4a2-4925-9299-d4648ea77602 1073741824 Jul 10 10:25:59 devstack sudo[106107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:25:59 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-83764915-7211-4964-94f1-f13bcbd596f8 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:25:59 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-83764915-7211-4964-94f1-f13bcbd596f8 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Flow 'volume_create_manager' (91cb3f1a-ac75-4d1b-9d11-2480cd74c954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:25:59 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-83764915-7211-4964-94f1-f13bcbd596f8 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b7a2742-e72c-4abc-b07a-69669723f3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:59 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-2771f4ff-27a0-407f-a184-0ceb6d8399dc tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Lock "cinder-quobyte-c9ba87b4-1660-4b73-b6eb-874bc63c5d38" released by "delete_volume" :: held 2.041s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:25:59 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-83764915-7211-4964-94f1-f13bcbd596f8 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b7a2742-e72c-4abc-b07a-69669723f3c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:25:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1631092739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed0ccd1b-c5a7-4034-926f-7037d9be22ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c822827c5ee424dbb75caf8e22eea34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:25:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:25:59Z,use_quota=True,user_id='88918e620d724190bac3e76e27b732ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:59 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-83764915-7211-4964-94f1-f13bcbd596f8 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aff2cf44-e68f-4091-a09a-e7e386f16d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:59 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-83764915-7211-4964-94f1-f13bcbd596f8 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aff2cf44-e68f-4091-a09a-e7e386f16d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:59 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-83764915-7211-4964-94f1-f13bcbd596f8 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b014a092-0a18-4797-99c4-34a6086b9e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:59 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-83764915-7211-4964-94f1-f13bcbd596f8 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b014a092-0a18-4797-99c4-34a6086b9e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed0ccd1b-c5a7-4034-926f-7037d9be22ee', 'volume_name': 'volume-ed0ccd1b-c5a7-4034-926f-7037d9be22ee', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:59 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-83764915-7211-4964-94f1-f13bcbd596f8 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9bdba33-0e81-4648-b210-1cece86c3443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:59 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-83764915-7211-4964-94f1-f13bcbd596f8 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9bdba33-0e81-4648-b210-1cece86c3443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:59 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-83764915-7211-4964-94f1-f13bcbd596f8 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48098c58-0a4e-431a-a4bf-cba4b9696a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:59 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-83764915-7211-4964-94f1-f13bcbd596f8 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Volume ed0ccd1b-c5a7-4034-926f-7037d9be22ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed0ccd1b-c5a7-4034-926f-7037d9be22ee', 'volume_size': 1} Jul 10 10:25:59 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-83764915-7211-4964-94f1-f13bcbd596f8 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:25:59 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5662322-557f-4326-8b19-dd2b77640510 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:25:59 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c5662322-557f-4326-8b19-dd2b77640510 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Flow 'volume_create_manager' (23cd607e-07cb-4d18-8b9c-a10aba6c5068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:25:59 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c5662322-557f-4326-8b19-dd2b77640510 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5756f7d7-5fe0-42c8-89dd-5f515ba2fcad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:59 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f84a488f-9f7d-43c5-ad6c-7f0527c5c18f tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f97fa3da-bb02-4b61-b7a0-b2a2eec9a2c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1efa7389-2eea-4e00-842b-fe58f43f97a5', 'volume_size': 1, 'image_id': '6444dfb8-852a-4472-bc3d-099a8e69db28', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6444dfb8-852a-4472-bc3d-099a8e69db28', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '897d1d418e3f56fda7b59f50c16ca7ff', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3dd61292b677493eb06770c25cf013e2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '48c48d41d4ece64cbcf59c0a5c21c926bd15f497023e974a2b79c9977f1a56b0cce9404802e7c0f57cfd9636b0b66f528b18d22b64cd2b5bbd8af746aa9c8e34', 'id': '6444dfb8-852a-4472-bc3d-099a8e69db28', 'created_at': datetime.datetime(2026, 7, 10, 8, 25, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 8, 25, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6444dfb8-852a-4472-bc3d-099a8e69db28/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:59 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f84a488f-9f7d-43c5-ad6c-7f0527c5c18f tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d133d1b-b703-4523-ba13-7bc1e4fcceec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:59 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c5662322-557f-4326-8b19-dd2b77640510 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5756f7d7-5fe0-42c8-89dd-5f515ba2fcad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:25:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1796467566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6601ff64-ebee-4e4d-a4bf-31df47bfceea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c822827c5ee424dbb75caf8e22eea34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:25:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:25:59Z,use_quota=True,user_id='88918e620d724190bac3e76e27b732ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:59 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c5662322-557f-4326-8b19-dd2b77640510 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ad772f2-4932-45f3-b785-20680eddf7ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:59 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c5662322-557f-4326-8b19-dd2b77640510 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ad772f2-4932-45f3-b785-20680eddf7ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:59 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c5662322-557f-4326-8b19-dd2b77640510 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0e2cc42-df87-42c7-8973-231da4a6ee1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:59 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c5662322-557f-4326-8b19-dd2b77640510 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0e2cc42-df87-42c7-8973-231da4a6ee1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6601ff64-ebee-4e4d-a4bf-31df47bfceea', 'volume_name': 'volume-6601ff64-ebee-4e4d-a4bf-31df47bfceea', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:59 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c5662322-557f-4326-8b19-dd2b77640510 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24956320-07a6-416f-8032-e4c97cb7e430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:59 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c5662322-557f-4326-8b19-dd2b77640510 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24956320-07a6-416f-8032-e4c97cb7e430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:59 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c5662322-557f-4326-8b19-dd2b77640510 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d3a0d93-e4ad-4d2d-88e5-4f734f83f102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:59 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-c5662322-557f-4326-8b19-dd2b77640510 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Volume 6601ff64-ebee-4e4d-a4bf-31df47bfceea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6601ff64-ebee-4e4d-a4bf-31df47bfceea', 'volume_size': 1} Jul 10 10:25:59 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-c5662322-557f-4326-8b19-dd2b77640510 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:25:59 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-f84a488f-9f7d-43c5-ad6c-7f0527c5c18f tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] Volume volume-1efa7389-2eea-4e00-842b-fe58f43f97a5 (1efa7389-2eea-4e00-842b-fe58f43f97a5): created successfully Jul 10 10:25:59 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f84a488f-9f7d-43c5-ad6c-7f0527c5c18f tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d133d1b-b703-4523-ba13-7bc1e4fcceec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:59 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f84a488f-9f7d-43c5-ad6c-7f0527c5c18f tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] Flow 'volume_create_manager' (bc7f6115-b3d0-494d-90a9-f872c2b9784f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:25:59 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-2771f4ff-27a0-407f-a184-0ceb6d8399dc tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Created reservations ['770d5053-4fb4-4b07-a31c-b00734a6f6bf', 'ebba37f9-82e6-4511-b455-4a6b0d955230', '7d45cdb2-3b69-437e-9a1c-286fbb8553ab', '0d2bce1e-df23-4455-82fc-0885c61b464d'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:25:59 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-013a5286-77d1-4b2d-bde1-c523aeed565e tempest-CreateVolumesFromSnapshotTest-1391512244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:25:59 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-013a5286-77d1-4b2d-bde1-c523aeed565e tempest-CreateVolumesFromSnapshotTest-1391512244 None] Flow 'volume_create_manager' (e6d94668-8261-4bcc-8fcf-65f0182c69c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:25:59 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-013a5286-77d1-4b2d-bde1-c523aeed565e tempest-CreateVolumesFromSnapshotTest-1391512244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12a11b67-c6a7-4572-a75c-a0cb9238626c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:59 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-f84a488f-9f7d-43c5-ad6c-7f0527c5c18f tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] Created volume successfully. Jul 10 10:25:59 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-013a5286-77d1-4b2d-bde1-c523aeed565e tempest-CreateVolumesFromSnapshotTest-1391512244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12a11b67-c6a7-4572-a75c-a0cb9238626c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:25:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1010157171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b0ec475-cbaa-411b-82fc-2ec73f9d1bda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c822827c5ee424dbb75caf8e22eea34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:26:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:26:00Z,use_quota=True,user_id='88918e620d724190bac3e76e27b732ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:59 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-013a5286-77d1-4b2d-bde1-c523aeed565e tempest-CreateVolumesFromSnapshotTest-1391512244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (335ad2b1-6d56-4c18-968a-c7523ded198b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:59 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-013a5286-77d1-4b2d-bde1-c523aeed565e tempest-CreateVolumesFromSnapshotTest-1391512244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (335ad2b1-6d56-4c18-968a-c7523ded198b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:59 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-013a5286-77d1-4b2d-bde1-c523aeed565e tempest-CreateVolumesFromSnapshotTest-1391512244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2373f9d3-c469-4c24-bd92-b8ee657a801e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:59 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-013a5286-77d1-4b2d-bde1-c523aeed565e tempest-CreateVolumesFromSnapshotTest-1391512244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2373f9d3-c469-4c24-bd92-b8ee657a801e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b0ec475-cbaa-411b-82fc-2ec73f9d1bda', 'volume_name': 'volume-0b0ec475-cbaa-411b-82fc-2ec73f9d1bda', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:59 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-013a5286-77d1-4b2d-bde1-c523aeed565e tempest-CreateVolumesFromSnapshotTest-1391512244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37271c7a-cae0-4cf4-b214-cf33292a70a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:59 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-013a5286-77d1-4b2d-bde1-c523aeed565e tempest-CreateVolumesFromSnapshotTest-1391512244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37271c7a-cae0-4cf4-b214-cf33292a70a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:25:59 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-013a5286-77d1-4b2d-bde1-c523aeed565e tempest-CreateVolumesFromSnapshotTest-1391512244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fd4d018-5a3e-4175-8001-8bbf44e28882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:25:59 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-013a5286-77d1-4b2d-bde1-c523aeed565e tempest-CreateVolumesFromSnapshotTest-1391512244 None] Volume 0b0ec475-cbaa-411b-82fc-2ec73f9d1bda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b0ec475-cbaa-411b-82fc-2ec73f9d1bda', 'volume_size': 1} Jul 10 10:25:59 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-013a5286-77d1-4b2d-bde1-c523aeed565e tempest-CreateVolumesFromSnapshotTest-1391512244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:25:59 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-c02a350f-2f67-4990-ae3f-a1baacdc79fb tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] Acquiring lock "cinder-1efa7389-2eea-4e00-842b-fe58f43f97a5-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:25:59 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-c02a350f-2f67-4990-ae3f-a1baacdc79fb tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] Lock "cinder-1efa7389-2eea-4e00-842b-fe58f43f97a5-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:25:59 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-2771f4ff-27a0-407f-a184-0ceb6d8399dc tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:25:59 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-2771f4ff-27a0-407f-a184-0ceb6d8399dc tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:25:59 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-2771f4ff-27a0-407f-a184-0ceb6d8399dc tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:25:59 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-2771f4ff-27a0-407f-a184-0ceb6d8399dc tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:25:59 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-2771f4ff-27a0-407f-a184-0ceb6d8399dc tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:25:59 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-2771f4ff-27a0-407f-a184-0ceb6d8399dc tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:25:59 devstack sudo[106109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:25:59 devstack sudo[106109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:00 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-c02a350f-2f67-4990-ae3f-a1baacdc79fb tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] Acquiring lock "cinder-quobyte-1efa7389-2eea-4e00-842b-fe58f43f97a5" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:26:00 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-c02a350f-2f67-4990-ae3f-a1baacdc79fb tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] Lock "cinder-quobyte-1efa7389-2eea-4e00-842b-fe58f43f97a5" acquired by "delete_volume" :: waited 0.033s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:26:00 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd09bde-cd46-42ea-9760-e3be5eb23de9]: (4, 'raw') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:26:00 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c02a350f-2f67-4990-ae3f-a1baacdc79fb tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-1efa7389-2eea-4e00-842b-fe58f43f97a5 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:00 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fa2fe16-2457-4a26-ab5f-f0cc1be69152 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:26:00 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3fa2fe16-2457-4a26-ab5f-f0cc1be69152 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Flow 'volume_create_manager' (7ed0addd-e763-46b9-9955-26c51a411880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:26:00 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3fa2fe16-2457-4a26-ab5f-f0cc1be69152 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02fba2e7-8a84-4134-959b-07dcabac0808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:26:00 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3fa2fe16-2457-4a26-ab5f-f0cc1be69152 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02fba2e7-8a84-4134-959b-07dcabac0808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:26:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1005931971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a23d9b0-da8f-4afb-b1f5-784fe43001f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c822827c5ee424dbb75caf8e22eea34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:26:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:26:00Z,use_quota=True,user_id='88918e620d724190bac3e76e27b732ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:26:00 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3fa2fe16-2457-4a26-ab5f-f0cc1be69152 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (432b6d83-5777-4e8f-8956-6ae4adcc6b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:26:00 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3fa2fe16-2457-4a26-ab5f-f0cc1be69152 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (432b6d83-5777-4e8f-8956-6ae4adcc6b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:26:00 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3fa2fe16-2457-4a26-ab5f-f0cc1be69152 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (993aa627-eef9-4e27-8321-c4e717dc596c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:26:00 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3fa2fe16-2457-4a26-ab5f-f0cc1be69152 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (993aa627-eef9-4e27-8321-c4e717dc596c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a23d9b0-da8f-4afb-b1f5-784fe43001f3', 'volume_name': 'volume-7a23d9b0-da8f-4afb-b1f5-784fe43001f3', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:26:00 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3fa2fe16-2457-4a26-ab5f-f0cc1be69152 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c253c3e-2df7-4083-9b1f-94d37463bab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:26:00 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3fa2fe16-2457-4a26-ab5f-f0cc1be69152 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c253c3e-2df7-4083-9b1f-94d37463bab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:26:00 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3fa2fe16-2457-4a26-ab5f-f0cc1be69152 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5326ea1-9767-4426-9796-d97303c07e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:26:00 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-3fa2fe16-2457-4a26-ab5f-f0cc1be69152 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Volume 7a23d9b0-da8f-4afb-b1f5-784fe43001f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a23d9b0-da8f-4afb-b1f5-784fe43001f3', 'volume_size': 1} Jul 10 10:26:00 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-3fa2fe16-2457-4a26-ab5f-f0cc1be69152 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:26:00 devstack sudo[106112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-1efa7389-2eea-4e00-842b-fe58f43f97a5 Jul 10 10:26:00 devstack sudo[106112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:00 devstack sudo[106107]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:00 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4c179cab-0cb4-4764-9b4e-cd1860749adc tempest-VolumeDependencyTests-448903000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-034ce50d-a4a2-4925-9299-d4648ea77602 1073741824" returned: 0 in 1.303s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:00 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b02710a-00e1-4c7d-8d44-4ce4dee138a2 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:26:00 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3b02710a-00e1-4c7d-8d44-4ce4dee138a2 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Flow 'volume_create_manager' (aea8ed41-d4ba-4e9c-8347-b18cc4597fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:26:00 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3b02710a-00e1-4c7d-8d44-4ce4dee138a2 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b950cd77-01ab-4929-be3a-6a137966c40e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:26:00 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3b02710a-00e1-4c7d-8d44-4ce4dee138a2 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b950cd77-01ab-4929-be3a-6a137966c40e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:26:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-452358513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbfe03cf-ebc6-411a-bbdc-2da51e2e03b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c822827c5ee424dbb75caf8e22eea34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:26:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:26:00Z,use_quota=True,user_id='88918e620d724190bac3e76e27b732ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:26:00 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3b02710a-00e1-4c7d-8d44-4ce4dee138a2 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bac7235b-8f1c-4492-a21e-21317be1437f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:26:00 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3b02710a-00e1-4c7d-8d44-4ce4dee138a2 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bac7235b-8f1c-4492-a21e-21317be1437f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:26:00 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3b02710a-00e1-4c7d-8d44-4ce4dee138a2 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76c07c77-157f-4345-b722-2e4dc3f319ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:26:00 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3b02710a-00e1-4c7d-8d44-4ce4dee138a2 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76c07c77-157f-4345-b722-2e4dc3f319ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbfe03cf-ebc6-411a-bbdc-2da51e2e03b4', 'volume_name': 'volume-cbfe03cf-ebc6-411a-bbdc-2da51e2e03b4', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:26:00 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3b02710a-00e1-4c7d-8d44-4ce4dee138a2 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (609d81da-7ce1-4a8d-a427-fabf84b2db14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:26:00 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3b02710a-00e1-4c7d-8d44-4ce4dee138a2 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (609d81da-7ce1-4a8d-a427-fabf84b2db14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:26:00 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3b02710a-00e1-4c7d-8d44-4ce4dee138a2 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (373e8aa8-9c93-41b6-959e-314a830eb680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:26:00 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-3b02710a-00e1-4c7d-8d44-4ce4dee138a2 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Volume cbfe03cf-ebc6-411a-bbdc-2da51e2e03b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbfe03cf-ebc6-411a-bbdc-2da51e2e03b4', 'volume_size': 1} Jul 10 10:26:00 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-3b02710a-00e1-4c7d-8d44-4ce4dee138a2 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:26:00 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4c179cab-0cb4-4764-9b4e-cd1860749adc tempest-VolumeDependencyTests-448903000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-034ce50d-a4a2-4925-9299-d4648ea77602 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:00 devstack sudo[106118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-034ce50d-a4a2-4925-9299-d4648ea77602 Jul 10 10:26:00 devstack sudo[106118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:00 devstack sudo[106109]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:00 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-2771f4ff-27a0-407f-a184-0ceb6d8399dc tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.775s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:00 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-2771f4ff-27a0-407f-a184-0ceb6d8399dc tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:26:00 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-2771f4ff-27a0-407f-a184-0ceb6d8399dc tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Deleted volume successfully. Jul 10 10:26:00 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-2771f4ff-27a0-407f-a184-0ceb6d8399dc tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Lock "cinder-c9ba87b4-1660-4b73-b6eb-874bc63c5d38-delete_volume" released by "delete_volume" :: held 3.594s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:26:00 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-28f24211-e744-4231-8e02-4e053ae3d84f tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Acquiring lock "cinder-4823decc-80d5-4829-b21d-766721004b74-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:26:00 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-28f24211-e744-4231-8e02-4e053ae3d84f tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Lock "cinder-4823decc-80d5-4829-b21d-766721004b74-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:26:00 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-28f24211-e744-4231-8e02-4e053ae3d84f tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Acquiring lock "cinder-quobyte-4823decc-80d5-4829-b21d-766721004b74" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:26:00 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-28f24211-e744-4231-8e02-4e053ae3d84f tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Lock "cinder-quobyte-4823decc-80d5-4829-b21d-766721004b74" acquired by "delete_volume" :: waited 0.017s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:26:00 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b6a53c3-acbe-426d-b6ba-cb471c225f36]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:26:00 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-28f24211-e744-4231-8e02-4e053ae3d84f tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-4823decc-80d5-4829-b21d-766721004b74 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:01 devstack sudo[106120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-4823decc-80d5-4829-b21d-766721004b74 Jul 10 10:26:01 devstack sudo[106120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:01 devstack sudo[106112]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:01 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c02a350f-2f67-4990-ae3f-a1baacdc79fb tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-1efa7389-2eea-4e00-842b-fe58f43f97a5" returned: 0 in 0.987s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:01 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c02a350f-2f67-4990-ae3f-a1baacdc79fb tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-1efa7389-2eea-4e00-842b-fe58f43f97a5 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:01 devstack sudo[106124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-1efa7389-2eea-4e00-842b-fe58f43f97a5 Jul 10 10:26:01 devstack sudo[106124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:01 devstack sudo[106118]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:01 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4c179cab-0cb4-4764-9b4e-cd1860749adc tempest-VolumeDependencyTests-448903000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-034ce50d-a4a2-4925-9299-d4648ea77602" returned: 0 in 0.746s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:01 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-4c179cab-0cb4-4764-9b4e-cd1860749adc tempest-VolumeDependencyTests-448903000 None] <== create_volume: return (2168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:26:01 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-4c179cab-0cb4-4764-9b4e-cd1860749adc tempest-VolumeDependencyTests-448903000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.170s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:26:01 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-83764915-7211-4964-94f1-f13bcbd596f8 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.933s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:26:01 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-83764915-7211-4964-94f1-f13bcbd596f8 tempest-CreateVolumesFromSnapshotTest-1391512244 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:25:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1631092739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed0ccd1b-c5a7-4034-926f-7037d9be22ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c822827c5ee424dbb75caf8e22eea34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:25:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:25:59Z,use_quota=True,user_id='88918e620d724190bac3e76e27b732ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:26:01 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-83764915-7211-4964-94f1-f13bcbd596f8 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Creating volume ed0ccd1b-c5a7-4034-926f-7037d9be22ee {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:26:01 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-83764915-7211-4964-94f1-f13bcbd596f8 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:26:01 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-83764915-7211-4964-94f1-f13bcbd596f8 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:26:01 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-83764915-7211-4964-94f1-f13bcbd596f8 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:26:01 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-83764915-7211-4964-94f1-f13bcbd596f8 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:26:01 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-83764915-7211-4964-94f1-f13bcbd596f8 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:26:01 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-83764915-7211-4964-94f1-f13bcbd596f8 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:26:01 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-83764915-7211-4964-94f1-f13bcbd596f8 tempest-CreateVolumesFromSnapshotTest-1391512244 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:26:01 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-83764915-7211-4964-94f1-f13bcbd596f8 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ed0ccd1b-c5a7-4034-926f-7037d9be22ee 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:01 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4c179cab-0cb4-4764-9b4e-cd1860749adc tempest-VolumeDependencyTests-448903000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1923ca80-4b4c-4e75-a943-c11499d156e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-034ce50d-a4a2-4925-9299-d4648ea77602', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:26:01 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4c179cab-0cb4-4764-9b4e-cd1860749adc tempest-VolumeDependencyTests-448903000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc80b7c5-ee32-42da-b28a-2117fb524d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:26:01 devstack sudo[106127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ed0ccd1b-c5a7-4034-926f-7037d9be22ee 1073741824 Jul 10 10:26:01 devstack sudo[106127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:01 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-4c179cab-0cb4-4764-9b4e-cd1860749adc tempest-VolumeDependencyTests-448903000 None] Volume volume-034ce50d-a4a2-4925-9299-d4648ea77602 (034ce50d-a4a2-4925-9299-d4648ea77602): created successfully Jul 10 10:26:01 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4c179cab-0cb4-4764-9b4e-cd1860749adc tempest-VolumeDependencyTests-448903000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc80b7c5-ee32-42da-b28a-2117fb524d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:26:01 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4c179cab-0cb4-4764-9b4e-cd1860749adc tempest-VolumeDependencyTests-448903000 None] Flow 'volume_create_manager' (2de1708e-8e5e-4c4e-9f26-6324eb39333e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:26:01 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-4c179cab-0cb4-4764-9b4e-cd1860749adc tempest-VolumeDependencyTests-448903000 None] Created volume successfully. Jul 10 10:26:01 devstack sudo[106120]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:01 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-28f24211-e744-4231-8e02-4e053ae3d84f tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-4823decc-80d5-4829-b21d-766721004b74" returned: 0 in 0.812s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:01 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-28f24211-e744-4231-8e02-4e053ae3d84f tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-4823decc-80d5-4829-b21d-766721004b74 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:01 devstack sudo[106132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-4823decc-80d5-4829-b21d-766721004b74 Jul 10 10:26:01 devstack sudo[106132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:02 devstack sudo[106124]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c02a350f-2f67-4990-ae3f-a1baacdc79fb tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-1efa7389-2eea-4e00-842b-fe58f43f97a5" returned: 1 in 0.885s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c02a350f-2f67-4990-ae3f-a1baacdc79fb tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-1efa7389-2eea-4e00-842b-fe58f43f97a5' failed. Not Retrying. {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 10:26:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c02a350f-2f67-4990-ae3f-a1baacdc79fb tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-1efa7389-2eea-4e00-842b-fe58f43f97a5 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:02 devstack sudo[106137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-1efa7389-2eea-4e00-842b-fe58f43f97a5 Jul 10 10:26:02 devstack sudo[106137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-4d13b7bb-329f-418a-941e-ee539453daf6 tempest-VolumeDependencyTests-448903000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:26:02 devstack sudo[106127]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-83764915-7211-4964-94f1-f13bcbd596f8 tempest-CreateVolumesFromSnapshotTest-1391512244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ed0ccd1b-c5a7-4034-926f-7037d9be22ee 1073741824" returned: 0 in 1.012s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-83764915-7211-4964-94f1-f13bcbd596f8 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ed0ccd1b-c5a7-4034-926f-7037d9be22ee {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:02 devstack sudo[106144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ed0ccd1b-c5a7-4034-926f-7037d9be22ee Jul 10 10:26:02 devstack sudo[106144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:02 devstack sudo[106132]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-28f24211-e744-4231-8e02-4e053ae3d84f tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-4823decc-80d5-4829-b21d-766721004b74" returned: 0 in 0.842s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:02 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-28f24211-e744-4231-8e02-4e053ae3d84f tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Lock "cinder-quobyte-4823decc-80d5-4829-b21d-766721004b74" released by "delete_volume" :: held 1.700s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:26:02 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-28f24211-e744-4231-8e02-4e053ae3d84f tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Created reservations ['71019e87-2bb2-4d57-89c8-42c7e5729798', '6d3c12a1-a6d2-4c3e-b422-126db4306489', '973f5185-13ec-45da-802d-96b9c7d0d604', 'f9ae680f-1e16-4bda-866c-3a068327fb5a'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:26:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-28f24211-e744-4231-8e02-4e053ae3d84f tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:26:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-28f24211-e744-4231-8e02-4e053ae3d84f tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:26:02 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-28f24211-e744-4231-8e02-4e053ae3d84f tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:26:02 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-28f24211-e744-4231-8e02-4e053ae3d84f tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:26:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-28f24211-e744-4231-8e02-4e053ae3d84f tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:26:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-28f24211-e744-4231-8e02-4e053ae3d84f tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:02 devstack sudo[106147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:26:02 devstack sudo[106147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:02 devstack sudo[106137]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c02a350f-2f67-4990-ae3f-a1baacdc79fb tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-1efa7389-2eea-4e00-842b-fe58f43f97a5" returned: 0 in 0.742s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:02 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-c02a350f-2f67-4990-ae3f-a1baacdc79fb tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] Lock "cinder-quobyte-1efa7389-2eea-4e00-842b-fe58f43f97a5" released by "delete_volume" :: held 2.717s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:26:02 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-c02a350f-2f67-4990-ae3f-a1baacdc79fb tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] Created reservations ['9924be6e-6b4c-4d40-99f6-00db26e21046', '3b90cd7f-8e27-46a0-b5b4-f819787fe5b4', '64db4582-3ad5-4eae-b992-fa7051e260fb', '18744a83-9c51-4c36-9a6a-42903d0a09e3'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:26:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-c02a350f-2f67-4990-ae3f-a1baacdc79fb tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:26:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-c02a350f-2f67-4990-ae3f-a1baacdc79fb tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:26:02 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-c02a350f-2f67-4990-ae3f-a1baacdc79fb tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:26:02 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-c02a350f-2f67-4990-ae3f-a1baacdc79fb tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:26:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-c02a350f-2f67-4990-ae3f-a1baacdc79fb tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:26:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c02a350f-2f67-4990-ae3f-a1baacdc79fb tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:02 devstack sudo[106149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:26:02 devstack sudo[106149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:03 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-b5b58d3e-d69f-4c4c-aaf4-21c3845e3ec9 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Acquiring lock "cinder-1d4d8ebf-8102-42df-903b-377756eadd41-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:26:03 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-b5b58d3e-d69f-4c4c-aaf4-21c3845e3ec9 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Lock "cinder-1d4d8ebf-8102-42df-903b-377756eadd41-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:26:03 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-b5b58d3e-d69f-4c4c-aaf4-21c3845e3ec9 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Acquiring lock "cinder-quobyte-1d4d8ebf-8102-42df-903b-377756eadd41" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:26:03 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-b5b58d3e-d69f-4c4c-aaf4-21c3845e3ec9 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Lock "cinder-quobyte-1d4d8ebf-8102-42df-903b-377756eadd41" acquired by "delete_volume" :: waited 0.037s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:26:03 devstack sudo[106144]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-83764915-7211-4964-94f1-f13bcbd596f8 tempest-CreateVolumesFromSnapshotTest-1391512244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ed0ccd1b-c5a7-4034-926f-7037d9be22ee" returned: 0 in 0.805s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:03 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-83764915-7211-4964-94f1-f13bcbd596f8 tempest-CreateVolumesFromSnapshotTest-1391512244 None] <== create_volume: return (1865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:26:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-83764915-7211-4964-94f1-f13bcbd596f8 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.869s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:26:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-c5662322-557f-4326-8b19-dd2b77640510 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.593s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:26:03 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-c5662322-557f-4326-8b19-dd2b77640510 tempest-CreateVolumesFromSnapshotTest-1391512244 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:25:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1796467566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6601ff64-ebee-4e4d-a4bf-31df47bfceea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c822827c5ee424dbb75caf8e22eea34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:25:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:25:59Z,use_quota=True,user_id='88918e620d724190bac3e76e27b732ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:26:03 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-c5662322-557f-4326-8b19-dd2b77640510 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Creating volume 6601ff64-ebee-4e4d-a4bf-31df47bfceea {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:26:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-c5662322-557f-4326-8b19-dd2b77640510 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:26:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-c5662322-557f-4326-8b19-dd2b77640510 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:26:03 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-c5662322-557f-4326-8b19-dd2b77640510 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:26:03 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-c5662322-557f-4326-8b19-dd2b77640510 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:26:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-c5662322-557f-4326-8b19-dd2b77640510 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:26:03 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-c5662322-557f-4326-8b19-dd2b77640510 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:26:03 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-c5662322-557f-4326-8b19-dd2b77640510 tempest-CreateVolumesFromSnapshotTest-1391512244 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:26:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c5662322-557f-4326-8b19-dd2b77640510 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-6601ff64-ebee-4e4d-a4bf-31df47bfceea 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:03 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0affec8-baef-437a-a847-4e81ad1eb17c]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:26:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-b5b58d3e-d69f-4c4c-aaf4-21c3845e3ec9 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-1d4d8ebf-8102-42df-903b-377756eadd41 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:03 devstack sudo[106152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-6601ff64-ebee-4e4d-a4bf-31df47bfceea 1073741824 Jul 10 10:26:03 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-83764915-7211-4964-94f1-f13bcbd596f8 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48098c58-0a4e-431a-a4bf-cba4b9696a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed0ccd1b-c5a7-4034-926f-7037d9be22ee', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:26:03 devstack sudo[106152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:03 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-83764915-7211-4964-94f1-f13bcbd596f8 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (760fc940-0473-4c3c-998d-034bca5b938b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:26:03 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-83764915-7211-4964-94f1-f13bcbd596f8 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Volume volume-ed0ccd1b-c5a7-4034-926f-7037d9be22ee (ed0ccd1b-c5a7-4034-926f-7037d9be22ee): created successfully Jul 10 10:26:03 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-83764915-7211-4964-94f1-f13bcbd596f8 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (760fc940-0473-4c3c-998d-034bca5b938b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:26:03 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-83764915-7211-4964-94f1-f13bcbd596f8 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Flow 'volume_create_manager' (91cb3f1a-ac75-4d1b-9d11-2480cd74c954) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:26:03 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-83764915-7211-4964-94f1-f13bcbd596f8 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Created volume successfully. Jul 10 10:26:03 devstack sudo[106153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-1d4d8ebf-8102-42df-903b-377756eadd41 Jul 10 10:26:03 devstack sudo[106153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:03 devstack sudo[106147]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-28f24211-e744-4231-8e02-4e053ae3d84f tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.888s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:03 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-28f24211-e744-4231-8e02-4e053ae3d84f tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:26:03 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-28f24211-e744-4231-8e02-4e053ae3d84f tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Deleted volume successfully. Jul 10 10:26:03 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-28f24211-e744-4231-8e02-4e053ae3d84f tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Lock "cinder-4823decc-80d5-4829-b21d-766721004b74-delete_volume" released by "delete_volume" :: held 2.822s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:26:03 devstack sudo[106149]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c02a350f-2f67-4990-ae3f-a1baacdc79fb tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.938s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:03 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-c02a350f-2f67-4990-ae3f-a1baacdc79fb tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:26:03 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-c02a350f-2f67-4990-ae3f-a1baacdc79fb tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] Deleted volume successfully. Jul 10 10:26:03 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-c02a350f-2f67-4990-ae3f-a1baacdc79fb tempest-VolumeAndVolumeTypeFromImageTest-1659348634 None] Lock "cinder-1efa7389-2eea-4e00-842b-fe58f43f97a5-delete_volume" released by "delete_volume" :: held 3.966s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:26:04 devstack sudo[106152]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c5662322-557f-4326-8b19-dd2b77640510 tempest-CreateVolumesFromSnapshotTest-1391512244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-6601ff64-ebee-4e4d-a4bf-31df47bfceea 1073741824" returned: 0 in 1.070s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:04 devstack sudo[106153]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-b5b58d3e-d69f-4c4c-aaf4-21c3845e3ec9 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-1d4d8ebf-8102-42df-903b-377756eadd41" returned: 0 in 1.062s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-b5b58d3e-d69f-4c4c-aaf4-21c3845e3ec9 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-1d4d8ebf-8102-42df-903b-377756eadd41 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:04 devstack sudo[106165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-1d4d8ebf-8102-42df-903b-377756eadd41 Jul 10 10:26:04 devstack sudo[106165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c5662322-557f-4326-8b19-dd2b77640510 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-6601ff64-ebee-4e4d-a4bf-31df47bfceea {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:04 devstack sudo[106167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-6601ff64-ebee-4e4d-a4bf-31df47bfceea Jul 10 10:26:04 devstack sudo[106167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:05 devstack sudo[106165]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-b5b58d3e-d69f-4c4c-aaf4-21c3845e3ec9 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-1d4d8ebf-8102-42df-903b-377756eadd41" returned: 0 in 0.681s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:05 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-b5b58d3e-d69f-4c4c-aaf4-21c3845e3ec9 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Lock "cinder-quobyte-1d4d8ebf-8102-42df-903b-377756eadd41" released by "delete_volume" :: held 1.854s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:26:05 devstack sudo[106167]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:05 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-b5b58d3e-d69f-4c4c-aaf4-21c3845e3ec9 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Created reservations ['74bd61d6-f6f5-4ba8-a2f9-8f60ce8035ac', '17ca100e-00e2-484f-9304-cc7f474f3b3c', '562c7685-54f4-4769-bf27-cabe0f60ea26', '45ab20e8-2121-48e4-b83a-946e63dcaada'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:26:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-c5662322-557f-4326-8b19-dd2b77640510 tempest-CreateVolumesFromSnapshotTest-1391512244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-6601ff64-ebee-4e4d-a4bf-31df47bfceea" returned: 0 in 0.721s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:05 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-c5662322-557f-4326-8b19-dd2b77640510 tempest-CreateVolumesFromSnapshotTest-1391512244 None] <== create_volume: return (1854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:26:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-c5662322-557f-4326-8b19-dd2b77640510 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.860s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:26:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-013a5286-77d1-4b2d-bde1-c523aeed565e tempest-CreateVolumesFromSnapshotTest-1391512244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.311s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:26:05 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-013a5286-77d1-4b2d-bde1-c523aeed565e tempest-CreateVolumesFromSnapshotTest-1391512244 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:25:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1010157171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b0ec475-cbaa-411b-82fc-2ec73f9d1bda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c822827c5ee424dbb75caf8e22eea34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:26:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:26:00Z,use_quota=True,user_id='88918e620d724190bac3e76e27b732ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:26:05 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-013a5286-77d1-4b2d-bde1-c523aeed565e tempest-CreateVolumesFromSnapshotTest-1391512244 None] Creating volume 0b0ec475-cbaa-411b-82fc-2ec73f9d1bda {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:26:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-013a5286-77d1-4b2d-bde1-c523aeed565e tempest-CreateVolumesFromSnapshotTest-1391512244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:26:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-013a5286-77d1-4b2d-bde1-c523aeed565e tempest-CreateVolumesFromSnapshotTest-1391512244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:26:05 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-013a5286-77d1-4b2d-bde1-c523aeed565e tempest-CreateVolumesFromSnapshotTest-1391512244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:26:05 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-013a5286-77d1-4b2d-bde1-c523aeed565e tempest-CreateVolumesFromSnapshotTest-1391512244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:26:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-013a5286-77d1-4b2d-bde1-c523aeed565e tempest-CreateVolumesFromSnapshotTest-1391512244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:26:05 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-013a5286-77d1-4b2d-bde1-c523aeed565e tempest-CreateVolumesFromSnapshotTest-1391512244 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:26:05 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-013a5286-77d1-4b2d-bde1-c523aeed565e tempest-CreateVolumesFromSnapshotTest-1391512244 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:26:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-013a5286-77d1-4b2d-bde1-c523aeed565e tempest-CreateVolumesFromSnapshotTest-1391512244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0b0ec475-cbaa-411b-82fc-2ec73f9d1bda 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:05 devstack sudo[106171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0b0ec475-cbaa-411b-82fc-2ec73f9d1bda 1073741824 Jul 10 10:26:05 devstack sudo[106171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:05 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c5662322-557f-4326-8b19-dd2b77640510 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d3a0d93-e4ad-4d2d-88e5-4f734f83f102) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6601ff64-ebee-4e4d-a4bf-31df47bfceea', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:26:05 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c5662322-557f-4326-8b19-dd2b77640510 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8606d707-b812-499d-8671-f74cddb098a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:26:05 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-c5662322-557f-4326-8b19-dd2b77640510 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Volume volume-6601ff64-ebee-4e4d-a4bf-31df47bfceea (6601ff64-ebee-4e4d-a4bf-31df47bfceea): created successfully Jul 10 10:26:05 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c5662322-557f-4326-8b19-dd2b77640510 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8606d707-b812-499d-8671-f74cddb098a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:26:05 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-c5662322-557f-4326-8b19-dd2b77640510 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Flow 'volume_create_manager' (23cd607e-07cb-4d18-8b9c-a10aba6c5068) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:26:05 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-c5662322-557f-4326-8b19-dd2b77640510 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Created volume successfully. Jul 10 10:26:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-b5b58d3e-d69f-4c4c-aaf4-21c3845e3ec9 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:26:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-b5b58d3e-d69f-4c4c-aaf4-21c3845e3ec9 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:26:05 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-b5b58d3e-d69f-4c4c-aaf4-21c3845e3ec9 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:26:05 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-b5b58d3e-d69f-4c4c-aaf4-21c3845e3ec9 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:26:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-b5b58d3e-d69f-4c4c-aaf4-21c3845e3ec9 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:26:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-b5b58d3e-d69f-4c4c-aaf4-21c3845e3ec9 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:05 devstack sudo[106173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:26:05 devstack sudo[106173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:06 devstack sudo[106173]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-b5b58d3e-d69f-4c4c-aaf4-21c3845e3ec9 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.864s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:06 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-b5b58d3e-d69f-4c4c-aaf4-21c3845e3ec9 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:26:06 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-b5b58d3e-d69f-4c4c-aaf4-21c3845e3ec9 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Deleted volume successfully. Jul 10 10:26:06 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-b5b58d3e-d69f-4c4c-aaf4-21c3845e3ec9 tempest-CreateVolumesFromSourceVolumeTest-1513016215 None] Lock "cinder-1d4d8ebf-8102-42df-903b-377756eadd41-delete_volume" released by "delete_volume" :: held 3.075s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:26:06 devstack sudo[106171]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-013a5286-77d1-4b2d-bde1-c523aeed565e tempest-CreateVolumesFromSnapshotTest-1391512244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0b0ec475-cbaa-411b-82fc-2ec73f9d1bda 1073741824" returned: 0 in 1.148s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-013a5286-77d1-4b2d-bde1-c523aeed565e tempest-CreateVolumesFromSnapshotTest-1391512244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0b0ec475-cbaa-411b-82fc-2ec73f9d1bda {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:06 devstack sudo[106179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0b0ec475-cbaa-411b-82fc-2ec73f9d1bda Jul 10 10:26:06 devstack sudo[106179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:07 devstack sudo[106179]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-013a5286-77d1-4b2d-bde1-c523aeed565e tempest-CreateVolumesFromSnapshotTest-1391512244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0b0ec475-cbaa-411b-82fc-2ec73f9d1bda" returned: 0 in 0.781s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:07 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-013a5286-77d1-4b2d-bde1-c523aeed565e tempest-CreateVolumesFromSnapshotTest-1391512244 None] <== create_volume: return (1988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:26:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-013a5286-77d1-4b2d-bde1-c523aeed565e tempest-CreateVolumesFromSnapshotTest-1391512244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.992s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:26:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-3fa2fe16-2457-4a26-ab5f-f0cc1be69152 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.807s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:26:07 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-3fa2fe16-2457-4a26-ab5f-f0cc1be69152 tempest-CreateVolumesFromSnapshotTest-1391512244 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:26:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1005931971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a23d9b0-da8f-4afb-b1f5-784fe43001f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c822827c5ee424dbb75caf8e22eea34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:26:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:26:00Z,use_quota=True,user_id='88918e620d724190bac3e76e27b732ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:26:07 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-3fa2fe16-2457-4a26-ab5f-f0cc1be69152 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Creating volume 7a23d9b0-da8f-4afb-b1f5-784fe43001f3 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:26:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-3fa2fe16-2457-4a26-ab5f-f0cc1be69152 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:26:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-3fa2fe16-2457-4a26-ab5f-f0cc1be69152 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:26:07 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-3fa2fe16-2457-4a26-ab5f-f0cc1be69152 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:26:07 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-3fa2fe16-2457-4a26-ab5f-f0cc1be69152 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:26:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-3fa2fe16-2457-4a26-ab5f-f0cc1be69152 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:26:07 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-3fa2fe16-2457-4a26-ab5f-f0cc1be69152 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:26:07 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-3fa2fe16-2457-4a26-ab5f-f0cc1be69152 tempest-CreateVolumesFromSnapshotTest-1391512244 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:26:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3fa2fe16-2457-4a26-ab5f-f0cc1be69152 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7a23d9b0-da8f-4afb-b1f5-784fe43001f3 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:07 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-013a5286-77d1-4b2d-bde1-c523aeed565e tempest-CreateVolumesFromSnapshotTest-1391512244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fd4d018-5a3e-4175-8001-8bbf44e28882) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b0ec475-cbaa-411b-82fc-2ec73f9d1bda', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:26:07 devstack sudo[106183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7a23d9b0-da8f-4afb-b1f5-784fe43001f3 1073741824 Jul 10 10:26:07 devstack sudo[106183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:07 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-013a5286-77d1-4b2d-bde1-c523aeed565e tempest-CreateVolumesFromSnapshotTest-1391512244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90a87377-c117-4dd6-8b51-9caf50bd02f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:26:07 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-013a5286-77d1-4b2d-bde1-c523aeed565e tempest-CreateVolumesFromSnapshotTest-1391512244 None] Volume volume-0b0ec475-cbaa-411b-82fc-2ec73f9d1bda (0b0ec475-cbaa-411b-82fc-2ec73f9d1bda): created successfully Jul 10 10:26:07 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-013a5286-77d1-4b2d-bde1-c523aeed565e tempest-CreateVolumesFromSnapshotTest-1391512244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90a87377-c117-4dd6-8b51-9caf50bd02f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:26:07 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-013a5286-77d1-4b2d-bde1-c523aeed565e tempest-CreateVolumesFromSnapshotTest-1391512244 None] Flow 'volume_create_manager' (e6d94668-8261-4bcc-8fcf-65f0182c69c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:26:07 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-013a5286-77d1-4b2d-bde1-c523aeed565e tempest-CreateVolumesFromSnapshotTest-1391512244 None] Created volume successfully. Jul 10 10:26:08 devstack sudo[106183]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:08 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3fa2fe16-2457-4a26-ab5f-f0cc1be69152 tempest-CreateVolumesFromSnapshotTest-1391512244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7a23d9b0-da8f-4afb-b1f5-784fe43001f3 1073741824" returned: 0 in 0.981s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:08 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3fa2fe16-2457-4a26-ab5f-f0cc1be69152 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7a23d9b0-da8f-4afb-b1f5-784fe43001f3 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:08 devstack sudo[106190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7a23d9b0-da8f-4afb-b1f5-784fe43001f3 Jul 10 10:26:08 devstack sudo[106190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:08 devstack sudo[106190]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:08 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3fa2fe16-2457-4a26-ab5f-f0cc1be69152 tempest-CreateVolumesFromSnapshotTest-1391512244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7a23d9b0-da8f-4afb-b1f5-784fe43001f3" returned: 0 in 0.700s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:08 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-3fa2fe16-2457-4a26-ab5f-f0cc1be69152 tempest-CreateVolumesFromSnapshotTest-1391512244 None] <== create_volume: return (1738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:26:08 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-3fa2fe16-2457-4a26-ab5f-f0cc1be69152 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.741s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:26:08 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-3b02710a-00e1-4c7d-8d44-4ce4dee138a2 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.239s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:26:08 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-3b02710a-00e1-4c7d-8d44-4ce4dee138a2 tempest-CreateVolumesFromSnapshotTest-1391512244 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:26:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-452358513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbfe03cf-ebc6-411a-bbdc-2da51e2e03b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c822827c5ee424dbb75caf8e22eea34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:26:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:26:00Z,use_quota=True,user_id='88918e620d724190bac3e76e27b732ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:26:08 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-3b02710a-00e1-4c7d-8d44-4ce4dee138a2 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Creating volume cbfe03cf-ebc6-411a-bbdc-2da51e2e03b4 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:26:08 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-3b02710a-00e1-4c7d-8d44-4ce4dee138a2 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:26:08 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-3b02710a-00e1-4c7d-8d44-4ce4dee138a2 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:26:08 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-3b02710a-00e1-4c7d-8d44-4ce4dee138a2 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:26:08 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-3b02710a-00e1-4c7d-8d44-4ce4dee138a2 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:26:08 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-3b02710a-00e1-4c7d-8d44-4ce4dee138a2 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:26:08 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-3b02710a-00e1-4c7d-8d44-4ce4dee138a2 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:26:08 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-3b02710a-00e1-4c7d-8d44-4ce4dee138a2 tempest-CreateVolumesFromSnapshotTest-1391512244 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:26:08 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3b02710a-00e1-4c7d-8d44-4ce4dee138a2 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-cbfe03cf-ebc6-411a-bbdc-2da51e2e03b4 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:08 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3fa2fe16-2457-4a26-ab5f-f0cc1be69152 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5326ea1-9767-4426-9796-d97303c07e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a23d9b0-da8f-4afb-b1f5-784fe43001f3', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:26:08 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3fa2fe16-2457-4a26-ab5f-f0cc1be69152 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59982a9a-8905-4f9a-b68f-a94f16f5c0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:26:08 devstack sudo[106193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-cbfe03cf-ebc6-411a-bbdc-2da51e2e03b4 1073741824 Jul 10 10:26:08 devstack sudo[106193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:08 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-3fa2fe16-2457-4a26-ab5f-f0cc1be69152 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Volume volume-7a23d9b0-da8f-4afb-b1f5-784fe43001f3 (7a23d9b0-da8f-4afb-b1f5-784fe43001f3): created successfully Jul 10 10:26:08 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3fa2fe16-2457-4a26-ab5f-f0cc1be69152 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59982a9a-8905-4f9a-b68f-a94f16f5c0ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:26:08 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3fa2fe16-2457-4a26-ab5f-f0cc1be69152 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Flow 'volume_create_manager' (7ed0addd-e763-46b9-9955-26c51a411880) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:26:08 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-3fa2fe16-2457-4a26-ab5f-f0cc1be69152 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Created volume successfully. Jul 10 10:26:09 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-5efc01ad-8236-44b5-99b0-ef32ecf44499 tempest-CinderUnicodeTest-1860234538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:26:09 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5efc01ad-8236-44b5-99b0-ef32ecf44499 tempest-CinderUnicodeTest-1860234538 None] Flow 'volume_create_manager' (d31a13ec-de2d-4eda-a1df-56cc002ea6f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:26:09 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5efc01ad-8236-44b5-99b0-ef32ecf44499 tempest-CinderUnicodeTest-1860234538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d86cac5b-7b47-4b27-9916-322df72b0f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:26:09 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5efc01ad-8236-44b5-99b0-ef32ecf44499 tempest-CinderUnicodeTest-1860234538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d86cac5b-7b47-4b27-9916-322df72b0f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:26:09Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b02b661d-db5a-4cc1-8dc1-6d6bbdefafc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1de8c217e88344058fbbb70fa368ea53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:26:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:26:09Z,use_quota=True,user_id='fc81c4caa48441efa52239fc2b9ae3f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:26:09 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5efc01ad-8236-44b5-99b0-ef32ecf44499 tempest-CinderUnicodeTest-1860234538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f22112c-141b-45b9-81f5-2e980daa731c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:26:09 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5efc01ad-8236-44b5-99b0-ef32ecf44499 tempest-CinderUnicodeTest-1860234538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f22112c-141b-45b9-81f5-2e980daa731c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:26:09 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5efc01ad-8236-44b5-99b0-ef32ecf44499 tempest-CinderUnicodeTest-1860234538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d82300f1-afa2-4589-a771-c67d34972454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:26:09 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5efc01ad-8236-44b5-99b0-ef32ecf44499 tempest-CinderUnicodeTest-1860234538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d82300f1-afa2-4589-a771-c67d34972454) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b02b661d-db5a-4cc1-8dc1-6d6bbdefafc9', 'volume_name': 'volume-b02b661d-db5a-4cc1-8dc1-6d6bbdefafc9', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:26:09 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5efc01ad-8236-44b5-99b0-ef32ecf44499 tempest-CinderUnicodeTest-1860234538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f2fb105-314f-4c4c-8c86-271ae60c0517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:26:09 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5efc01ad-8236-44b5-99b0-ef32ecf44499 tempest-CinderUnicodeTest-1860234538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f2fb105-314f-4c4c-8c86-271ae60c0517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:26:09 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5efc01ad-8236-44b5-99b0-ef32ecf44499 tempest-CinderUnicodeTest-1860234538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (940b7b6a-e956-4c23-b2fa-d57c9cb8e823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:26:09 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-5efc01ad-8236-44b5-99b0-ef32ecf44499 tempest-CinderUnicodeTest-1860234538 None] Volume b02b661d-db5a-4cc1-8dc1-6d6bbdefafc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b02b661d-db5a-4cc1-8dc1-6d6bbdefafc9', 'volume_size': 1} Jul 10 10:26:09 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-5efc01ad-8236-44b5-99b0-ef32ecf44499 tempest-CinderUnicodeTest-1860234538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:26:09 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-4aa4e2ae-df4f-4210-9200-8b40e3fd1674 tempest-ProjectReaderTests-901478856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:26:09 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4aa4e2ae-df4f-4210-9200-8b40e3fd1674 tempest-ProjectReaderTests-901478856 None] Flow 'volume_create_manager' (6e1e24e9-53dd-4061-80c9-a03936848d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:26:09 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4aa4e2ae-df4f-4210-9200-8b40e3fd1674 tempest-ProjectReaderTests-901478856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6f2aba9-a88a-4b59-b89d-38b9013c3771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:26:09 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4aa4e2ae-df4f-4210-9200-8b40e3fd1674 tempest-ProjectReaderTests-901478856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6f2aba9-a88a-4b59-b89d-38b9013c3771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:26:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2055620166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b31bf35-687d-4a1f-b25e-009637e8e71e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3ae08cf4bfc42e782558d8b9e55b009',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:26:10Z,use_quota=True,user_id='9b37d3c824f343e387285d0cddc1aa8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:26:09 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4aa4e2ae-df4f-4210-9200-8b40e3fd1674 tempest-ProjectReaderTests-901478856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6894dd61-13c8-4268-a645-91c811b5d9a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:26:09 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4aa4e2ae-df4f-4210-9200-8b40e3fd1674 tempest-ProjectReaderTests-901478856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6894dd61-13c8-4268-a645-91c811b5d9a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:26:09 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4aa4e2ae-df4f-4210-9200-8b40e3fd1674 tempest-ProjectReaderTests-901478856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f7ae372-709f-41e3-bba1-8633bdf603ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:26:09 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4aa4e2ae-df4f-4210-9200-8b40e3fd1674 tempest-ProjectReaderTests-901478856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f7ae372-709f-41e3-bba1-8633bdf603ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b31bf35-687d-4a1f-b25e-009637e8e71e', 'volume_name': 'volume-2b31bf35-687d-4a1f-b25e-009637e8e71e', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:26:09 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4aa4e2ae-df4f-4210-9200-8b40e3fd1674 tempest-ProjectReaderTests-901478856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2476a65d-52c2-49af-a6f9-d84cd6fe09d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:26:09 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4aa4e2ae-df4f-4210-9200-8b40e3fd1674 tempest-ProjectReaderTests-901478856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2476a65d-52c2-49af-a6f9-d84cd6fe09d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:26:09 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4aa4e2ae-df4f-4210-9200-8b40e3fd1674 tempest-ProjectReaderTests-901478856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2abb971b-f673-4db2-9b2c-acb28b64e8ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:26:09 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-4aa4e2ae-df4f-4210-9200-8b40e3fd1674 tempest-ProjectReaderTests-901478856 None] Volume 2b31bf35-687d-4a1f-b25e-009637e8e71e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b31bf35-687d-4a1f-b25e-009637e8e71e', 'volume_size': 1} Jul 10 10:26:09 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-4aa4e2ae-df4f-4210-9200-8b40e3fd1674 tempest-ProjectReaderTests-901478856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:26:09 devstack sudo[106193]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:09 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3b02710a-00e1-4c7d-8d44-4ce4dee138a2 tempest-CreateVolumesFromSnapshotTest-1391512244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-cbfe03cf-ebc6-411a-bbdc-2da51e2e03b4 1073741824" returned: 0 in 0.950s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:09 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3b02710a-00e1-4c7d-8d44-4ce4dee138a2 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-cbfe03cf-ebc6-411a-bbdc-2da51e2e03b4 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:09 devstack sudo[106199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-cbfe03cf-ebc6-411a-bbdc-2da51e2e03b4 Jul 10 10:26:09 devstack sudo[106199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:10 devstack sudo[106199]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:10 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3b02710a-00e1-4c7d-8d44-4ce4dee138a2 tempest-CreateVolumesFromSnapshotTest-1391512244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-cbfe03cf-ebc6-411a-bbdc-2da51e2e03b4" returned: 0 in 0.662s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:10 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-3b02710a-00e1-4c7d-8d44-4ce4dee138a2 tempest-CreateVolumesFromSnapshotTest-1391512244 None] <== create_volume: return (1651ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:26:10 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-3b02710a-00e1-4c7d-8d44-4ce4dee138a2 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.655s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:26:10 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-4d13b7bb-329f-418a-941e-ee539453daf6 tempest-VolumeDependencyTests-448903000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.311s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:26:10 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-4d13b7bb-329f-418a-941e-ee539453daf6 tempest-VolumeDependencyTests-448903000 None] Creating offline snapshot 77943c84-2d65-40d4-8b99-b14b998cfd4b of volume 034ce50d-a4a2-4925-9299-d4648ea77602 {{(pid=87234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 10:26:10 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3b02710a-00e1-4c7d-8d44-4ce4dee138a2 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (373e8aa8-9c93-41b6-959e-314a830eb680) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbfe03cf-ebc6-411a-bbdc-2da51e2e03b4', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:26:10 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3b02710a-00e1-4c7d-8d44-4ce4dee138a2 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99f9fc5f-715f-441f-b41e-4e99745ee2eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:26:10 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a60407b-1014-4403-8508-a0460c8cb721]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:26:10 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4d13b7bb-329f-418a-941e-ee539453daf6 tempest-VolumeDependencyTests-448903000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-034ce50d-a4a2-4925-9299-d4648ea77602 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:10 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-3b02710a-00e1-4c7d-8d44-4ce4dee138a2 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Volume volume-cbfe03cf-ebc6-411a-bbdc-2da51e2e03b4 (cbfe03cf-ebc6-411a-bbdc-2da51e2e03b4): created successfully Jul 10 10:26:10 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3b02710a-00e1-4c7d-8d44-4ce4dee138a2 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99f9fc5f-715f-441f-b41e-4e99745ee2eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:26:10 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3b02710a-00e1-4c7d-8d44-4ce4dee138a2 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Flow 'volume_create_manager' (aea8ed41-d4ba-4e9c-8347-b18cc4597fc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:26:10 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-3b02710a-00e1-4c7d-8d44-4ce4dee138a2 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Created volume successfully. Jul 10 10:26:10 devstack sudo[106202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-034ce50d-a4a2-4925-9299-d4648ea77602 Jul 10 10:26:10 devstack sudo[106202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:11 devstack sudo[106202]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:11 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4d13b7bb-329f-418a-941e-ee539453daf6 tempest-VolumeDependencyTests-448903000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-034ce50d-a4a2-4925-9299-d4648ea77602" returned: 0 in 0.782s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:11 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4d13b7bb-329f-418a-941e-ee539453daf6 tempest-VolumeDependencyTests-448903000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-034ce50d-a4a2-4925-9299-d4648ea77602,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-034ce50d-a4a2-4925-9299-d4648ea77602.77943c84-2d65-40d4-8b99-b14b998cfd4b 1G {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:11 devstack sudo[106207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-034ce50d-a4a2-4925-9299-d4648ea77602,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-034ce50d-a4a2-4925-9299-d4648ea77602.77943c84-2d65-40d4-8b99-b14b998cfd4b 1G Jul 10 10:26:11 devstack sudo[106207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:11 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-1f5e2b33-18f0-43ab-9c2b-cf035cf66de4 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Acquiring lock "cinder-cbfe03cf-ebc6-411a-bbdc-2da51e2e03b4-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:26:11 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-1f5e2b33-18f0-43ab-9c2b-cf035cf66de4 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Lock "cinder-cbfe03cf-ebc6-411a-bbdc-2da51e2e03b4-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:26:11 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-1f5e2b33-18f0-43ab-9c2b-cf035cf66de4 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Acquiring lock "cinder-quobyte-cbfe03cf-ebc6-411a-bbdc-2da51e2e03b4" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:26:11 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-1f5e2b33-18f0-43ab-9c2b-cf035cf66de4 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Lock "cinder-quobyte-cbfe03cf-ebc6-411a-bbdc-2da51e2e03b4" acquired by "delete_volume" :: waited 0.015s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:26:11 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d5f144-fdc5-4322-b1e0-cfc8981ab92f]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:26:11 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1f5e2b33-18f0-43ab-9c2b-cf035cf66de4 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-cbfe03cf-ebc6-411a-bbdc-2da51e2e03b4 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:11 devstack sudo[106209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-cbfe03cf-ebc6-411a-bbdc-2da51e2e03b4 Jul 10 10:26:11 devstack sudo[106209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:12 devstack sudo[106207]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4d13b7bb-329f-418a-941e-ee539453daf6 tempest-VolumeDependencyTests-448903000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-034ce50d-a4a2-4925-9299-d4648ea77602,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-034ce50d-a4a2-4925-9299-d4648ea77602.77943c84-2d65-40d4-8b99-b14b998cfd4b 1G" returned: 0 in 0.850s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4d13b7bb-329f-418a-941e-ee539453daf6 tempest-VolumeDependencyTests-448903000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-034ce50d-a4a2-4925-9299-d4648ea77602 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-034ce50d-a4a2-4925-9299-d4648ea77602.77943c84-2d65-40d4-8b99-b14b998cfd4b {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:12 devstack sudo[106214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-034ce50d-a4a2-4925-9299-d4648ea77602 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-034ce50d-a4a2-4925-9299-d4648ea77602.77943c84-2d65-40d4-8b99-b14b998cfd4b Jul 10 10:26:12 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:12 devstack sudo[106209]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1f5e2b33-18f0-43ab-9c2b-cf035cf66de4 tempest-CreateVolumesFromSnapshotTest-1391512244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-cbfe03cf-ebc6-411a-bbdc-2da51e2e03b4" returned: 0 in 0.803s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1f5e2b33-18f0-43ab-9c2b-cf035cf66de4 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-cbfe03cf-ebc6-411a-bbdc-2da51e2e03b4 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:12 devstack sudo[106219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-cbfe03cf-ebc6-411a-bbdc-2da51e2e03b4 Jul 10 10:26:12 devstack sudo[106219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:12 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4d13b7bb-329f-418a-941e-ee539453daf6 tempest-VolumeDependencyTests-448903000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-034ce50d-a4a2-4925-9299-d4648ea77602 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-034ce50d-a4a2-4925-9299-d4648ea77602.77943c84-2d65-40d4-8b99-b14b998cfd4b" returned: 0 in 0.715s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:12 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-4d13b7bb-329f-418a-941e-ee539453daf6 tempest-VolumeDependencyTests-448903000 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-034ce50d-a4a2-4925-9299-d4648ea77602.77943c84-2d65-40d4-8b99-b14b998cfd4b is being set with open permissions: ugo+rw Jul 10 10:26:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4d13b7bb-329f-418a-941e-ee539453daf6 tempest-VolumeDependencyTests-448903000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-034ce50d-a4a2-4925-9299-d4648ea77602.77943c84-2d65-40d4-8b99-b14b998cfd4b {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:12 devstack sudo[106224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-034ce50d-a4a2-4925-9299-d4648ea77602.77943c84-2d65-40d4-8b99-b14b998cfd4b Jul 10 10:26:12 devstack sudo[106224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:13 devstack sudo[106219]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:13 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1f5e2b33-18f0-43ab-9c2b-cf035cf66de4 tempest-CreateVolumesFromSnapshotTest-1391512244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-cbfe03cf-ebc6-411a-bbdc-2da51e2e03b4" returned: 0 in 0.679s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:13 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-1f5e2b33-18f0-43ab-9c2b-cf035cf66de4 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Lock "cinder-quobyte-cbfe03cf-ebc6-411a-bbdc-2da51e2e03b4" released by "delete_volume" :: held 1.528s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:26:13 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-1f5e2b33-18f0-43ab-9c2b-cf035cf66de4 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Created reservations ['04b0b566-b73d-4694-afd8-0d5f09b481e3', '5df9fd07-8362-4a64-a28e-2e2682f63e78', '7329ade2-3c60-4d14-85dc-8a10eda70f9a', '8160eef7-c5e6-4de5-9887-a21e2e9b8319'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:26:13 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-1f5e2b33-18f0-43ab-9c2b-cf035cf66de4 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:26:13 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-1f5e2b33-18f0-43ab-9c2b-cf035cf66de4 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:26:13 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-1f5e2b33-18f0-43ab-9c2b-cf035cf66de4 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:26:13 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-1f5e2b33-18f0-43ab-9c2b-cf035cf66de4 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:26:13 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-1f5e2b33-18f0-43ab-9c2b-cf035cf66de4 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:26:13 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1f5e2b33-18f0-43ab-9c2b-cf035cf66de4 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:13 devstack sudo[106227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:26:13 devstack sudo[106227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:13 devstack sudo[106224]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:13 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4d13b7bb-329f-418a-941e-ee539453daf6 tempest-VolumeDependencyTests-448903000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-034ce50d-a4a2-4925-9299-d4648ea77602.77943c84-2d65-40d4-8b99-b14b998cfd4b" returned: 0 in 0.653s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:13 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4d13b7bb-329f-418a-941e-ee539453daf6 tempest-VolumeDependencyTests-448903000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-034ce50d-a4a2-4925-9299-d4648ea77602.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:13 devstack sudo[106230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-034ce50d-a4a2-4925-9299-d4648ea77602.info Jul 10 10:26:13 devstack sudo[106230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:13 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-29b6d508-e351-4273-a84f-2f0b9490dac4 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Acquiring lock "cinder-7a23d9b0-da8f-4afb-b1f5-784fe43001f3-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:26:13 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-29b6d508-e351-4273-a84f-2f0b9490dac4 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Lock "cinder-7a23d9b0-da8f-4afb-b1f5-784fe43001f3-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:26:14 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-29b6d508-e351-4273-a84f-2f0b9490dac4 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Acquiring lock "cinder-quobyte-7a23d9b0-da8f-4afb-b1f5-784fe43001f3" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:26:14 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-29b6d508-e351-4273-a84f-2f0b9490dac4 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Lock "cinder-quobyte-7a23d9b0-da8f-4afb-b1f5-784fe43001f3" acquired by "delete_volume" :: waited 0.017s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:26:14 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6fe9aa-353b-4f22-83d4-e1e0cbde84fd]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:26:14 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-29b6d508-e351-4273-a84f-2f0b9490dac4 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7a23d9b0-da8f-4afb-b1f5-784fe43001f3 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:14 devstack sudo[106227]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:14 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-1f5e2b33-18f0-43ab-9c2b-cf035cf66de4 tempest-CreateVolumesFromSnapshotTest-1391512244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.700s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:14 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-1f5e2b33-18f0-43ab-9c2b-cf035cf66de4 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:26:14 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-1f5e2b33-18f0-43ab-9c2b-cf035cf66de4 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Deleted volume successfully. Jul 10 10:26:14 devstack sudo[106233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7a23d9b0-da8f-4afb-b1f5-784fe43001f3 Jul 10 10:26:14 devstack sudo[106233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:14 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-1f5e2b33-18f0-43ab-9c2b-cf035cf66de4 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Lock "cinder-cbfe03cf-ebc6-411a-bbdc-2da51e2e03b4-delete_volume" released by "delete_volume" :: held 2.452s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:26:14 devstack sudo[106230]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:14 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4d13b7bb-329f-418a-941e-ee539453daf6 tempest-VolumeDependencyTests-448903000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-034ce50d-a4a2-4925-9299-d4648ea77602.info" returned: 0 in 0.691s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:14 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-4d13b7bb-329f-418a-941e-ee539453daf6 tempest-VolumeDependencyTests-448903000 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-034ce50d-a4a2-4925-9299-d4648ea77602.info is being set with open permissions: ugo+rw Jul 10 10:26:14 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4d13b7bb-329f-418a-941e-ee539453daf6 tempest-VolumeDependencyTests-448903000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-034ce50d-a4a2-4925-9299-d4648ea77602.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:14 devstack sudo[106236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-034ce50d-a4a2-4925-9299-d4648ea77602.info Jul 10 10:26:14 devstack sudo[106236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:14 devstack sudo[106233]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:14 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-29b6d508-e351-4273-a84f-2f0b9490dac4 tempest-CreateVolumesFromSnapshotTest-1391512244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7a23d9b0-da8f-4afb-b1f5-784fe43001f3" returned: 0 in 0.799s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:14 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-29b6d508-e351-4273-a84f-2f0b9490dac4 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7a23d9b0-da8f-4afb-b1f5-784fe43001f3 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:14 devstack sudo[106241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7a23d9b0-da8f-4afb-b1f5-784fe43001f3 Jul 10 10:26:14 devstack sudo[106241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:14 devstack sudo[106236]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:14 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4d13b7bb-329f-418a-941e-ee539453daf6 tempest-VolumeDependencyTests-448903000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-034ce50d-a4a2-4925-9299-d4648ea77602.info" returned: 0 in 0.636s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:14 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-4d13b7bb-329f-418a-941e-ee539453daf6 tempest-VolumeDependencyTests-448903000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.449s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:26:14 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-5efc01ad-8236-44b5-99b0-ef32ecf44499 tempest-CinderUnicodeTest-1860234538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.786s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:26:14 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-5efc01ad-8236-44b5-99b0-ef32ecf44499 tempest-CinderUnicodeTest-1860234538 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:26:09Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b02b661d-db5a-4cc1-8dc1-6d6bbdefafc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1de8c217e88344058fbbb70fa368ea53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:26:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:26:09Z,use_quota=True,user_id='fc81c4caa48441efa52239fc2b9ae3f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:26:14 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-5efc01ad-8236-44b5-99b0-ef32ecf44499 tempest-CinderUnicodeTest-1860234538 None] Creating volume b02b661d-db5a-4cc1-8dc1-6d6bbdefafc9 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:26:14 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-5efc01ad-8236-44b5-99b0-ef32ecf44499 tempest-CinderUnicodeTest-1860234538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:26:14 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-5efc01ad-8236-44b5-99b0-ef32ecf44499 tempest-CinderUnicodeTest-1860234538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:26:14 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-5efc01ad-8236-44b5-99b0-ef32ecf44499 tempest-CinderUnicodeTest-1860234538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:26:14 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-5efc01ad-8236-44b5-99b0-ef32ecf44499 tempest-CinderUnicodeTest-1860234538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:26:14 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-5efc01ad-8236-44b5-99b0-ef32ecf44499 tempest-CinderUnicodeTest-1860234538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:26:14 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-5efc01ad-8236-44b5-99b0-ef32ecf44499 tempest-CinderUnicodeTest-1860234538 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:26:14 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-5efc01ad-8236-44b5-99b0-ef32ecf44499 tempest-CinderUnicodeTest-1860234538 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:26:14 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5efc01ad-8236-44b5-99b0-ef32ecf44499 tempest-CinderUnicodeTest-1860234538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b02b661d-db5a-4cc1-8dc1-6d6bbdefafc9 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:15 devstack sudo[106244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b02b661d-db5a-4cc1-8dc1-6d6bbdefafc9 1073741824 Jul 10 10:26:15 devstack sudo[106244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:15 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-4d13b7bb-329f-418a-941e-ee539453daf6 tempest-VolumeDependencyTests-448903000 None] Create snapshot completed successfully Jul 10 10:26:15 devstack sudo[106241]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:15 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-29b6d508-e351-4273-a84f-2f0b9490dac4 tempest-CreateVolumesFromSnapshotTest-1391512244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-7a23d9b0-da8f-4afb-b1f5-784fe43001f3" returned: 0 in 0.664s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:15 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-29b6d508-e351-4273-a84f-2f0b9490dac4 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Lock "cinder-quobyte-7a23d9b0-da8f-4afb-b1f5-784fe43001f3" released by "delete_volume" :: held 1.502s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:26:15 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-29b6d508-e351-4273-a84f-2f0b9490dac4 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Created reservations ['a495b68a-31f1-4385-a361-d7c4c7e32d4a', '26b81419-746d-4be3-9d90-5e76c01d056b', 'fb4392cc-ded1-465d-9435-8c41b1883f3d', '3faa24e0-f1cc-4fc8-8217-aac194d4577d'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:26:15 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-29b6d508-e351-4273-a84f-2f0b9490dac4 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:26:15 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-29b6d508-e351-4273-a84f-2f0b9490dac4 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:26:15 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-29b6d508-e351-4273-a84f-2f0b9490dac4 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:26:15 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-29b6d508-e351-4273-a84f-2f0b9490dac4 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:26:15 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-29b6d508-e351-4273-a84f-2f0b9490dac4 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:26:15 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-29b6d508-e351-4273-a84f-2f0b9490dac4 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:15 devstack sudo[106250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:26:15 devstack sudo[106250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:15 devstack sudo[106244]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:15 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5efc01ad-8236-44b5-99b0-ef32ecf44499 tempest-CinderUnicodeTest-1860234538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b02b661d-db5a-4cc1-8dc1-6d6bbdefafc9 1073741824" returned: 0 in 0.858s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:15 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5efc01ad-8236-44b5-99b0-ef32ecf44499 tempest-CinderUnicodeTest-1860234538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b02b661d-db5a-4cc1-8dc1-6d6bbdefafc9 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:15 devstack sudo[106253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b02b661d-db5a-4cc1-8dc1-6d6bbdefafc9 Jul 10 10:26:15 devstack sudo[106253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:16 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-de51debf-a974-4d43-94fd-188b502c3b12 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Acquiring lock "cinder-0b0ec475-cbaa-411b-82fc-2ec73f9d1bda-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:26:16 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-de51debf-a974-4d43-94fd-188b502c3b12 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Lock "cinder-0b0ec475-cbaa-411b-82fc-2ec73f9d1bda-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:26:16 devstack sudo[106250]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:16 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-de51debf-a974-4d43-94fd-188b502c3b12 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Acquiring lock "cinder-quobyte-0b0ec475-cbaa-411b-82fc-2ec73f9d1bda" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:26:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-29b6d508-e351-4273-a84f-2f0b9490dac4 tempest-CreateVolumesFromSnapshotTest-1391512244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.737s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:16 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-29b6d508-e351-4273-a84f-2f0b9490dac4 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:26:16 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-29b6d508-e351-4273-a84f-2f0b9490dac4 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Deleted volume successfully. Jul 10 10:26:16 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-de51debf-a974-4d43-94fd-188b502c3b12 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Lock "cinder-quobyte-0b0ec475-cbaa-411b-82fc-2ec73f9d1bda" acquired by "delete_volume" :: waited 0.030s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:26:16 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf3e635e-5b61-4402-b92a-4120834111c4 tempest-VolumeDependencyTests-448903000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:26:16 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad21955c-9c32-44a8-a4fe-ce2649068429]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:26:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-de51debf-a974-4d43-94fd-188b502c3b12 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0b0ec475-cbaa-411b-82fc-2ec73f9d1bda {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:16 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-29b6d508-e351-4273-a84f-2f0b9490dac4 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Lock "cinder-7a23d9b0-da8f-4afb-b1f5-784fe43001f3-delete_volume" released by "delete_volume" :: held 2.503s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:26:16 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-bf3e635e-5b61-4402-b92a-4120834111c4 tempest-VolumeDependencyTests-448903000 None] Flow 'volume_create_manager' (c774346c-6166-416d-a4a1-4093dcf797ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:26:16 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-bf3e635e-5b61-4402-b92a-4120834111c4 tempest-VolumeDependencyTests-448903000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (002a47f8-6fb8-4140-a79d-cf2e549ee878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:26:16 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-bf3e635e-5b61-4402-b92a-4120834111c4 tempest-VolumeDependencyTests-448903000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (002a47f8-6fb8-4140-a79d-cf2e549ee878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:26:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-826237564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb9609c3-60f8-4e24-9744-904b9c4165c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f91a3417b09a4f6485c26909477081ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:26:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=77943c84-2d65-40d4-8b99-b14b998cfd4b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:26:16Z,use_quota=True,user_id='294ad27d4d1c49bbbb504f9ed2ca7b9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:26:16 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-bf3e635e-5b61-4402-b92a-4120834111c4 tempest-VolumeDependencyTests-448903000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6602221f-3994-4d88-8f05-97ca0030230b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:26:16 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-bf3e635e-5b61-4402-b92a-4120834111c4 tempest-VolumeDependencyTests-448903000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6602221f-3994-4d88-8f05-97ca0030230b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:26:16 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-bf3e635e-5b61-4402-b92a-4120834111c4 tempest-VolumeDependencyTests-448903000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88781e82-d5a8-4526-9cca-5ed2181f33bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:26:16 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-bf3e635e-5b61-4402-b92a-4120834111c4 tempest-VolumeDependencyTests-448903000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88781e82-d5a8-4526-9cca-5ed2181f33bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cb9609c3-60f8-4e24-9744-904b9c4165c1', 'volume_name': 'volume-cb9609c3-60f8-4e24-9744-904b9c4165c1', 'volume_size': 1, 'snapshot_id': '77943c84-2d65-40d4-8b99-b14b998cfd4b'}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:26:16 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-bf3e635e-5b61-4402-b92a-4120834111c4 tempest-VolumeDependencyTests-448903000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f75c66e9-e9a1-46e2-ac69-291cd7a5907b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:26:16 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-bf3e635e-5b61-4402-b92a-4120834111c4 tempest-VolumeDependencyTests-448903000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f75c66e9-e9a1-46e2-ac69-291cd7a5907b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:26:16 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-bf3e635e-5b61-4402-b92a-4120834111c4 tempest-VolumeDependencyTests-448903000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (418984a7-ad62-4777-b480-3427d13c99f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:26:16 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-bf3e635e-5b61-4402-b92a-4120834111c4 tempest-VolumeDependencyTests-448903000 None] Volume cb9609c3-60f8-4e24-9744-904b9c4165c1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cb9609c3-60f8-4e24-9744-904b9c4165c1', 'volume_size': 1, 'snapshot_id': '77943c84-2d65-40d4-8b99-b14b998cfd4b'} Jul 10 10:26:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-bf3e635e-5b61-4402-b92a-4120834111c4 tempest-VolumeDependencyTests-448903000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:26:16 devstack sudo[106256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0b0ec475-cbaa-411b-82fc-2ec73f9d1bda Jul 10 10:26:16 devstack sudo[106256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:16 devstack sudo[106253]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5efc01ad-8236-44b5-99b0-ef32ecf44499 tempest-CinderUnicodeTest-1860234538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b02b661d-db5a-4cc1-8dc1-6d6bbdefafc9" returned: 0 in 0.792s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:16 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-5efc01ad-8236-44b5-99b0-ef32ecf44499 tempest-CinderUnicodeTest-1860234538 None] <== create_volume: return (1710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:26:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-5efc01ad-8236-44b5-99b0-ef32ecf44499 tempest-CinderUnicodeTest-1860234538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.714s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:26:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-4aa4e2ae-df4f-4210-9200-8b40e3fd1674 tempest-ProjectReaderTests-901478856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.991s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:26:16 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-4aa4e2ae-df4f-4210-9200-8b40e3fd1674 tempest-ProjectReaderTests-901478856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:26:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2055620166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b31bf35-687d-4a1f-b25e-009637e8e71e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3ae08cf4bfc42e782558d8b9e55b009',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:26:10Z,use_quota=True,user_id='9b37d3c824f343e387285d0cddc1aa8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:26:16 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-4aa4e2ae-df4f-4210-9200-8b40e3fd1674 tempest-ProjectReaderTests-901478856 None] Creating volume 2b31bf35-687d-4a1f-b25e-009637e8e71e {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:26:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-4aa4e2ae-df4f-4210-9200-8b40e3fd1674 tempest-ProjectReaderTests-901478856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:26:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-4aa4e2ae-df4f-4210-9200-8b40e3fd1674 tempest-ProjectReaderTests-901478856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:26:16 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-4aa4e2ae-df4f-4210-9200-8b40e3fd1674 tempest-ProjectReaderTests-901478856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:26:16 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-4aa4e2ae-df4f-4210-9200-8b40e3fd1674 tempest-ProjectReaderTests-901478856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:26:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-4aa4e2ae-df4f-4210-9200-8b40e3fd1674 tempest-ProjectReaderTests-901478856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:26:16 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-4aa4e2ae-df4f-4210-9200-8b40e3fd1674 tempest-ProjectReaderTests-901478856 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:26:16 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-4aa4e2ae-df4f-4210-9200-8b40e3fd1674 tempest-ProjectReaderTests-901478856 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:26:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4aa4e2ae-df4f-4210-9200-8b40e3fd1674 tempest-ProjectReaderTests-901478856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2b31bf35-687d-4a1f-b25e-009637e8e71e 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:16 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5efc01ad-8236-44b5-99b0-ef32ecf44499 tempest-CinderUnicodeTest-1860234538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (940b7b6a-e956-4c23-b2fa-d57c9cb8e823) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b02b661d-db5a-4cc1-8dc1-6d6bbdefafc9', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:26:16 devstack sudo[106259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2b31bf35-687d-4a1f-b25e-009637e8e71e 1073741824 Jul 10 10:26:16 devstack sudo[106259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:16 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5efc01ad-8236-44b5-99b0-ef32ecf44499 tempest-CinderUnicodeTest-1860234538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70acc9e7-7edf-40e9-8228-d5ca11a4ccfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:26:16 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-5efc01ad-8236-44b5-99b0-ef32ecf44499 tempest-CinderUnicodeTest-1860234538 None] Volume volume-b02b661d-db5a-4cc1-8dc1-6d6bbdefafc9 (b02b661d-db5a-4cc1-8dc1-6d6bbdefafc9): created successfully Jul 10 10:26:16 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5efc01ad-8236-44b5-99b0-ef32ecf44499 tempest-CinderUnicodeTest-1860234538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70acc9e7-7edf-40e9-8228-d5ca11a4ccfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:26:16 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5efc01ad-8236-44b5-99b0-ef32ecf44499 tempest-CinderUnicodeTest-1860234538 None] Flow 'volume_create_manager' (d31a13ec-de2d-4eda-a1df-56cc002ea6f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:26:16 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-5efc01ad-8236-44b5-99b0-ef32ecf44499 tempest-CinderUnicodeTest-1860234538 None] Created volume successfully. Jul 10 10:26:17 devstack sudo[106256]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-de51debf-a974-4d43-94fd-188b502c3b12 tempest-CreateVolumesFromSnapshotTest-1391512244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0b0ec475-cbaa-411b-82fc-2ec73f9d1bda" returned: 0 in 0.810s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-de51debf-a974-4d43-94fd-188b502c3b12 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0b0ec475-cbaa-411b-82fc-2ec73f9d1bda {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:17 devstack sudo[106264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0b0ec475-cbaa-411b-82fc-2ec73f9d1bda Jul 10 10:26:17 devstack sudo[106264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:17 devstack sudo[106259]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4aa4e2ae-df4f-4210-9200-8b40e3fd1674 tempest-ProjectReaderTests-901478856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2b31bf35-687d-4a1f-b25e-009637e8e71e 1073741824" returned: 0 in 0.893s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4aa4e2ae-df4f-4210-9200-8b40e3fd1674 tempest-ProjectReaderTests-901478856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2b31bf35-687d-4a1f-b25e-009637e8e71e {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:17 devstack sudo[106271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2b31bf35-687d-4a1f-b25e-009637e8e71e Jul 10 10:26:17 devstack sudo[106271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:18 devstack sudo[106264]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:18 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-de51debf-a974-4d43-94fd-188b502c3b12 tempest-CreateVolumesFromSnapshotTest-1391512244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-0b0ec475-cbaa-411b-82fc-2ec73f9d1bda" returned: 0 in 0.769s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:18 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-de51debf-a974-4d43-94fd-188b502c3b12 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Lock "cinder-quobyte-0b0ec475-cbaa-411b-82fc-2ec73f9d1bda" released by "delete_volume" :: held 1.636s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:26:18 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-9594a0e6-1b7e-4c46-8f8c-d688bf3842ec tempest-CinderUnicodeTest-1860234538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:26:18 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9594a0e6-1b7e-4c46-8f8c-d688bf3842ec tempest-CinderUnicodeTest-1860234538 None] Flow 'volume_create_manager' (1d8cbaf2-6763-4e12-9d69-7dfa5362cafd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:26:18 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9594a0e6-1b7e-4c46-8f8c-d688bf3842ec tempest-CinderUnicodeTest-1860234538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25ed1cd4-e847-4e62-8f3e-24a17af3797f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:26:18 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-de51debf-a974-4d43-94fd-188b502c3b12 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Created reservations ['439ad7b7-ee01-44fe-8365-4c2774a37b06', 'bdf3c59f-8903-426f-8350-54cb6a5306a1', '81847a07-e753-484b-aebf-aee88515a6c2', '21e1fae0-baca-40df-9ea6-912c2be8a35a'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:26:18 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9594a0e6-1b7e-4c46-8f8c-d688bf3842ec tempest-CinderUnicodeTest-1860234538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25ed1cd4-e847-4e62-8f3e-24a17af3797f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:26:18Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-726828730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8d88311-aa4b-45c6-94b4-aeeb8a32f0f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1de8c217e88344058fbbb70fa368ea53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:26:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:26:18Z,use_quota=True,user_id='fc81c4caa48441efa52239fc2b9ae3f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:26:18 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9594a0e6-1b7e-4c46-8f8c-d688bf3842ec tempest-CinderUnicodeTest-1860234538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5696e01c-c19d-45f1-8ab4-338c231fa4c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:26:18 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9594a0e6-1b7e-4c46-8f8c-d688bf3842ec tempest-CinderUnicodeTest-1860234538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5696e01c-c19d-45f1-8ab4-338c231fa4c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:26:18 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9594a0e6-1b7e-4c46-8f8c-d688bf3842ec tempest-CinderUnicodeTest-1860234538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df958152-99d4-4a0f-8c5c-4e77d85ff39a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:26:18 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9594a0e6-1b7e-4c46-8f8c-d688bf3842ec tempest-CinderUnicodeTest-1860234538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df958152-99d4-4a0f-8c5c-4e77d85ff39a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8d88311-aa4b-45c6-94b4-aeeb8a32f0f2', 'volume_name': 'volume-d8d88311-aa4b-45c6-94b4-aeeb8a32f0f2', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:26:18 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9594a0e6-1b7e-4c46-8f8c-d688bf3842ec tempest-CinderUnicodeTest-1860234538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f50893d9-8afe-4de0-a178-4d2da69093ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:26:18 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9594a0e6-1b7e-4c46-8f8c-d688bf3842ec tempest-CinderUnicodeTest-1860234538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f50893d9-8afe-4de0-a178-4d2da69093ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:26:18 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9594a0e6-1b7e-4c46-8f8c-d688bf3842ec tempest-CinderUnicodeTest-1860234538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df9d1116-eba2-4c1a-b3f8-ffb1104792d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:26:18 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-9594a0e6-1b7e-4c46-8f8c-d688bf3842ec tempest-CinderUnicodeTest-1860234538 None] Volume d8d88311-aa4b-45c6-94b4-aeeb8a32f0f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8d88311-aa4b-45c6-94b4-aeeb8a32f0f2', 'volume_size': 1} Jul 10 10:26:18 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-9594a0e6-1b7e-4c46-8f8c-d688bf3842ec tempest-CinderUnicodeTest-1860234538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:26:18 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-de51debf-a974-4d43-94fd-188b502c3b12 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:26:18 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-de51debf-a974-4d43-94fd-188b502c3b12 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:26:18 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-de51debf-a974-4d43-94fd-188b502c3b12 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:26:18 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-de51debf-a974-4d43-94fd-188b502c3b12 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:26:18 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-de51debf-a974-4d43-94fd-188b502c3b12 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:26:18 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-de51debf-a974-4d43-94fd-188b502c3b12 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:18 devstack sudo[106274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:26:18 devstack sudo[106274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:18 devstack sudo[106271]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:18 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4aa4e2ae-df4f-4210-9200-8b40e3fd1674 tempest-ProjectReaderTests-901478856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2b31bf35-687d-4a1f-b25e-009637e8e71e" returned: 0 in 0.761s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:18 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-4aa4e2ae-df4f-4210-9200-8b40e3fd1674 tempest-ProjectReaderTests-901478856 None] <== create_volume: return (1702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:26:18 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-4aa4e2ae-df4f-4210-9200-8b40e3fd1674 tempest-ProjectReaderTests-901478856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.704s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:26:18 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-bf3e635e-5b61-4402-b92a-4120834111c4 tempest-VolumeDependencyTests-448903000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.858s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:26:18 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-bf3e635e-5b61-4402-b92a-4120834111c4 tempest-VolumeDependencyTests-448903000 None] Acquiring lock "cinder-quobyte-77943c84-2d65-40d4-8b99-b14b998cfd4b-cb9609c3-60f8-4e24-9744-904b9c4165c1" by "_create_volume_from_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:26:18 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4aa4e2ae-df4f-4210-9200-8b40e3fd1674 tempest-ProjectReaderTests-901478856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2abb971b-f673-4db2-9b2c-acb28b64e8ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b31bf35-687d-4a1f-b25e-009637e8e71e', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:26:18 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4aa4e2ae-df4f-4210-9200-8b40e3fd1674 tempest-ProjectReaderTests-901478856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f940df7f-610b-470a-9dbc-f467ca713d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:26:18 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-bf3e635e-5b61-4402-b92a-4120834111c4 tempest-VolumeDependencyTests-448903000 None] Lock "cinder-quobyte-77943c84-2d65-40d4-8b99-b14b998cfd4b-cb9609c3-60f8-4e24-9744-904b9c4165c1" acquired by "_create_volume_from_snapshot" :: waited 0.038s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:26:18 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-bf3e635e-5b61-4402-b92a-4120834111c4 tempest-VolumeDependencyTests-448903000 None] Creating volume cb9609c3-60f8-4e24-9744-904b9c4165c1 from snapshot 77943c84-2d65-40d4-8b99-b14b998cfd4b {{(pid=87234) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 10:26:18 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-bf3e635e-5b61-4402-b92a-4120834111c4 tempest-VolumeDependencyTests-448903000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:26:18 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-bf3e635e-5b61-4402-b92a-4120834111c4 tempest-VolumeDependencyTests-448903000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:26:18 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-bf3e635e-5b61-4402-b92a-4120834111c4 tempest-VolumeDependencyTests-448903000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:26:18 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-bf3e635e-5b61-4402-b92a-4120834111c4 tempest-VolumeDependencyTests-448903000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:26:18 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-bf3e635e-5b61-4402-b92a-4120834111c4 tempest-VolumeDependencyTests-448903000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:26:18 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-bf3e635e-5b61-4402-b92a-4120834111c4 tempest-VolumeDependencyTests-448903000 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:26:18 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-bf3e635e-5b61-4402-b92a-4120834111c4 tempest-VolumeDependencyTests-448903000 None] Acquiring lock "cinder-quobyte-cb9609c3-60f8-4e24-9744-904b9c4165c1" by "_copy_volume_from_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:26:18 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-4aa4e2ae-df4f-4210-9200-8b40e3fd1674 tempest-ProjectReaderTests-901478856 None] Volume volume-2b31bf35-687d-4a1f-b25e-009637e8e71e (2b31bf35-687d-4a1f-b25e-009637e8e71e): created successfully Jul 10 10:26:18 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4aa4e2ae-df4f-4210-9200-8b40e3fd1674 tempest-ProjectReaderTests-901478856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f940df7f-610b-470a-9dbc-f467ca713d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:26:18 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4aa4e2ae-df4f-4210-9200-8b40e3fd1674 tempest-ProjectReaderTests-901478856 None] Flow 'volume_create_manager' (6e1e24e9-53dd-4061-80c9-a03936848d15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:26:18 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-bf3e635e-5b61-4402-b92a-4120834111c4 tempest-VolumeDependencyTests-448903000 None] Lock "cinder-quobyte-cb9609c3-60f8-4e24-9744-904b9c4165c1" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:26:18 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-bf3e635e-5b61-4402-b92a-4120834111c4 tempest-VolumeDependencyTests-448903000 None] snapshot: 77943c84-2d65-40d4-8b99-b14b998cfd4b, volume: cb9609c3-60f8-4e24-9744-904b9c4165c1, {{(pid=87234) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 10:26:18 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-4aa4e2ae-df4f-4210-9200-8b40e3fd1674 tempest-ProjectReaderTests-901478856 None] Created volume successfully. Jul 10 10:26:18 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-bf3e635e-5b61-4402-b92a-4120834111c4 tempest-VolumeDependencyTests-448903000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:26:18 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-bf3e635e-5b61-4402-b92a-4120834111c4 tempest-VolumeDependencyTests-448903000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:26:18 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-bf3e635e-5b61-4402-b92a-4120834111c4 tempest-VolumeDependencyTests-448903000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:26:18 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-bf3e635e-5b61-4402-b92a-4120834111c4 tempest-VolumeDependencyTests-448903000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:26:18 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-bf3e635e-5b61-4402-b92a-4120834111c4 tempest-VolumeDependencyTests-448903000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:26:18 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-14e508fb-dc96-471c-b347-d8ee7c8797c8 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Acquiring lock "cinder-6601ff64-ebee-4e4d-a4bf-31df47bfceea-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:26:18 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[100eebb6-aceb-4d0d-bbbb-d5ae80204cf3]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:26:18 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-bf3e635e-5b61-4402-b92a-4120834111c4 tempest-VolumeDependencyTests-448903000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-034ce50d-a4a2-4925-9299-d4648ea77602.77943c84-2d65-40d4-8b99-b14b998cfd4b {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:18 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-14e508fb-dc96-471c-b347-d8ee7c8797c8 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Lock "cinder-6601ff64-ebee-4e4d-a4bf-31df47bfceea-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:26:18 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-14e508fb-dc96-471c-b347-d8ee7c8797c8 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Acquiring lock "cinder-quobyte-6601ff64-ebee-4e4d-a4bf-31df47bfceea" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:26:18 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-14e508fb-dc96-471c-b347-d8ee7c8797c8 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Lock "cinder-quobyte-6601ff64-ebee-4e4d-a4bf-31df47bfceea" acquired by "delete_volume" :: waited 0.016s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:26:18 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea2aeb0-2ec0-4aa7-bfe1-9b312905cbc4]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:26:18 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-14e508fb-dc96-471c-b347-d8ee7c8797c8 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-6601ff64-ebee-4e4d-a4bf-31df47bfceea {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:18 devstack sudo[106277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-034ce50d-a4a2-4925-9299-d4648ea77602.77943c84-2d65-40d4-8b99-b14b998cfd4b Jul 10 10:26:18 devstack sudo[106277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:18 devstack sudo[106278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-6601ff64-ebee-4e4d-a4bf-31df47bfceea Jul 10 10:26:18 devstack sudo[106278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:18 devstack sudo[106274]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:18 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-de51debf-a974-4d43-94fd-188b502c3b12 tempest-CreateVolumesFromSnapshotTest-1391512244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.686s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:18 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-de51debf-a974-4d43-94fd-188b502c3b12 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:26:18 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-de51debf-a974-4d43-94fd-188b502c3b12 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Deleted volume successfully. Jul 10 10:26:18 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-de51debf-a974-4d43-94fd-188b502c3b12 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Lock "cinder-0b0ec475-cbaa-411b-82fc-2ec73f9d1bda-delete_volume" released by "delete_volume" :: held 2.675s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:26:19 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-963b3c86-2206-43a9-aa2c-1a285e0e7f5d tempest-ProjectReaderTests-901478856 None] Acquiring lock "cinder-2b31bf35-687d-4a1f-b25e-009637e8e71e-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:26:19 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-963b3c86-2206-43a9-aa2c-1a285e0e7f5d tempest-ProjectReaderTests-901478856 None] Lock "cinder-2b31bf35-687d-4a1f-b25e-009637e8e71e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:26:19 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-963b3c86-2206-43a9-aa2c-1a285e0e7f5d tempest-ProjectReaderTests-901478856 None] Acquiring lock "cinder-quobyte-2b31bf35-687d-4a1f-b25e-009637e8e71e" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:26:19 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-963b3c86-2206-43a9-aa2c-1a285e0e7f5d tempest-ProjectReaderTests-901478856 None] Lock "cinder-quobyte-2b31bf35-687d-4a1f-b25e-009637e8e71e" acquired by "delete_volume" :: waited 0.026s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:26:19 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1399656-c231-4653-8725-7be0e40cdf6f]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:26:19 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-963b3c86-2206-43a9-aa2c-1a285e0e7f5d tempest-ProjectReaderTests-901478856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2b31bf35-687d-4a1f-b25e-009637e8e71e {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:19 devstack sudo[106277]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:19 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-bf3e635e-5b61-4402-b92a-4120834111c4 tempest-VolumeDependencyTests-448903000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-034ce50d-a4a2-4925-9299-d4648ea77602.77943c84-2d65-40d4-8b99-b14b998cfd4b" returned: 0 in 0.926s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:19 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-bf3e635e-5b61-4402-b92a-4120834111c4 tempest-VolumeDependencyTests-448903000 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-034ce50d-a4a2-4925-9299-d4648ea77602(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 10:26:19 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-bf3e635e-5b61-4402-b92a-4120834111c4 tempest-VolumeDependencyTests-448903000 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-034ce50d-a4a2-4925-9299-d4648ea77602 {{(pid=87234) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 10:26:19 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-bf3e635e-5b61-4402-b92a-4120834111c4 tempest-VolumeDependencyTests-448903000 None] Creating direct copy from snapshot {{(pid=87234) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 10:26:19 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8eb7263-e469-4c18-9c2c-2c42135461c7]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:26:19 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-bf3e635e-5b61-4402-b92a-4120834111c4 tempest-VolumeDependencyTests-448903000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-034ce50d-a4a2-4925-9299-d4648ea77602 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:19 devstack sudo[106278]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:19 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-14e508fb-dc96-471c-b347-d8ee7c8797c8 tempest-CreateVolumesFromSnapshotTest-1391512244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-6601ff64-ebee-4e4d-a4bf-31df47bfceea" returned: 0 in 0.851s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:19 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-14e508fb-dc96-471c-b347-d8ee7c8797c8 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-6601ff64-ebee-4e4d-a4bf-31df47bfceea {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:19 devstack sudo[106290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-6601ff64-ebee-4e4d-a4bf-31df47bfceea Jul 10 10:26:19 devstack sudo[106290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:19 devstack sudo[106288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2b31bf35-687d-4a1f-b25e-009637e8e71e Jul 10 10:26:19 devstack sudo[106288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:19 devstack sudo[106289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-034ce50d-a4a2-4925-9299-d4648ea77602 Jul 10 10:26:19 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:20 devstack sudo[106290]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:20 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-14e508fb-dc96-471c-b347-d8ee7c8797c8 tempest-CreateVolumesFromSnapshotTest-1391512244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-6601ff64-ebee-4e4d-a4bf-31df47bfceea" returned: 0 in 0.704s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:20 devstack sudo[106288]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:20 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-963b3c86-2206-43a9-aa2c-1a285e0e7f5d tempest-ProjectReaderTests-901478856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2b31bf35-687d-4a1f-b25e-009637e8e71e" returned: 0 in 0.796s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:20 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-963b3c86-2206-43a9-aa2c-1a285e0e7f5d tempest-ProjectReaderTests-901478856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2b31bf35-687d-4a1f-b25e-009637e8e71e {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:20 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-14e508fb-dc96-471c-b347-d8ee7c8797c8 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Lock "cinder-quobyte-6601ff64-ebee-4e4d-a4bf-31df47bfceea" released by "delete_volume" :: held 1.613s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:26:20 devstack sudo[106302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2b31bf35-687d-4a1f-b25e-009637e8e71e Jul 10 10:26:20 devstack sudo[106302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:20 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:20 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-bf3e635e-5b61-4402-b92a-4120834111c4 tempest-VolumeDependencyTests-448903000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-034ce50d-a4a2-4925-9299-d4648ea77602" returned: 0 in 0.798s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:20 devstack cinder-volume[87234]: DEBUG cinder.utils [None req-bf3e635e-5b61-4402-b92a-4120834111c4 tempest-VolumeDependencyTests-448903000 None] Path /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-cb9609c3-60f8-4e24-9744-904b9c4165c1 not found in is_blk_device check {{(pid=87234) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 10:26:20 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-bf3e635e-5b61-4402-b92a-4120834111c4 tempest-VolumeDependencyTests-448903000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-034ce50d-a4a2-4925-9299-d4648ea77602 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-cb9609c3-60f8-4e24-9744-904b9c4165c1 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:20 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-14e508fb-dc96-471c-b347-d8ee7c8797c8 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Created reservations ['8fe46341-e742-4906-9e47-0592249049f3', '1ec31063-9941-4a3a-bf3f-fc18cfc07c21', '069c7a45-e19a-42e0-b8d5-9c252c8017d0', 'dc1bb2e8-d229-4a8d-8afe-1a5eb1e95680'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:26:20 devstack sudo[106314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-034ce50d-a4a2-4925-9299-d4648ea77602 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-cb9609c3-60f8-4e24-9744-904b9c4165c1 Jul 10 10:26:20 devstack sudo[106314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:20 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-14e508fb-dc96-471c-b347-d8ee7c8797c8 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:26:20 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-14e508fb-dc96-471c-b347-d8ee7c8797c8 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:26:20 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-14e508fb-dc96-471c-b347-d8ee7c8797c8 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:26:20 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-14e508fb-dc96-471c-b347-d8ee7c8797c8 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:26:20 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-14e508fb-dc96-471c-b347-d8ee7c8797c8 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:26:20 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-14e508fb-dc96-471c-b347-d8ee7c8797c8 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:20 devstack sudo[106340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:26:20 devstack sudo[106340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:20 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-ff844d92-5d42-4da0-946b-87c800fca50e tempest-CreateVolumesFromSnapshotTest-1391512244 None] Acquiring lock "cinder-ed0ccd1b-c5a7-4034-926f-7037d9be22ee-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:26:20 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-ff844d92-5d42-4da0-946b-87c800fca50e tempest-CreateVolumesFromSnapshotTest-1391512244 None] Lock "cinder-ed0ccd1b-c5a7-4034-926f-7037d9be22ee-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:26:20 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-ff844d92-5d42-4da0-946b-87c800fca50e tempest-CreateVolumesFromSnapshotTest-1391512244 None] Acquiring lock "cinder-quobyte-ed0ccd1b-c5a7-4034-926f-7037d9be22ee" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:26:20 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-ff844d92-5d42-4da0-946b-87c800fca50e tempest-CreateVolumesFromSnapshotTest-1391512244 None] Lock "cinder-quobyte-ed0ccd1b-c5a7-4034-926f-7037d9be22ee" acquired by "delete_volume" :: waited 0.017s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:26:20 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f80a538-29c6-408b-b5f9-391ac2528334]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:26:20 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ff844d92-5d42-4da0-946b-87c800fca50e tempest-CreateVolumesFromSnapshotTest-1391512244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ed0ccd1b-c5a7-4034-926f-7037d9be22ee {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:21 devstack sudo[106302]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:21 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-963b3c86-2206-43a9-aa2c-1a285e0e7f5d tempest-ProjectReaderTests-901478856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2b31bf35-687d-4a1f-b25e-009637e8e71e" returned: 0 in 0.818s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:21 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-963b3c86-2206-43a9-aa2c-1a285e0e7f5d tempest-ProjectReaderTests-901478856 None] Lock "cinder-quobyte-2b31bf35-687d-4a1f-b25e-009637e8e71e" released by "delete_volume" :: held 1.670s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:26:21 devstack sudo[106345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ed0ccd1b-c5a7-4034-926f-7037d9be22ee Jul 10 10:26:21 devstack sudo[106345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:21 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-963b3c86-2206-43a9-aa2c-1a285e0e7f5d tempest-ProjectReaderTests-901478856 None] Created reservations ['ab9a40d4-242c-44e8-9886-69095e7d0fe0', '971bc955-0cbc-4456-8f48-fb0bfef07ddc', '3da09271-b900-4fd7-9232-c822810d6bdc', '47a633cc-1d0e-4b25-9df2-7eadda1b1be7'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:26:21 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-963b3c86-2206-43a9-aa2c-1a285e0e7f5d tempest-ProjectReaderTests-901478856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:26:21 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-963b3c86-2206-43a9-aa2c-1a285e0e7f5d tempest-ProjectReaderTests-901478856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:26:21 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-963b3c86-2206-43a9-aa2c-1a285e0e7f5d tempest-ProjectReaderTests-901478856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:26:21 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-963b3c86-2206-43a9-aa2c-1a285e0e7f5d tempest-ProjectReaderTests-901478856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:26:21 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-963b3c86-2206-43a9-aa2c-1a285e0e7f5d tempest-ProjectReaderTests-901478856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:26:21 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-963b3c86-2206-43a9-aa2c-1a285e0e7f5d tempest-ProjectReaderTests-901478856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:21 devstack sudo[106352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:26:21 devstack sudo[106352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:21 devstack sudo[106340]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:21 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-14e508fb-dc96-471c-b347-d8ee7c8797c8 tempest-CreateVolumesFromSnapshotTest-1391512244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.884s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:21 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-14e508fb-dc96-471c-b347-d8ee7c8797c8 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:26:21 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-14e508fb-dc96-471c-b347-d8ee7c8797c8 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Deleted volume successfully. Jul 10 10:26:21 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-14e508fb-dc96-471c-b347-d8ee7c8797c8 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Lock "cinder-6601ff64-ebee-4e4d-a4bf-31df47bfceea-delete_volume" released by "delete_volume" :: held 2.793s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:26:22 devstack sudo[106345]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ff844d92-5d42-4da0-946b-87c800fca50e tempest-CreateVolumesFromSnapshotTest-1391512244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ed0ccd1b-c5a7-4034-926f-7037d9be22ee" returned: 0 in 1.135s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ff844d92-5d42-4da0-946b-87c800fca50e tempest-CreateVolumesFromSnapshotTest-1391512244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ed0ccd1b-c5a7-4034-926f-7037d9be22ee {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:22 devstack sudo[106363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ed0ccd1b-c5a7-4034-926f-7037d9be22ee Jul 10 10:26:22 devstack sudo[106363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:22 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a0ebdd3-b9b2-4860-a636-bab9ae86f9b0 tempest-ProjectReaderTests-901478856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:26:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-2a0ebdd3-b9b2-4860-a636-bab9ae86f9b0 tempest-ProjectReaderTests-901478856 None] Flow 'volume_create_manager' (b056727c-7d97-485a-907b-aad5e77a2422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:26:22 devstack sudo[106352]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:23 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-2a0ebdd3-b9b2-4860-a636-bab9ae86f9b0 tempest-ProjectReaderTests-901478856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (879e8b45-fdb2-4e62-ae53-0de4fcf9e31b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:26:23 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-963b3c86-2206-43a9-aa2c-1a285e0e7f5d tempest-ProjectReaderTests-901478856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 1.760s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:23 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-963b3c86-2206-43a9-aa2c-1a285e0e7f5d tempest-ProjectReaderTests-901478856 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:26:23 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-963b3c86-2206-43a9-aa2c-1a285e0e7f5d tempest-ProjectReaderTests-901478856 None] Deleted volume successfully. Jul 10 10:26:23 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-2a0ebdd3-b9b2-4860-a636-bab9ae86f9b0 tempest-ProjectReaderTests-901478856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (879e8b45-fdb2-4e62-ae53-0de4fcf9e31b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:26:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2085515936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=561e2fa5-6e51-4e0f-ad83-22150e82f835,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3ae08cf4bfc42e782558d8b9e55b009',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:26:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:26:23Z,use_quota=True,user_id='9b37d3c824f343e387285d0cddc1aa8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:26:23 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-2a0ebdd3-b9b2-4860-a636-bab9ae86f9b0 tempest-ProjectReaderTests-901478856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (949b8775-567d-4350-9628-66e16f55479a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:26:23 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-2a0ebdd3-b9b2-4860-a636-bab9ae86f9b0 tempest-ProjectReaderTests-901478856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (949b8775-567d-4350-9628-66e16f55479a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:26:23 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-2a0ebdd3-b9b2-4860-a636-bab9ae86f9b0 tempest-ProjectReaderTests-901478856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57ab63ec-6172-482d-b194-e5e61675a681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:26:23 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-2a0ebdd3-b9b2-4860-a636-bab9ae86f9b0 tempest-ProjectReaderTests-901478856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57ab63ec-6172-482d-b194-e5e61675a681) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '561e2fa5-6e51-4e0f-ad83-22150e82f835', 'volume_name': 'volume-561e2fa5-6e51-4e0f-ad83-22150e82f835', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:26:23 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-2a0ebdd3-b9b2-4860-a636-bab9ae86f9b0 tempest-ProjectReaderTests-901478856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc6d628c-dd4e-4786-9a0e-3c35c07e52b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:26:23 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-2a0ebdd3-b9b2-4860-a636-bab9ae86f9b0 tempest-ProjectReaderTests-901478856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc6d628c-dd4e-4786-9a0e-3c35c07e52b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:26:23 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-2a0ebdd3-b9b2-4860-a636-bab9ae86f9b0 tempest-ProjectReaderTests-901478856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cc44431-8131-4438-9b1d-56b6af5e4cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:26:23 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-2a0ebdd3-b9b2-4860-a636-bab9ae86f9b0 tempest-ProjectReaderTests-901478856 None] Volume 561e2fa5-6e51-4e0f-ad83-22150e82f835: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-561e2fa5-6e51-4e0f-ad83-22150e82f835', 'volume_size': 1} Jul 10 10:26:23 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-2a0ebdd3-b9b2-4860-a636-bab9ae86f9b0 tempest-ProjectReaderTests-901478856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:26:23 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-963b3c86-2206-43a9-aa2c-1a285e0e7f5d tempest-ProjectReaderTests-901478856 None] Lock "cinder-2b31bf35-687d-4a1f-b25e-009637e8e71e-delete_volume" released by "delete_volume" :: held 3.825s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:26:23 devstack sudo[106363]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:23 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ff844d92-5d42-4da0-946b-87c800fca50e tempest-CreateVolumesFromSnapshotTest-1391512244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ed0ccd1b-c5a7-4034-926f-7037d9be22ee" returned: 0 in 1.715s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:23 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-ff844d92-5d42-4da0-946b-87c800fca50e tempest-CreateVolumesFromSnapshotTest-1391512244 None] Lock "cinder-quobyte-ed0ccd1b-c5a7-4034-926f-7037d9be22ee" released by "delete_volume" :: held 2.958s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:26:24 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-ff844d92-5d42-4da0-946b-87c800fca50e tempest-CreateVolumesFromSnapshotTest-1391512244 None] Created reservations ['e6ff87b1-7f5f-45c5-aaf0-3442fc737f5f', '95256482-7698-4555-9334-6dbeabbadee7', '92290de4-7958-4f78-b9c6-8328de0a06f3', 'f4dc9e4c-e2ad-4796-af9b-456880d599a3'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:26:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-ff844d92-5d42-4da0-946b-87c800fca50e tempest-CreateVolumesFromSnapshotTest-1391512244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:26:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-ff844d92-5d42-4da0-946b-87c800fca50e tempest-CreateVolumesFromSnapshotTest-1391512244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:26:24 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-ff844d92-5d42-4da0-946b-87c800fca50e tempest-CreateVolumesFromSnapshotTest-1391512244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:26:24 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-ff844d92-5d42-4da0-946b-87c800fca50e tempest-CreateVolumesFromSnapshotTest-1391512244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:26:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-ff844d92-5d42-4da0-946b-87c800fca50e tempest-CreateVolumesFromSnapshotTest-1391512244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:26:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ff844d92-5d42-4da0-946b-87c800fca50e tempest-CreateVolumesFromSnapshotTest-1391512244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:24 devstack sudo[106370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:26:24 devstack sudo[106370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:24 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-ce3315df-e2a9-46be-b2f0-afb052e4d8c2 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Acquiring lock "cinder-5d1e389b-f9b8-4a6b-85f5-7699d97c5827-delete_snapshot" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:26:24 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-ce3315df-e2a9-46be-b2f0-afb052e4d8c2 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Lock "cinder-5d1e389b-f9b8-4a6b-85f5-7699d97c5827-delete_snapshot" acquired by "delete_snapshot" :: waited 0.076s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:26:24 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-ce3315df-e2a9-46be-b2f0-afb052e4d8c2 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Acquiring lock "cinder-quobyte-715d38e9-d5e9-45cc-b836-3c447cca2e66" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:26:24 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-ce3315df-e2a9-46be-b2f0-afb052e4d8c2 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Lock "cinder-quobyte-715d38e9-d5e9-45cc-b836-3c447cca2e66" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:26:24 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-ce3315df-e2a9-46be-b2f0-afb052e4d8c2 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Acquiring lock "cinder-quobyte-5d1e389b-f9b8-4a6b-85f5-7699d97c5827" by "_delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:26:24 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-ce3315df-e2a9-46be-b2f0-afb052e4d8c2 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Lock "cinder-quobyte-5d1e389b-f9b8-4a6b-85f5-7699d97c5827" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:26:24 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-ce3315df-e2a9-46be-b2f0-afb052e4d8c2 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Deleting offline snapshot 5d1e389b-f9b8-4a6b-85f5-7699d97c5827 of volume 715d38e9-d5e9-45cc-b836-3c447cca2e66 {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 10:26:24 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-ce3315df-e2a9-46be-b2f0-afb052e4d8c2 tempest-CreateVolumesFromSnapshotTest-1391512244 None] snapshot_file for this snap is: volume-715d38e9-d5e9-45cc-b836-3c447cca2e66.5d1e389b-f9b8-4a6b-85f5-7699d97c5827 {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 10:26:24 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbeae56b-9a41-47aa-ac00-bf92a59154cc]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:26:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ce3315df-e2a9-46be-b2f0-afb052e4d8c2 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-715d38e9-d5e9-45cc-b836-3c447cca2e66.5d1e389b-f9b8-4a6b-85f5-7699d97c5827 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:25 devstack sudo[106372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-715d38e9-d5e9-45cc-b836-3c447cca2e66.5d1e389b-f9b8-4a6b-85f5-7699d97c5827 Jul 10 10:26:25 devstack sudo[106372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:26 devstack sudo[106370]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ff844d92-5d42-4da0-946b-87c800fca50e tempest-CreateVolumesFromSnapshotTest-1391512244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 1.741s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:26 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-ff844d92-5d42-4da0-946b-87c800fca50e tempest-CreateVolumesFromSnapshotTest-1391512244 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:26:26 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-ff844d92-5d42-4da0-946b-87c800fca50e tempest-CreateVolumesFromSnapshotTest-1391512244 None] Deleted volume successfully. Jul 10 10:26:26 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-ff844d92-5d42-4da0-946b-87c800fca50e tempest-CreateVolumesFromSnapshotTest-1391512244 None] Lock "cinder-ed0ccd1b-c5a7-4034-926f-7037d9be22ee-delete_volume" released by "delete_volume" :: held 5.356s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:26:26 devstack sudo[106314]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-bf3e635e-5b61-4402-b92a-4120834111c4 tempest-VolumeDependencyTests-448903000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-034ce50d-a4a2-4925-9299-d4648ea77602 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-cb9609c3-60f8-4e24-9744-904b9c4165c1" returned: 0 in 6.069s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:26 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ca5560-2789-43e4-87a6-13089fc99c4c]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:26:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-bf3e635e-5b61-4402-b92a-4120834111c4 tempest-VolumeDependencyTests-448903000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-034ce50d-a4a2-4925-9299-d4648ea77602 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:26 devstack sudo[106376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-034ce50d-a4a2-4925-9299-d4648ea77602 Jul 10 10:26:26 devstack sudo[106376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:26 devstack sudo[106372]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ce3315df-e2a9-46be-b2f0-afb052e4d8c2 tempest-CreateVolumesFromSnapshotTest-1391512244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-715d38e9-d5e9-45cc-b836-3c447cca2e66.5d1e389b-f9b8-4a6b-85f5-7699d97c5827" returned: 0 in 1.655s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:26 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-ce3315df-e2a9-46be-b2f0-afb052e4d8c2 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-715d38e9-d5e9-45cc-b836-3c447cca2e66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 10:26:26 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[07705065-dab8-4a65-8855-ba278ae12916]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:26:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ce3315df-e2a9-46be-b2f0-afb052e4d8c2 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-715d38e9-d5e9-45cc-b836-3c447cca2e66 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:26 devstack sudo[106380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-715d38e9-d5e9-45cc-b836-3c447cca2e66 Jul 10 10:26:26 devstack sudo[106380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:27 devstack sudo[106380]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ce3315df-e2a9-46be-b2f0-afb052e4d8c2 tempest-CreateVolumesFromSnapshotTest-1391512244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-715d38e9-d5e9-45cc-b836-3c447cca2e66" returned: 0 in 0.741s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ce3315df-e2a9-46be-b2f0-afb052e4d8c2 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-715d38e9-d5e9-45cc-b836-3c447cca2e66.5d1e389b-f9b8-4a6b-85f5-7699d97c5827 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:27 devstack sudo[106376]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-bf3e635e-5b61-4402-b92a-4120834111c4 tempest-VolumeDependencyTests-448903000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-034ce50d-a4a2-4925-9299-d4648ea77602" returned: 0 in 0.941s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:27 devstack cinder-volume[87234]: DEBUG cinder.image.image_utils [None req-bf3e635e-5b61-4402-b92a-4120834111c4 tempest-VolumeDependencyTests-448903000 None] Image conversion details: src /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-034ce50d-a4a2-4925-9299-d4648ea77602, size 1024.00 MB, duration 6.07 sec, destination /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-cb9609c3-60f8-4e24-9744-904b9c4165c1 {{(pid=87234) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 10:26:27 devstack sudo[106388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-715d38e9-d5e9-45cc-b836-3c447cca2e66.5d1e389b-f9b8-4a6b-85f5-7699d97c5827 Jul 10 10:26:27 devstack sudo[106388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:27 devstack cinder-volume[87234]: INFO cinder.image.image_utils [None req-bf3e635e-5b61-4402-b92a-4120834111c4 tempest-VolumeDependencyTests-448903000 None] Converted 1024.00 MB image at 168.70 MB/s Jul 10 10:26:27 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-bf3e635e-5b61-4402-b92a-4120834111c4 tempest-VolumeDependencyTests-448903000 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-cb9609c3-60f8-4e24-9744-904b9c4165c1 is being set with open permissions: ugo+rw Jul 10 10:26:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-bf3e635e-5b61-4402-b92a-4120834111c4 tempest-VolumeDependencyTests-448903000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-cb9609c3-60f8-4e24-9744-904b9c4165c1 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:27 devstack sudo[106390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-cb9609c3-60f8-4e24-9744-904b9c4165c1 Jul 10 10:26:27 devstack sudo[106390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:28 devstack sudo[106390]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-bf3e635e-5b61-4402-b92a-4120834111c4 tempest-VolumeDependencyTests-448903000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-cb9609c3-60f8-4e24-9744-904b9c4165c1" returned: 0 in 0.668s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:28 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-bf3e635e-5b61-4402-b92a-4120834111c4 tempest-VolumeDependencyTests-448903000 None] Lock "cinder-quobyte-cb9609c3-60f8-4e24-9744-904b9c4165c1" released by "_copy_volume_from_snapshot" :: held 9.533s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:26:28 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-bf3e635e-5b61-4402-b92a-4120834111c4 tempest-VolumeDependencyTests-448903000 None] Lock "cinder-quobyte-77943c84-2d65-40d4-8b99-b14b998cfd4b-cb9609c3-60f8-4e24-9744-904b9c4165c1" released by "_create_volume_from_snapshot" :: held 9.582s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:26:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-bf3e635e-5b61-4402-b92a-4120834111c4 tempest-VolumeDependencyTests-448903000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.623s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:26:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-9594a0e6-1b7e-4c46-8f8c-d688bf3842ec tempest-CinderUnicodeTest-1860234538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.836s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:26:28 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-9594a0e6-1b7e-4c46-8f8c-d688bf3842ec tempest-CinderUnicodeTest-1860234538 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:26:18Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-726828730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8d88311-aa4b-45c6-94b4-aeeb8a32f0f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1de8c217e88344058fbbb70fa368ea53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:26:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:26:18Z,use_quota=True,user_id='fc81c4caa48441efa52239fc2b9ae3f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:26:28 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-9594a0e6-1b7e-4c46-8f8c-d688bf3842ec tempest-CinderUnicodeTest-1860234538 None] Creating volume d8d88311-aa4b-45c6-94b4-aeeb8a32f0f2 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:26:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-9594a0e6-1b7e-4c46-8f8c-d688bf3842ec tempest-CinderUnicodeTest-1860234538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:26:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-9594a0e6-1b7e-4c46-8f8c-d688bf3842ec tempest-CinderUnicodeTest-1860234538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:26:28 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-9594a0e6-1b7e-4c46-8f8c-d688bf3842ec tempest-CinderUnicodeTest-1860234538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:26:28 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-9594a0e6-1b7e-4c46-8f8c-d688bf3842ec tempest-CinderUnicodeTest-1860234538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:26:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-9594a0e6-1b7e-4c46-8f8c-d688bf3842ec tempest-CinderUnicodeTest-1860234538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:26:28 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-9594a0e6-1b7e-4c46-8f8c-d688bf3842ec tempest-CinderUnicodeTest-1860234538 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:26:28 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-9594a0e6-1b7e-4c46-8f8c-d688bf3842ec tempest-CinderUnicodeTest-1860234538 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:26:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9594a0e6-1b7e-4c46-8f8c-d688bf3842ec tempest-CinderUnicodeTest-1860234538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d8d88311-aa4b-45c6-94b4-aeeb8a32f0f2 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:28 devstack sudo[106388]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:28 devstack cinder-volume[87234]: DEBUG dbcounter [-] [87234] Writing DB stats cinder:SELECT=152,cinder:UPDATE=223,cinder:INSERT=50,cinder:DELETE=20 {{(pid=87234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 10:26:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ce3315df-e2a9-46be-b2f0-afb052e4d8c2 tempest-CreateVolumesFromSnapshotTest-1391512244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-715d38e9-d5e9-45cc-b836-3c447cca2e66.5d1e389b-f9b8-4a6b-85f5-7699d97c5827" returned: 0 in 0.766s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:28 devstack sudo[106397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d8d88311-aa4b-45c6-94b4-aeeb8a32f0f2 1073741824 Jul 10 10:26:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ce3315df-e2a9-46be-b2f0-afb052e4d8c2 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-715d38e9-d5e9-45cc-b836-3c447cca2e66.5d1e389b-f9b8-4a6b-85f5-7699d97c5827 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:28 devstack sudo[106397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:28 devstack cinder-volume[87234]: DEBUG dbcounter [-] [87234] Writing DB stats cinder:UPDATE=205,cinder:SELECT=148,cinder:INSERT=55,cinder:DELETE=21 {{(pid=87234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 10:26:28 devstack sudo[106399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-715d38e9-d5e9-45cc-b836-3c447cca2e66.5d1e389b-f9b8-4a6b-85f5-7699d97c5827 Jul 10 10:26:28 devstack sudo[106399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:28 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-bf3e635e-5b61-4402-b92a-4120834111c4 tempest-VolumeDependencyTests-448903000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (418984a7-ad62-4777-b480-3427d13c99f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb9609c3-60f8-4e24-9744-904b9c4165c1', 'volume_size': 1, 'snapshot_id': '77943c84-2d65-40d4-8b99-b14b998cfd4b'}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:26:28 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-bf3e635e-5b61-4402-b92a-4120834111c4 tempest-VolumeDependencyTests-448903000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93cd16cb-0304-4ab5-9c79-ca0b06e988da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:26:28 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-bf3e635e-5b61-4402-b92a-4120834111c4 tempest-VolumeDependencyTests-448903000 None] Volume volume-cb9609c3-60f8-4e24-9744-904b9c4165c1 (cb9609c3-60f8-4e24-9744-904b9c4165c1): created successfully Jul 10 10:26:28 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-bf3e635e-5b61-4402-b92a-4120834111c4 tempest-VolumeDependencyTests-448903000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93cd16cb-0304-4ab5-9c79-ca0b06e988da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:26:28 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-bf3e635e-5b61-4402-b92a-4120834111c4 tempest-VolumeDependencyTests-448903000 None] Flow 'volume_create_manager' (c774346c-6166-416d-a4a1-4093dcf797ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:26:28 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-bf3e635e-5b61-4402-b92a-4120834111c4 tempest-VolumeDependencyTests-448903000 None] Created volume successfully. Jul 10 10:26:28 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-5a724753-3614-4556-ab1e-912992671923 tempest-VolumeDependencyTests-448903000 None] Acquiring lock "cinder-77943c84-2d65-40d4-8b99-b14b998cfd4b-delete_snapshot" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:26:28 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-5a724753-3614-4556-ab1e-912992671923 tempest-VolumeDependencyTests-448903000 None] Lock "cinder-77943c84-2d65-40d4-8b99-b14b998cfd4b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:26:28 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-5a724753-3614-4556-ab1e-912992671923 tempest-VolumeDependencyTests-448903000 None] Acquiring lock "cinder-quobyte-034ce50d-a4a2-4925-9299-d4648ea77602" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:26:28 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-5a724753-3614-4556-ab1e-912992671923 tempest-VolumeDependencyTests-448903000 None] Lock "cinder-quobyte-034ce50d-a4a2-4925-9299-d4648ea77602" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:26:28 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-5a724753-3614-4556-ab1e-912992671923 tempest-VolumeDependencyTests-448903000 None] Acquiring lock "cinder-quobyte-77943c84-2d65-40d4-8b99-b14b998cfd4b" by "_delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:26:28 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-5a724753-3614-4556-ab1e-912992671923 tempest-VolumeDependencyTests-448903000 None] Lock "cinder-quobyte-77943c84-2d65-40d4-8b99-b14b998cfd4b" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:26:28 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-5a724753-3614-4556-ab1e-912992671923 tempest-VolumeDependencyTests-448903000 None] Deleting offline snapshot 77943c84-2d65-40d4-8b99-b14b998cfd4b of volume 034ce50d-a4a2-4925-9299-d4648ea77602 {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 10:26:28 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-5a724753-3614-4556-ab1e-912992671923 tempest-VolumeDependencyTests-448903000 None] snapshot_file for this snap is: volume-034ce50d-a4a2-4925-9299-d4648ea77602.77943c84-2d65-40d4-8b99-b14b998cfd4b {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 10:26:28 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[6500478a-94d0-4820-9738-4c96086504f8]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:26:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5a724753-3614-4556-ab1e-912992671923 tempest-VolumeDependencyTests-448903000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-034ce50d-a4a2-4925-9299-d4648ea77602.77943c84-2d65-40d4-8b99-b14b998cfd4b {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:28 devstack sudo[106401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-034ce50d-a4a2-4925-9299-d4648ea77602.77943c84-2d65-40d4-8b99-b14b998cfd4b Jul 10 10:26:28 devstack sudo[106401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:28 devstack sudo[106399]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ce3315df-e2a9-46be-b2f0-afb052e4d8c2 tempest-CreateVolumesFromSnapshotTest-1391512244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-715d38e9-d5e9-45cc-b836-3c447cca2e66.5d1e389b-f9b8-4a6b-85f5-7699d97c5827" returned: 0 in 0.728s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:28 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-ce3315df-e2a9-46be-b2f0-afb052e4d8c2 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Lock "cinder-quobyte-5d1e389b-f9b8-4a6b-85f5-7699d97c5827" released by "_delete_snapshot" :: held 4.084s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:26:28 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-ce3315df-e2a9-46be-b2f0-afb052e4d8c2 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Lock "cinder-quobyte-715d38e9-d5e9-45cc-b836-3c447cca2e66" released by "delete_snapshot" :: held 4.136s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:26:28 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-ce3315df-e2a9-46be-b2f0-afb052e4d8c2 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Created reservations ['e54fbe5b-c8f1-4e20-8890-0227f03db3cc', 'cf33d38d-678f-45c9-969d-b59419ef29ea', '817c0940-a3c8-485e-91c7-60e8e70330af', '304f5876-3e86-4451-b2c2-7ebf228730a7'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:26:28 devstack sudo[106397]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9594a0e6-1b7e-4c46-8f8c-d688bf3842ec tempest-CinderUnicodeTest-1860234538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d8d88311-aa4b-45c6-94b4-aeeb8a32f0f2 1073741824" returned: 0 in 0.921s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:28 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-ce3315df-e2a9-46be-b2f0-afb052e4d8c2 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Delete snapshot completed successfully. Jul 10 10:26:28 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-ce3315df-e2a9-46be-b2f0-afb052e4d8c2 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Lock "cinder-5d1e389b-f9b8-4a6b-85f5-7699d97c5827-delete_snapshot" released by "delete_snapshot" :: held 4.306s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:26:29 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9594a0e6-1b7e-4c46-8f8c-d688bf3842ec tempest-CinderUnicodeTest-1860234538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d8d88311-aa4b-45c6-94b4-aeeb8a32f0f2 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:29 devstack sudo[106408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d8d88311-aa4b-45c6-94b4-aeeb8a32f0f2 Jul 10 10:26:29 devstack sudo[106408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:29 devstack sudo[106401]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:29 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5a724753-3614-4556-ab1e-912992671923 tempest-VolumeDependencyTests-448903000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-034ce50d-a4a2-4925-9299-d4648ea77602.77943c84-2d65-40d4-8b99-b14b998cfd4b" returned: 0 in 0.847s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:29 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-5a724753-3614-4556-ab1e-912992671923 tempest-VolumeDependencyTests-448903000 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-034ce50d-a4a2-4925-9299-d4648ea77602(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 10:26:29 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f92ecf-5908-4f60-8671-c1a2d45bfb80]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:26:29 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5a724753-3614-4556-ab1e-912992671923 tempest-VolumeDependencyTests-448903000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-034ce50d-a4a2-4925-9299-d4648ea77602 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:29 devstack sudo[106413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-034ce50d-a4a2-4925-9299-d4648ea77602 Jul 10 10:26:29 devstack sudo[106413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:29 devstack sudo[106408]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:29 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9594a0e6-1b7e-4c46-8f8c-d688bf3842ec tempest-CinderUnicodeTest-1860234538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d8d88311-aa4b-45c6-94b4-aeeb8a32f0f2" returned: 0 in 0.675s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:29 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-9594a0e6-1b7e-4c46-8f8c-d688bf3842ec tempest-CinderUnicodeTest-1860234538 None] <== create_volume: return (1642ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:26:29 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-9594a0e6-1b7e-4c46-8f8c-d688bf3842ec tempest-CinderUnicodeTest-1860234538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.646s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:26:29 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-2a0ebdd3-b9b2-4860-a636-bab9ae86f9b0 tempest-ProjectReaderTests-901478856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.538s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:26:29 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-2a0ebdd3-b9b2-4860-a636-bab9ae86f9b0 tempest-ProjectReaderTests-901478856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:26:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2085515936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=561e2fa5-6e51-4e0f-ad83-22150e82f835,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3ae08cf4bfc42e782558d8b9e55b009',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:26:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:26:23Z,use_quota=True,user_id='9b37d3c824f343e387285d0cddc1aa8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:26:29 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-2a0ebdd3-b9b2-4860-a636-bab9ae86f9b0 tempest-ProjectReaderTests-901478856 None] Creating volume 561e2fa5-6e51-4e0f-ad83-22150e82f835 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:26:29 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-2a0ebdd3-b9b2-4860-a636-bab9ae86f9b0 tempest-ProjectReaderTests-901478856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:26:29 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-2a0ebdd3-b9b2-4860-a636-bab9ae86f9b0 tempest-ProjectReaderTests-901478856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:26:29 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-2a0ebdd3-b9b2-4860-a636-bab9ae86f9b0 tempest-ProjectReaderTests-901478856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:26:29 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-2a0ebdd3-b9b2-4860-a636-bab9ae86f9b0 tempest-ProjectReaderTests-901478856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:26:29 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-2a0ebdd3-b9b2-4860-a636-bab9ae86f9b0 tempest-ProjectReaderTests-901478856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:26:29 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-2a0ebdd3-b9b2-4860-a636-bab9ae86f9b0 tempest-ProjectReaderTests-901478856 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:26:29 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-2a0ebdd3-b9b2-4860-a636-bab9ae86f9b0 tempest-ProjectReaderTests-901478856 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:26:29 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-2a0ebdd3-b9b2-4860-a636-bab9ae86f9b0 tempest-ProjectReaderTests-901478856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-561e2fa5-6e51-4e0f-ad83-22150e82f835 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:29 devstack sudo[106416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-561e2fa5-6e51-4e0f-ad83-22150e82f835 1073741824 Jul 10 10:26:29 devstack sudo[106416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:29 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9594a0e6-1b7e-4c46-8f8c-d688bf3842ec tempest-CinderUnicodeTest-1860234538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df9d1116-eba2-4c1a-b3f8-ffb1104792d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8d88311-aa4b-45c6-94b4-aeeb8a32f0f2', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:26:29 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9594a0e6-1b7e-4c46-8f8c-d688bf3842ec tempest-CinderUnicodeTest-1860234538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cf1f5ab-486b-4945-adb4-5be673aa71b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:26:29 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-9594a0e6-1b7e-4c46-8f8c-d688bf3842ec tempest-CinderUnicodeTest-1860234538 None] Volume volume-d8d88311-aa4b-45c6-94b4-aeeb8a32f0f2 (d8d88311-aa4b-45c6-94b4-aeeb8a32f0f2): created successfully Jul 10 10:26:29 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9594a0e6-1b7e-4c46-8f8c-d688bf3842ec tempest-CinderUnicodeTest-1860234538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cf1f5ab-486b-4945-adb4-5be673aa71b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:26:29 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-9594a0e6-1b7e-4c46-8f8c-d688bf3842ec tempest-CinderUnicodeTest-1860234538 None] Flow 'volume_create_manager' (1d8cbaf2-6763-4e12-9d69-7dfa5362cafd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:26:29 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-9594a0e6-1b7e-4c46-8f8c-d688bf3842ec tempest-CinderUnicodeTest-1860234538 None] Created volume successfully. Jul 10 10:26:29 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-9c15ce3a-3b4d-424b-80f9-6c6d534a5445 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Acquiring lock "cinder-715d38e9-d5e9-45cc-b836-3c447cca2e66-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:26:29 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-9c15ce3a-3b4d-424b-80f9-6c6d534a5445 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Lock "cinder-715d38e9-d5e9-45cc-b836-3c447cca2e66-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:26:30 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-9c15ce3a-3b4d-424b-80f9-6c6d534a5445 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Acquiring lock "cinder-quobyte-715d38e9-d5e9-45cc-b836-3c447cca2e66" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:26:30 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-9c15ce3a-3b4d-424b-80f9-6c6d534a5445 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Lock "cinder-quobyte-715d38e9-d5e9-45cc-b836-3c447cca2e66" acquired by "delete_volume" :: waited 0.025s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:26:30 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[bffc36be-bdaa-42bf-aaa2-8acc1c3ff753]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:26:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9c15ce3a-3b4d-424b-80f9-6c6d534a5445 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-715d38e9-d5e9-45cc-b836-3c447cca2e66 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:30 devstack sudo[106418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-715d38e9-d5e9-45cc-b836-3c447cca2e66 Jul 10 10:26:30 devstack sudo[106418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:30 devstack sudo[106413]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5a724753-3614-4556-ab1e-912992671923 tempest-VolumeDependencyTests-448903000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-034ce50d-a4a2-4925-9299-d4648ea77602" returned: 0 in 0.805s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5a724753-3614-4556-ab1e-912992671923 tempest-VolumeDependencyTests-448903000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-034ce50d-a4a2-4925-9299-d4648ea77602.77943c84-2d65-40d4-8b99-b14b998cfd4b {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:30 devstack sudo[106425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-034ce50d-a4a2-4925-9299-d4648ea77602.77943c84-2d65-40d4-8b99-b14b998cfd4b Jul 10 10:26:30 devstack sudo[106425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-13bbbc52-b1d6-4777-9bba-6f963fe74252 tempest-CinderUnicodeTest-1860234538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:26:30 devstack sudo[106416]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-2a0ebdd3-b9b2-4860-a636-bab9ae86f9b0 tempest-ProjectReaderTests-901478856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-561e2fa5-6e51-4e0f-ad83-22150e82f835 1073741824" returned: 0 in 0.943s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-2a0ebdd3-b9b2-4860-a636-bab9ae86f9b0 tempest-ProjectReaderTests-901478856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-561e2fa5-6e51-4e0f-ad83-22150e82f835 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:30 devstack sudo[106430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-561e2fa5-6e51-4e0f-ad83-22150e82f835 Jul 10 10:26:30 devstack sudo[106430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:30 devstack sudo[106418]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9c15ce3a-3b4d-424b-80f9-6c6d534a5445 tempest-CreateVolumesFromSnapshotTest-1391512244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-715d38e9-d5e9-45cc-b836-3c447cca2e66" returned: 0 in 0.882s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9c15ce3a-3b4d-424b-80f9-6c6d534a5445 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-715d38e9-d5e9-45cc-b836-3c447cca2e66 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:31 devstack sudo[106445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-715d38e9-d5e9-45cc-b836-3c447cca2e66 Jul 10 10:26:31 devstack sudo[106445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:31 devstack sudo[106425]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5a724753-3614-4556-ab1e-912992671923 tempest-VolumeDependencyTests-448903000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-034ce50d-a4a2-4925-9299-d4648ea77602.77943c84-2d65-40d4-8b99-b14b998cfd4b" returned: 0 in 0.871s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5a724753-3614-4556-ab1e-912992671923 tempest-VolumeDependencyTests-448903000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-034ce50d-a4a2-4925-9299-d4648ea77602.77943c84-2d65-40d4-8b99-b14b998cfd4b {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:31 devstack sudo[106447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-034ce50d-a4a2-4925-9299-d4648ea77602.77943c84-2d65-40d4-8b99-b14b998cfd4b Jul 10 10:26:31 devstack sudo[106447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:31 devstack sudo[106430]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-2a0ebdd3-b9b2-4860-a636-bab9ae86f9b0 tempest-ProjectReaderTests-901478856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-561e2fa5-6e51-4e0f-ad83-22150e82f835" returned: 0 in 0.688s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:31 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-2a0ebdd3-b9b2-4860-a636-bab9ae86f9b0 tempest-ProjectReaderTests-901478856 None] <== create_volume: return (1676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:26:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-2a0ebdd3-b9b2-4860-a636-bab9ae86f9b0 tempest-ProjectReaderTests-901478856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.679s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:26:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-13bbbc52-b1d6-4777-9bba-6f963fe74252 tempest-CinderUnicodeTest-1860234538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.825s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:26:31 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-2a0ebdd3-b9b2-4860-a636-bab9ae86f9b0 tempest-ProjectReaderTests-901478856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cc44431-8131-4438-9b1d-56b6af5e4cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-561e2fa5-6e51-4e0f-ad83-22150e82f835', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:26:31 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-2a0ebdd3-b9b2-4860-a636-bab9ae86f9b0 tempest-ProjectReaderTests-901478856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5450e992-4b42-46aa-a9b3-7d10075935e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:26:31 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-13bbbc52-b1d6-4777-9bba-6f963fe74252 tempest-CinderUnicodeTest-1860234538 None] Creating offline snapshot 840db9fd-0b72-4235-bca0-f63af14db7e9 of volume d8d88311-aa4b-45c6-94b4-aeeb8a32f0f2 {{(pid=87234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 10:26:31 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-2a0ebdd3-b9b2-4860-a636-bab9ae86f9b0 tempest-ProjectReaderTests-901478856 None] Volume volume-561e2fa5-6e51-4e0f-ad83-22150e82f835 (561e2fa5-6e51-4e0f-ad83-22150e82f835): created successfully Jul 10 10:26:31 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-2a0ebdd3-b9b2-4860-a636-bab9ae86f9b0 tempest-ProjectReaderTests-901478856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5450e992-4b42-46aa-a9b3-7d10075935e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:26:31 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-2a0ebdd3-b9b2-4860-a636-bab9ae86f9b0 tempest-ProjectReaderTests-901478856 None] Flow 'volume_create_manager' (b056727c-7d97-485a-907b-aad5e77a2422) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:26:31 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[3172aa2b-e210-44f3-8c75-c1c22619d4fb]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:26:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-13bbbc52-b1d6-4777-9bba-6f963fe74252 tempest-CinderUnicodeTest-1860234538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d8d88311-aa4b-45c6-94b4-aeeb8a32f0f2 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:31 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-2a0ebdd3-b9b2-4860-a636-bab9ae86f9b0 tempest-ProjectReaderTests-901478856 None] Created volume successfully. Jul 10 10:26:31 devstack sudo[106450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d8d88311-aa4b-45c6-94b4-aeeb8a32f0f2 Jul 10 10:26:31 devstack sudo[106450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:31 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-8f60c8c9-80c0-46de-925f-4f6c1a5f6769 tempest-ProjectReaderTests-901478856 None] Acquiring lock "cinder-561e2fa5-6e51-4e0f-ad83-22150e82f835-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:26:31 devstack sudo[106445]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9c15ce3a-3b4d-424b-80f9-6c6d534a5445 tempest-CreateVolumesFromSnapshotTest-1391512244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-715d38e9-d5e9-45cc-b836-3c447cca2e66" returned: 0 in 0.781s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:31 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-8f60c8c9-80c0-46de-925f-4f6c1a5f6769 tempest-ProjectReaderTests-901478856 None] Lock "cinder-561e2fa5-6e51-4e0f-ad83-22150e82f835-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:26:31 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-9c15ce3a-3b4d-424b-80f9-6c6d534a5445 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Lock "cinder-quobyte-715d38e9-d5e9-45cc-b836-3c447cca2e66" released by "delete_volume" :: held 1.747s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:26:31 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-8f60c8c9-80c0-46de-925f-4f6c1a5f6769 tempest-ProjectReaderTests-901478856 None] Acquiring lock "cinder-quobyte-561e2fa5-6e51-4e0f-ad83-22150e82f835" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:26:31 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-8f60c8c9-80c0-46de-925f-4f6c1a5f6769 tempest-ProjectReaderTests-901478856 None] Lock "cinder-quobyte-561e2fa5-6e51-4e0f-ad83-22150e82f835" acquired by "delete_volume" :: waited 0.019s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:26:31 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[858a4004-73fb-411a-ab02-ed83e4b4aefd]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:26:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-8f60c8c9-80c0-46de-925f-4f6c1a5f6769 tempest-ProjectReaderTests-901478856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-561e2fa5-6e51-4e0f-ad83-22150e82f835 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:31 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-9c15ce3a-3b4d-424b-80f9-6c6d534a5445 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Created reservations ['dade5434-fb84-441a-b953-d66495ec72be', 'be119539-b0fd-4f14-be91-f844b1ee2b0b', '1da9d0ff-c9f4-4b55-b72c-194b40cee071', '62a35f62-74bc-4fc0-b8a0-ffa465b8acd3'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:26:31 devstack sudo[106447]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5a724753-3614-4556-ab1e-912992671923 tempest-VolumeDependencyTests-448903000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-034ce50d-a4a2-4925-9299-d4648ea77602.77943c84-2d65-40d4-8b99-b14b998cfd4b" returned: 0 in 0.792s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:32 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-9c15ce3a-3b4d-424b-80f9-6c6d534a5445 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:26:32 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-9c15ce3a-3b4d-424b-80f9-6c6d534a5445 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:26:32 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-9c15ce3a-3b4d-424b-80f9-6c6d534a5445 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:26:32 devstack sudo[106454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-561e2fa5-6e51-4e0f-ad83-22150e82f835 Jul 10 10:26:32 devstack sudo[106454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:32 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-9c15ce3a-3b4d-424b-80f9-6c6d534a5445 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:26:32 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-9c15ce3a-3b4d-424b-80f9-6c6d534a5445 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:26:32 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9c15ce3a-3b4d-424b-80f9-6c6d534a5445 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:32 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-5a724753-3614-4556-ab1e-912992671923 tempest-VolumeDependencyTests-448903000 None] Lock "cinder-quobyte-77943c84-2d65-40d4-8b99-b14b998cfd4b" released by "_delete_snapshot" :: held 3.457s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:26:32 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-5a724753-3614-4556-ab1e-912992671923 tempest-VolumeDependencyTests-448903000 None] Lock "cinder-quobyte-034ce50d-a4a2-4925-9299-d4648ea77602" released by "delete_snapshot" :: held 3.494s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:26:32 devstack sudo[106456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:26:32 devstack sudo[106456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:32 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-5a724753-3614-4556-ab1e-912992671923 tempest-VolumeDependencyTests-448903000 None] Created reservations ['246aa24b-f242-4dcb-bdce-fbff08cdbec3', '3a99c70a-fcc2-4962-aa21-5a59cb8d902c', '3f2291a2-32ba-4c7a-bf7a-a954eff40b6c', 'fdc3dc1f-e9c8-49dc-b7b5-84f708673d89'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:26:32 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-5a724753-3614-4556-ab1e-912992671923 tempest-VolumeDependencyTests-448903000 None] Delete snapshot completed successfully. Jul 10 10:26:32 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-5a724753-3614-4556-ab1e-912992671923 tempest-VolumeDependencyTests-448903000 None] Lock "cinder-77943c84-2d65-40d4-8b99-b14b998cfd4b-delete_snapshot" released by "delete_snapshot" :: held 3.677s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:26:32 devstack sudo[106450]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:32 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-13bbbc52-b1d6-4777-9bba-6f963fe74252 tempest-CinderUnicodeTest-1860234538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d8d88311-aa4b-45c6-94b4-aeeb8a32f0f2" returned: 0 in 1.018s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:32 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-13bbbc52-b1d6-4777-9bba-6f963fe74252 tempest-CinderUnicodeTest-1860234538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d8d88311-aa4b-45c6-94b4-aeeb8a32f0f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d8d88311-aa4b-45c6-94b4-aeeb8a32f0f2.840db9fd-0b72-4235-bca0-f63af14db7e9 1G {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:32 devstack sudo[106462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d8d88311-aa4b-45c6-94b4-aeeb8a32f0f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d8d88311-aa4b-45c6-94b4-aeeb8a32f0f2.840db9fd-0b72-4235-bca0-f63af14db7e9 1G Jul 10 10:26:32 devstack sudo[106462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:32 devstack sudo[106456]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:32 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-3fcc4234-e74f-44a1-912b-aa3339205698 tempest-VolumeDependencyTests-448903000 None] Acquiring lock "cinder-034ce50d-a4a2-4925-9299-d4648ea77602-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:26:32 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9c15ce3a-3b4d-424b-80f9-6c6d534a5445 tempest-CreateVolumesFromSnapshotTest-1391512244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.837s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:32 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-9c15ce3a-3b4d-424b-80f9-6c6d534a5445 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:26:32 devstack sudo[106454]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:32 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-9c15ce3a-3b4d-424b-80f9-6c6d534a5445 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Deleted volume successfully. Jul 10 10:26:32 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-3fcc4234-e74f-44a1-912b-aa3339205698 tempest-VolumeDependencyTests-448903000 None] Lock "cinder-034ce50d-a4a2-4925-9299-d4648ea77602-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:26:32 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-8f60c8c9-80c0-46de-925f-4f6c1a5f6769 tempest-ProjectReaderTests-901478856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-561e2fa5-6e51-4e0f-ad83-22150e82f835" returned: 0 in 1.024s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:32 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-8f60c8c9-80c0-46de-925f-4f6c1a5f6769 tempest-ProjectReaderTests-901478856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-561e2fa5-6e51-4e0f-ad83-22150e82f835 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:32 devstack sudo[106469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-561e2fa5-6e51-4e0f-ad83-22150e82f835 Jul 10 10:26:32 devstack sudo[106469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:32 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-9c15ce3a-3b4d-424b-80f9-6c6d534a5445 tempest-CreateVolumesFromSnapshotTest-1391512244 None] Lock "cinder-715d38e9-d5e9-45cc-b836-3c447cca2e66-delete_volume" released by "delete_volume" :: held 2.992s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:26:32 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-3fcc4234-e74f-44a1-912b-aa3339205698 tempest-VolumeDependencyTests-448903000 None] Acquiring lock "cinder-quobyte-034ce50d-a4a2-4925-9299-d4648ea77602" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:26:33 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-3fcc4234-e74f-44a1-912b-aa3339205698 tempest-VolumeDependencyTests-448903000 None] Lock "cinder-quobyte-034ce50d-a4a2-4925-9299-d4648ea77602" acquired by "delete_volume" :: waited 0.026s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:26:33 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[877bb831-633d-4d11-9831-c88b04653f32]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:26:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3fcc4234-e74f-44a1-912b-aa3339205698 tempest-VolumeDependencyTests-448903000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-034ce50d-a4a2-4925-9299-d4648ea77602 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:33 devstack sudo[106472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-034ce50d-a4a2-4925-9299-d4648ea77602 Jul 10 10:26:33 devstack sudo[106472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:33 devstack sudo[106462]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-13bbbc52-b1d6-4777-9bba-6f963fe74252 tempest-CinderUnicodeTest-1860234538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d8d88311-aa4b-45c6-94b4-aeeb8a32f0f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d8d88311-aa4b-45c6-94b4-aeeb8a32f0f2.840db9fd-0b72-4235-bca0-f63af14db7e9 1G" returned: 0 in 0.979s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-13bbbc52-b1d6-4777-9bba-6f963fe74252 tempest-CinderUnicodeTest-1860234538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8d88311-aa4b-45c6-94b4-aeeb8a32f0f2 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d8d88311-aa4b-45c6-94b4-aeeb8a32f0f2.840db9fd-0b72-4235-bca0-f63af14db7e9 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:33 devstack sudo[106478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8d88311-aa4b-45c6-94b4-aeeb8a32f0f2 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d8d88311-aa4b-45c6-94b4-aeeb8a32f0f2.840db9fd-0b72-4235-bca0-f63af14db7e9 Jul 10 10:26:33 devstack sudo[106478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:33 devstack sudo[106469]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-8f60c8c9-80c0-46de-925f-4f6c1a5f6769 tempest-ProjectReaderTests-901478856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-561e2fa5-6e51-4e0f-ad83-22150e82f835" returned: 0 in 0.822s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:33 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-8f60c8c9-80c0-46de-925f-4f6c1a5f6769 tempest-ProjectReaderTests-901478856 None] Lock "cinder-quobyte-561e2fa5-6e51-4e0f-ad83-22150e82f835" released by "delete_volume" :: held 1.901s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:26:33 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-8f60c8c9-80c0-46de-925f-4f6c1a5f6769 tempest-ProjectReaderTests-901478856 None] Created reservations ['2310192d-c999-424b-9547-7bb46504e69d', '70749e02-03fd-4c1f-8730-fa372ff0b3be', '28b45e29-546d-447e-bb43-65b772df79fd', 'fbab26cb-952a-45f5-b7a1-8cf2e11d7600'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:26:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-8f60c8c9-80c0-46de-925f-4f6c1a5f6769 tempest-ProjectReaderTests-901478856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:26:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-8f60c8c9-80c0-46de-925f-4f6c1a5f6769 tempest-ProjectReaderTests-901478856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:26:33 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-8f60c8c9-80c0-46de-925f-4f6c1a5f6769 tempest-ProjectReaderTests-901478856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:26:33 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-8f60c8c9-80c0-46de-925f-4f6c1a5f6769 tempest-ProjectReaderTests-901478856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:26:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-8f60c8c9-80c0-46de-925f-4f6c1a5f6769 tempest-ProjectReaderTests-901478856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:26:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-8f60c8c9-80c0-46de-925f-4f6c1a5f6769 tempest-ProjectReaderTests-901478856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:33 devstack sudo[106485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:26:33 devstack sudo[106485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:34 devstack sudo[106472]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:34 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3fcc4234-e74f-44a1-912b-aa3339205698 tempest-VolumeDependencyTests-448903000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-034ce50d-a4a2-4925-9299-d4648ea77602" returned: 0 in 1.010s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:34 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3fcc4234-e74f-44a1-912b-aa3339205698 tempest-VolumeDependencyTests-448903000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-034ce50d-a4a2-4925-9299-d4648ea77602 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:34 devstack sudo[106487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-034ce50d-a4a2-4925-9299-d4648ea77602 Jul 10 10:26:34 devstack sudo[106487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:34 devstack sudo[106478]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:34 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-13bbbc52-b1d6-4777-9bba-6f963fe74252 tempest-CinderUnicodeTest-1860234538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8d88311-aa4b-45c6-94b4-aeeb8a32f0f2 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d8d88311-aa4b-45c6-94b4-aeeb8a32f0f2.840db9fd-0b72-4235-bca0-f63af14db7e9" returned: 0 in 1.010s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:34 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-13bbbc52-b1d6-4777-9bba-6f963fe74252 tempest-CinderUnicodeTest-1860234538 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d8d88311-aa4b-45c6-94b4-aeeb8a32f0f2.840db9fd-0b72-4235-bca0-f63af14db7e9 is being set with open permissions: ugo+rw Jul 10 10:26:34 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-13bbbc52-b1d6-4777-9bba-6f963fe74252 tempest-CinderUnicodeTest-1860234538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d8d88311-aa4b-45c6-94b4-aeeb8a32f0f2.840db9fd-0b72-4235-bca0-f63af14db7e9 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:34 devstack sudo[106493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d8d88311-aa4b-45c6-94b4-aeeb8a32f0f2.840db9fd-0b72-4235-bca0-f63af14db7e9 Jul 10 10:26:34 devstack sudo[106493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:34 devstack sudo[106485]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:35 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-8f60c8c9-80c0-46de-925f-4f6c1a5f6769 tempest-ProjectReaderTests-901478856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 1.099s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:35 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-8f60c8c9-80c0-46de-925f-4f6c1a5f6769 tempest-ProjectReaderTests-901478856 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:26:35 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-8f60c8c9-80c0-46de-925f-4f6c1a5f6769 tempest-ProjectReaderTests-901478856 None] Deleted volume successfully. Jul 10 10:26:35 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-8f60c8c9-80c0-46de-925f-4f6c1a5f6769 tempest-ProjectReaderTests-901478856 None] Lock "cinder-561e2fa5-6e51-4e0f-ad83-22150e82f835-delete_volume" released by "delete_volume" :: held 3.267s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:26:35 devstack sudo[106487]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:35 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3fcc4234-e74f-44a1-912b-aa3339205698 tempest-VolumeDependencyTests-448903000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-034ce50d-a4a2-4925-9299-d4648ea77602" returned: 0 in 1.120s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:35 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-3fcc4234-e74f-44a1-912b-aa3339205698 tempest-VolumeDependencyTests-448903000 None] Lock "cinder-quobyte-034ce50d-a4a2-4925-9299-d4648ea77602" released by "delete_volume" :: held 2.203s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:26:35 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-3fcc4234-e74f-44a1-912b-aa3339205698 tempest-VolumeDependencyTests-448903000 None] Created reservations ['8453fc01-9fee-4555-a039-58d48d70b401', 'd40e8e68-5631-4e57-87d9-484f19294d0b', '697d8e45-bcef-4b9e-bc1e-1bfd6339c775', 'a9dbe42e-9058-4bac-9b71-61fcf61728b2'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:26:35 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-3fcc4234-e74f-44a1-912b-aa3339205698 tempest-VolumeDependencyTests-448903000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:26:35 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-3fcc4234-e74f-44a1-912b-aa3339205698 tempest-VolumeDependencyTests-448903000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:26:35 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-3fcc4234-e74f-44a1-912b-aa3339205698 tempest-VolumeDependencyTests-448903000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:26:35 devstack sudo[106493]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:35 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-3fcc4234-e74f-44a1-912b-aa3339205698 tempest-VolumeDependencyTests-448903000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:26:35 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-3fcc4234-e74f-44a1-912b-aa3339205698 tempest-VolumeDependencyTests-448903000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:26:35 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3fcc4234-e74f-44a1-912b-aa3339205698 tempest-VolumeDependencyTests-448903000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:35 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-13bbbc52-b1d6-4777-9bba-6f963fe74252 tempest-CinderUnicodeTest-1860234538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d8d88311-aa4b-45c6-94b4-aeeb8a32f0f2.840db9fd-0b72-4235-bca0-f63af14db7e9" returned: 0 in 0.943s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:35 devstack sudo[106498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:26:35 devstack sudo[106498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:35 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-13bbbc52-b1d6-4777-9bba-6f963fe74252 tempest-CinderUnicodeTest-1860234538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d8d88311-aa4b-45c6-94b4-aeeb8a32f0f2.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:35 devstack sudo[106500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d8d88311-aa4b-45c6-94b4-aeeb8a32f0f2.info Jul 10 10:26:35 devstack sudo[106500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:36 devstack sudo[106500]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:36 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-13bbbc52-b1d6-4777-9bba-6f963fe74252 tempest-CinderUnicodeTest-1860234538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d8d88311-aa4b-45c6-94b4-aeeb8a32f0f2.info" returned: 0 in 0.789s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:36 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-13bbbc52-b1d6-4777-9bba-6f963fe74252 tempest-CinderUnicodeTest-1860234538 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d8d88311-aa4b-45c6-94b4-aeeb8a32f0f2.info is being set with open permissions: ugo+rw Jul 10 10:26:36 devstack sudo[106498]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:36 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-13bbbc52-b1d6-4777-9bba-6f963fe74252 tempest-CinderUnicodeTest-1860234538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d8d88311-aa4b-45c6-94b4-aeeb8a32f0f2.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:36 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3fcc4234-e74f-44a1-912b-aa3339205698 tempest-VolumeDependencyTests-448903000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.868s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:36 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-3fcc4234-e74f-44a1-912b-aa3339205698 tempest-VolumeDependencyTests-448903000 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:26:36 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-3fcc4234-e74f-44a1-912b-aa3339205698 tempest-VolumeDependencyTests-448903000 None] Deleted volume successfully. Jul 10 10:26:36 devstack sudo[106504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d8d88311-aa4b-45c6-94b4-aeeb8a32f0f2.info Jul 10 10:26:36 devstack sudo[106504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:36 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-3fcc4234-e74f-44a1-912b-aa3339205698 tempest-VolumeDependencyTests-448903000 None] Lock "cinder-034ce50d-a4a2-4925-9299-d4648ea77602-delete_volume" released by "delete_volume" :: held 3.411s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:26:36 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f970c173-74ce-4db1-a0af-ef3a071485e3 tempest-VolumeDependencyTests-448903000 None] Acquiring lock "cinder-cb9609c3-60f8-4e24-9744-904b9c4165c1-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:26:36 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f970c173-74ce-4db1-a0af-ef3a071485e3 tempest-VolumeDependencyTests-448903000 None] Lock "cinder-cb9609c3-60f8-4e24-9744-904b9c4165c1-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:26:36 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f970c173-74ce-4db1-a0af-ef3a071485e3 tempest-VolumeDependencyTests-448903000 None] Acquiring lock "cinder-quobyte-cb9609c3-60f8-4e24-9744-904b9c4165c1" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:26:36 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f970c173-74ce-4db1-a0af-ef3a071485e3 tempest-VolumeDependencyTests-448903000 None] Lock "cinder-quobyte-cb9609c3-60f8-4e24-9744-904b9c4165c1" acquired by "delete_volume" :: waited 0.025s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:26:36 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[5373905c-d735-4ef0-86c0-962264557965]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:26:36 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f970c173-74ce-4db1-a0af-ef3a071485e3 tempest-VolumeDependencyTests-448903000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-cb9609c3-60f8-4e24-9744-904b9c4165c1 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:36 devstack sudo[106506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-cb9609c3-60f8-4e24-9744-904b9c4165c1 Jul 10 10:26:36 devstack sudo[106506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:37 devstack sudo[106504]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:37 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-13bbbc52-b1d6-4777-9bba-6f963fe74252 tempest-CinderUnicodeTest-1860234538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d8d88311-aa4b-45c6-94b4-aeeb8a32f0f2.info" returned: 0 in 0.854s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:37 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-13bbbc52-b1d6-4777-9bba-6f963fe74252 tempest-CinderUnicodeTest-1860234538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.753s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:26:37 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-13bbbc52-b1d6-4777-9bba-6f963fe74252 tempest-CinderUnicodeTest-1860234538 None] Create snapshot completed successfully Jul 10 10:26:37 devstack sudo[106506]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:37 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f970c173-74ce-4db1-a0af-ef3a071485e3 tempest-VolumeDependencyTests-448903000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-cb9609c3-60f8-4e24-9744-904b9c4165c1" returned: 0 in 0.900s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:37 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f970c173-74ce-4db1-a0af-ef3a071485e3 tempest-VolumeDependencyTests-448903000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-cb9609c3-60f8-4e24-9744-904b9c4165c1 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:37 devstack sudo[106512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-cb9609c3-60f8-4e24-9744-904b9c4165c1 Jul 10 10:26:37 devstack sudo[106512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:38 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-02fc8452-9172-4a29-ab9a-f9d04e020601 tempest-CinderUnicodeTest-1860234538 None] Acquiring lock "cinder-840db9fd-0b72-4235-bca0-f63af14db7e9-delete_snapshot" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:26:38 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-02fc8452-9172-4a29-ab9a-f9d04e020601 tempest-CinderUnicodeTest-1860234538 None] Lock "cinder-840db9fd-0b72-4235-bca0-f63af14db7e9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:26:38 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-02fc8452-9172-4a29-ab9a-f9d04e020601 tempest-CinderUnicodeTest-1860234538 None] Acquiring lock "cinder-quobyte-d8d88311-aa4b-45c6-94b4-aeeb8a32f0f2" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:26:38 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-02fc8452-9172-4a29-ab9a-f9d04e020601 tempest-CinderUnicodeTest-1860234538 None] Lock "cinder-quobyte-d8d88311-aa4b-45c6-94b4-aeeb8a32f0f2" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:26:38 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-02fc8452-9172-4a29-ab9a-f9d04e020601 tempest-CinderUnicodeTest-1860234538 None] Acquiring lock "cinder-quobyte-840db9fd-0b72-4235-bca0-f63af14db7e9" by "_delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:26:38 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-02fc8452-9172-4a29-ab9a-f9d04e020601 tempest-CinderUnicodeTest-1860234538 None] Lock "cinder-quobyte-840db9fd-0b72-4235-bca0-f63af14db7e9" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:26:38 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-02fc8452-9172-4a29-ab9a-f9d04e020601 tempest-CinderUnicodeTest-1860234538 None] Deleting offline snapshot 840db9fd-0b72-4235-bca0-f63af14db7e9 of volume d8d88311-aa4b-45c6-94b4-aeeb8a32f0f2 {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 10:26:38 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-02fc8452-9172-4a29-ab9a-f9d04e020601 tempest-CinderUnicodeTest-1860234538 None] snapshot_file for this snap is: volume-d8d88311-aa4b-45c6-94b4-aeeb8a32f0f2.840db9fd-0b72-4235-bca0-f63af14db7e9 {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 10:26:38 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[5546b012-c00c-468a-9191-57f4d802c2a1]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:26:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-02fc8452-9172-4a29-ab9a-f9d04e020601 tempest-CinderUnicodeTest-1860234538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d8d88311-aa4b-45c6-94b4-aeeb8a32f0f2.840db9fd-0b72-4235-bca0-f63af14db7e9 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:38 devstack sudo[106512]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f970c173-74ce-4db1-a0af-ef3a071485e3 tempest-VolumeDependencyTests-448903000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-cb9609c3-60f8-4e24-9744-904b9c4165c1" returned: 0 in 0.832s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:38 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f970c173-74ce-4db1-a0af-ef3a071485e3 tempest-VolumeDependencyTests-448903000 None] Lock "cinder-quobyte-cb9609c3-60f8-4e24-9744-904b9c4165c1" released by "delete_volume" :: held 1.790s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:26:38 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-f970c173-74ce-4db1-a0af-ef3a071485e3 tempest-VolumeDependencyTests-448903000 None] Created reservations ['65383f56-5335-49ad-8656-b6730479f9f1', '6eb5e4d3-21fa-4931-9507-d7cceb4bee64', '03880633-c5be-44b1-9617-64e7864bc8f7', '9fe8afab-adac-4dc4-ba9d-5d1638f3a92a'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:26:38 devstack sudo[106516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d8d88311-aa4b-45c6-94b4-aeeb8a32f0f2.840db9fd-0b72-4235-bca0-f63af14db7e9 Jul 10 10:26:38 devstack sudo[106516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f970c173-74ce-4db1-a0af-ef3a071485e3 tempest-VolumeDependencyTests-448903000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:26:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f970c173-74ce-4db1-a0af-ef3a071485e3 tempest-VolumeDependencyTests-448903000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:26:38 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f970c173-74ce-4db1-a0af-ef3a071485e3 tempest-VolumeDependencyTests-448903000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:26:38 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f970c173-74ce-4db1-a0af-ef3a071485e3 tempest-VolumeDependencyTests-448903000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:26:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f970c173-74ce-4db1-a0af-ef3a071485e3 tempest-VolumeDependencyTests-448903000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:26:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f970c173-74ce-4db1-a0af-ef3a071485e3 tempest-VolumeDependencyTests-448903000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:38 devstack sudo[106518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:26:38 devstack sudo[106518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:39 devstack sudo[106518]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:39 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f970c173-74ce-4db1-a0af-ef3a071485e3 tempest-VolumeDependencyTests-448903000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.919s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:39 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-f970c173-74ce-4db1-a0af-ef3a071485e3 tempest-VolumeDependencyTests-448903000 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:26:39 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-f970c173-74ce-4db1-a0af-ef3a071485e3 tempest-VolumeDependencyTests-448903000 None] Deleted volume successfully. Jul 10 10:26:39 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f970c173-74ce-4db1-a0af-ef3a071485e3 tempest-VolumeDependencyTests-448903000 None] Lock "cinder-cb9609c3-60f8-4e24-9744-904b9c4165c1-delete_volume" released by "delete_volume" :: held 2.996s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:26:39 devstack sudo[106516]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:39 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-02fc8452-9172-4a29-ab9a-f9d04e020601 tempest-CinderUnicodeTest-1860234538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d8d88311-aa4b-45c6-94b4-aeeb8a32f0f2.840db9fd-0b72-4235-bca0-f63af14db7e9" returned: 0 in 1.271s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:39 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-02fc8452-9172-4a29-ab9a-f9d04e020601 tempest-CinderUnicodeTest-1860234538 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8d88311-aa4b-45c6-94b4-aeeb8a32f0f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 10:26:39 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[208bce1c-0797-4b2b-8b04-060d339e9d8a]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:26:39 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-02fc8452-9172-4a29-ab9a-f9d04e020601 tempest-CinderUnicodeTest-1860234538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d8d88311-aa4b-45c6-94b4-aeeb8a32f0f2 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:39 devstack sudo[106524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d8d88311-aa4b-45c6-94b4-aeeb8a32f0f2 Jul 10 10:26:39 devstack sudo[106524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:40 devstack sudo[106524]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-02fc8452-9172-4a29-ab9a-f9d04e020601 tempest-CinderUnicodeTest-1860234538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d8d88311-aa4b-45c6-94b4-aeeb8a32f0f2" returned: 0 in 1.050s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-02fc8452-9172-4a29-ab9a-f9d04e020601 tempest-CinderUnicodeTest-1860234538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d8d88311-aa4b-45c6-94b4-aeeb8a32f0f2.840db9fd-0b72-4235-bca0-f63af14db7e9 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:40 devstack sudo[106530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d8d88311-aa4b-45c6-94b4-aeeb8a32f0f2.840db9fd-0b72-4235-bca0-f63af14db7e9 Jul 10 10:26:40 devstack sudo[106530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:41 devstack sudo[106530]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-02fc8452-9172-4a29-ab9a-f9d04e020601 tempest-CinderUnicodeTest-1860234538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d8d88311-aa4b-45c6-94b4-aeeb8a32f0f2.840db9fd-0b72-4235-bca0-f63af14db7e9" returned: 0 in 0.923s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-02fc8452-9172-4a29-ab9a-f9d04e020601 tempest-CinderUnicodeTest-1860234538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d8d88311-aa4b-45c6-94b4-aeeb8a32f0f2.840db9fd-0b72-4235-bca0-f63af14db7e9 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:41 devstack sudo[106536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d8d88311-aa4b-45c6-94b4-aeeb8a32f0f2.840db9fd-0b72-4235-bca0-f63af14db7e9 Jul 10 10:26:41 devstack sudo[106536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:42 devstack cinder-volume[87234]: DEBUG oslo_service.periodic_task [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 10:26:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:26:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:26:42 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:26:42 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:26:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:26:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:42 devstack sudo[106539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:26:42 devstack sudo[106539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:42 devstack sudo[106536]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-02fc8452-9172-4a29-ab9a-f9d04e020601 tempest-CinderUnicodeTest-1860234538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d8d88311-aa4b-45c6-94b4-aeeb8a32f0f2.840db9fd-0b72-4235-bca0-f63af14db7e9" returned: 0 in 0.802s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:42 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-02fc8452-9172-4a29-ab9a-f9d04e020601 tempest-CinderUnicodeTest-1860234538 None] Lock "cinder-quobyte-840db9fd-0b72-4235-bca0-f63af14db7e9" released by "_delete_snapshot" :: held 4.236s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:26:42 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-02fc8452-9172-4a29-ab9a-f9d04e020601 tempest-CinderUnicodeTest-1860234538 None] Lock "cinder-quobyte-d8d88311-aa4b-45c6-94b4-aeeb8a32f0f2" released by "delete_snapshot" :: held 4.262s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:26:42 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-02fc8452-9172-4a29-ab9a-f9d04e020601 tempest-CinderUnicodeTest-1860234538 None] Created reservations ['cdf371f5-4c29-415c-9fcf-30f43f09a4de', 'dc1f7f6b-1300-4e05-bead-e646be60abb4', '08b2e7cb-cb6b-4596-a500-d2ddd86e7d38', 'f9c51efa-efd2-47ab-bad3-d44965bd6b27'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:26:42 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-02fc8452-9172-4a29-ab9a-f9d04e020601 tempest-CinderUnicodeTest-1860234538 None] Delete snapshot completed successfully. Jul 10 10:26:42 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-02fc8452-9172-4a29-ab9a-f9d04e020601 tempest-CinderUnicodeTest-1860234538 None] Lock "cinder-840db9fd-0b72-4235-bca0-f63af14db7e9-delete_snapshot" released by "delete_snapshot" :: held 4.473s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:26:42 devstack sudo[106539]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.836s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:42 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:26:42 devstack cinder-volume[87234]: DEBUG oslo_service.periodic_task [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Running periodic task VolumeManager._thread_info {{(pid=87234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 10:26:42 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] thread count: 28 {{(pid=87234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 10:26:42 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] thread info: [<_MainThread(MainThread, started 131600773742720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 10:26:43 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-e43ddaef-313c-4e83-9edd-4901bf371f56 tempest-CinderUnicodeTest-1860234538 None] Acquiring lock "cinder-d8d88311-aa4b-45c6-94b4-aeeb8a32f0f2-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:26:43 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-e43ddaef-313c-4e83-9edd-4901bf371f56 tempest-CinderUnicodeTest-1860234538 None] Lock "cinder-d8d88311-aa4b-45c6-94b4-aeeb8a32f0f2-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:26:43 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-e43ddaef-313c-4e83-9edd-4901bf371f56 tempest-CinderUnicodeTest-1860234538 None] Acquiring lock "cinder-quobyte-d8d88311-aa4b-45c6-94b4-aeeb8a32f0f2" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:26:43 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-e43ddaef-313c-4e83-9edd-4901bf371f56 tempest-CinderUnicodeTest-1860234538 None] Lock "cinder-quobyte-d8d88311-aa4b-45c6-94b4-aeeb8a32f0f2" acquired by "delete_volume" :: waited 0.019s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:26:43 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[e353e66a-8b2f-40c3-ae2f-0058f9168ad9]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:26:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e43ddaef-313c-4e83-9edd-4901bf371f56 tempest-CinderUnicodeTest-1860234538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d8d88311-aa4b-45c6-94b4-aeeb8a32f0f2 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:43 devstack sudo[106544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d8d88311-aa4b-45c6-94b4-aeeb8a32f0f2 Jul 10 10:26:43 devstack sudo[106544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:43 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-65e0aaaa-11ca-4633-982a-8d103b751264 tempest-ProjectReaderTests-1990163970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:26:43 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-65e0aaaa-11ca-4633-982a-8d103b751264 tempest-ProjectReaderTests-1990163970 None] Flow 'volume_create_manager' (abfccc0c-1edc-4a00-8910-e0f073a27472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:26:43 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-65e0aaaa-11ca-4633-982a-8d103b751264 tempest-ProjectReaderTests-1990163970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a68c5cd-cc17-4825-bbf5-0a599d966795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:26:43 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-65e0aaaa-11ca-4633-982a-8d103b751264 tempest-ProjectReaderTests-1990163970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a68c5cd-cc17-4825-bbf5-0a599d966795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:26:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-578665016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecf6457d-eda4-40cb-9286-4f5b70a14b25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9005996ee3c4fd79ff943ddef70d6a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:26:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:26:44Z,use_quota=True,user_id='af3da7e2db214368a3fb84a8cc08b50d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:26:43 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-65e0aaaa-11ca-4633-982a-8d103b751264 tempest-ProjectReaderTests-1990163970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b07dd54d-0dec-4da8-839b-e2c0e2ce436d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:26:43 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-65e0aaaa-11ca-4633-982a-8d103b751264 tempest-ProjectReaderTests-1990163970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b07dd54d-0dec-4da8-839b-e2c0e2ce436d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:26:43 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-65e0aaaa-11ca-4633-982a-8d103b751264 tempest-ProjectReaderTests-1990163970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcfed775-3307-446b-8a14-ede1879cf794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:26:43 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-65e0aaaa-11ca-4633-982a-8d103b751264 tempest-ProjectReaderTests-1990163970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcfed775-3307-446b-8a14-ede1879cf794) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecf6457d-eda4-40cb-9286-4f5b70a14b25', 'volume_name': 'volume-ecf6457d-eda4-40cb-9286-4f5b70a14b25', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:26:43 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-65e0aaaa-11ca-4633-982a-8d103b751264 tempest-ProjectReaderTests-1990163970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b471cd5b-ecd4-416e-8786-3b82efe68999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:26:43 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-65e0aaaa-11ca-4633-982a-8d103b751264 tempest-ProjectReaderTests-1990163970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b471cd5b-ecd4-416e-8786-3b82efe68999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:26:43 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-65e0aaaa-11ca-4633-982a-8d103b751264 tempest-ProjectReaderTests-1990163970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (463cb897-95b4-4c7e-9cac-a75eee9998c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:26:43 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-65e0aaaa-11ca-4633-982a-8d103b751264 tempest-ProjectReaderTests-1990163970 None] Volume ecf6457d-eda4-40cb-9286-4f5b70a14b25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecf6457d-eda4-40cb-9286-4f5b70a14b25', 'volume_size': 1} Jul 10 10:26:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-65e0aaaa-11ca-4633-982a-8d103b751264 tempest-ProjectReaderTests-1990163970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:26:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-65e0aaaa-11ca-4633-982a-8d103b751264 tempest-ProjectReaderTests-1990163970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:26:43 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-65e0aaaa-11ca-4633-982a-8d103b751264 tempest-ProjectReaderTests-1990163970 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:26:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-578665016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecf6457d-eda4-40cb-9286-4f5b70a14b25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9005996ee3c4fd79ff943ddef70d6a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:26:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:26:44Z,use_quota=True,user_id='af3da7e2db214368a3fb84a8cc08b50d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:26:43 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-65e0aaaa-11ca-4633-982a-8d103b751264 tempest-ProjectReaderTests-1990163970 None] Creating volume ecf6457d-eda4-40cb-9286-4f5b70a14b25 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:26:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-65e0aaaa-11ca-4633-982a-8d103b751264 tempest-ProjectReaderTests-1990163970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:26:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-65e0aaaa-11ca-4633-982a-8d103b751264 tempest-ProjectReaderTests-1990163970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:26:44 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-65e0aaaa-11ca-4633-982a-8d103b751264 tempest-ProjectReaderTests-1990163970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:26:44 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-65e0aaaa-11ca-4633-982a-8d103b751264 tempest-ProjectReaderTests-1990163970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:26:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-65e0aaaa-11ca-4633-982a-8d103b751264 tempest-ProjectReaderTests-1990163970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:26:44 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-65e0aaaa-11ca-4633-982a-8d103b751264 tempest-ProjectReaderTests-1990163970 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:26:44 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-65e0aaaa-11ca-4633-982a-8d103b751264 tempest-ProjectReaderTests-1990163970 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:26:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-65e0aaaa-11ca-4633-982a-8d103b751264 tempest-ProjectReaderTests-1990163970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ecf6457d-eda4-40cb-9286-4f5b70a14b25 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:44 devstack sudo[106546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ecf6457d-eda4-40cb-9286-4f5b70a14b25 1073741824 Jul 10 10:26:44 devstack sudo[106546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:44 devstack sudo[106544]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e43ddaef-313c-4e83-9edd-4901bf371f56 tempest-CinderUnicodeTest-1860234538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d8d88311-aa4b-45c6-94b4-aeeb8a32f0f2" returned: 0 in 0.829s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e43ddaef-313c-4e83-9edd-4901bf371f56 tempest-CinderUnicodeTest-1860234538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d8d88311-aa4b-45c6-94b4-aeeb8a32f0f2 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:44 devstack sudo[106551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d8d88311-aa4b-45c6-94b4-aeeb8a32f0f2 Jul 10 10:26:44 devstack sudo[106551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:44 devstack sudo[106546]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-65e0aaaa-11ca-4633-982a-8d103b751264 tempest-ProjectReaderTests-1990163970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ecf6457d-eda4-40cb-9286-4f5b70a14b25 1073741824" returned: 0 in 0.932s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-65e0aaaa-11ca-4633-982a-8d103b751264 tempest-ProjectReaderTests-1990163970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ecf6457d-eda4-40cb-9286-4f5b70a14b25 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:45 devstack sudo[106557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ecf6457d-eda4-40cb-9286-4f5b70a14b25 Jul 10 10:26:45 devstack sudo[106557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:45 devstack sudo[106551]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e43ddaef-313c-4e83-9edd-4901bf371f56 tempest-CinderUnicodeTest-1860234538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d8d88311-aa4b-45c6-94b4-aeeb8a32f0f2" returned: 0 in 0.799s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:45 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-e43ddaef-313c-4e83-9edd-4901bf371f56 tempest-CinderUnicodeTest-1860234538 None] Lock "cinder-quobyte-d8d88311-aa4b-45c6-94b4-aeeb8a32f0f2" released by "delete_volume" :: held 1.705s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:26:45 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-e43ddaef-313c-4e83-9edd-4901bf371f56 tempest-CinderUnicodeTest-1860234538 None] Created reservations ['058711d5-3a09-4cb8-b344-2f539ef1a7a0', 'b04cef04-5c78-4e89-9096-7aae8bb629bc', '0af05e55-e383-40cb-9e84-f2f5da462971', '331fe0f7-7997-494a-805f-f88a6455b55b'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:26:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-e43ddaef-313c-4e83-9edd-4901bf371f56 tempest-CinderUnicodeTest-1860234538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:26:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-e43ddaef-313c-4e83-9edd-4901bf371f56 tempest-CinderUnicodeTest-1860234538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:26:45 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-e43ddaef-313c-4e83-9edd-4901bf371f56 tempest-CinderUnicodeTest-1860234538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:26:45 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-e43ddaef-313c-4e83-9edd-4901bf371f56 tempest-CinderUnicodeTest-1860234538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:26:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-e43ddaef-313c-4e83-9edd-4901bf371f56 tempest-CinderUnicodeTest-1860234538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:26:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e43ddaef-313c-4e83-9edd-4901bf371f56 tempest-CinderUnicodeTest-1860234538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:45 devstack sudo[106560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:26:45 devstack sudo[106560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:45 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-509bc449-c4be-4f62-aeb1-d9023f1f1fea tempest-VolumeImageDependencyTests-1516718617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:26:45 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-509bc449-c4be-4f62-aeb1-d9023f1f1fea tempest-VolumeImageDependencyTests-1516718617 None] Flow 'volume_create_manager' (afb99a1d-1a80-40af-9905-7fc05251fd60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:26:45 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-509bc449-c4be-4f62-aeb1-d9023f1f1fea tempest-VolumeImageDependencyTests-1516718617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (261baa01-7d2a-44a4-a5e5-55db0da93c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:26:45 devstack sudo[106557]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-65e0aaaa-11ca-4633-982a-8d103b751264 tempest-ProjectReaderTests-1990163970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ecf6457d-eda4-40cb-9286-4f5b70a14b25" returned: 0 in 0.762s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:45 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-65e0aaaa-11ca-4633-982a-8d103b751264 tempest-ProjectReaderTests-1990163970 None] <== create_volume: return (1738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:26:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-65e0aaaa-11ca-4633-982a-8d103b751264 tempest-ProjectReaderTests-1990163970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.740s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:26:45 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-509bc449-c4be-4f62-aeb1-d9023f1f1fea tempest-VolumeImageDependencyTests-1516718617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (261baa01-7d2a-44a4-a5e5-55db0da93c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:26:45Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c9e226b-a25a-47da-8689-7e6888d70301,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8340ab9017c41c7966c080d9512b8c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:26:46Z,use_quota=True,user_id='886d98f3810341d5890bea440ec530cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:26:45 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-509bc449-c4be-4f62-aeb1-d9023f1f1fea tempest-VolumeImageDependencyTests-1516718617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a470809c-eb47-4bbd-8a86-95c0a1c2a687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:26:45 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-509bc449-c4be-4f62-aeb1-d9023f1f1fea tempest-VolumeImageDependencyTests-1516718617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a470809c-eb47-4bbd-8a86-95c0a1c2a687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:26:45 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-509bc449-c4be-4f62-aeb1-d9023f1f1fea tempest-VolumeImageDependencyTests-1516718617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e9e2c2c-996b-42f3-a606-c384411dec6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:26:45 devstack cinder-volume[87234]: DEBUG cinder.image.glance [None req-509bc449-c4be-4f62-aeb1-d9023f1f1fea tempest-VolumeImageDependencyTests-1516718617 None] Creating Keystone auth plugin from conf {{(pid=87234) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 10:26:45 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-6efaf8a7-9d82-45cd-b0a2-5a8ee4806e66 tempest-CinderUnicodeTest-1860234538 None] Acquiring lock "cinder-b02b661d-db5a-4cc1-8dc1-6d6bbdefafc9-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:26:45 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-65e0aaaa-11ca-4633-982a-8d103b751264 tempest-ProjectReaderTests-1990163970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (463cb897-95b4-4c7e-9cac-a75eee9998c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecf6457d-eda4-40cb-9286-4f5b70a14b25', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:26:45 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-65e0aaaa-11ca-4633-982a-8d103b751264 tempest-ProjectReaderTests-1990163970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a277473-7837-4368-8b65-0a7f755b7863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:26:45 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-6efaf8a7-9d82-45cd-b0a2-5a8ee4806e66 tempest-CinderUnicodeTest-1860234538 None] Lock "cinder-b02b661d-db5a-4cc1-8dc1-6d6bbdefafc9-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:26:45 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-65e0aaaa-11ca-4633-982a-8d103b751264 tempest-ProjectReaderTests-1990163970 None] Volume volume-ecf6457d-eda4-40cb-9286-4f5b70a14b25 (ecf6457d-eda4-40cb-9286-4f5b70a14b25): created successfully Jul 10 10:26:45 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-65e0aaaa-11ca-4633-982a-8d103b751264 tempest-ProjectReaderTests-1990163970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a277473-7837-4368-8b65-0a7f755b7863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:26:45 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-65e0aaaa-11ca-4633-982a-8d103b751264 tempest-ProjectReaderTests-1990163970 None] Flow 'volume_create_manager' (abfccc0c-1edc-4a00-8910-e0f073a27472) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:26:45 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-65e0aaaa-11ca-4633-982a-8d103b751264 tempest-ProjectReaderTests-1990163970 None] Created volume successfully. Jul 10 10:26:45 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-6efaf8a7-9d82-45cd-b0a2-5a8ee4806e66 tempest-CinderUnicodeTest-1860234538 None] Acquiring lock "cinder-quobyte-b02b661d-db5a-4cc1-8dc1-6d6bbdefafc9" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:26:45 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-6efaf8a7-9d82-45cd-b0a2-5a8ee4806e66 tempest-CinderUnicodeTest-1860234538 None] Lock "cinder-quobyte-b02b661d-db5a-4cc1-8dc1-6d6bbdefafc9" acquired by "delete_volume" :: waited 0.027s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:26:45 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c370f7-e33f-484e-b7a1-1d606ff8b7b1]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:26:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-6efaf8a7-9d82-45cd-b0a2-5a8ee4806e66 tempest-CinderUnicodeTest-1860234538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b02b661d-db5a-4cc1-8dc1-6d6bbdefafc9 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:46 devstack sudo[106563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b02b661d-db5a-4cc1-8dc1-6d6bbdefafc9 Jul 10 10:26:46 devstack sudo[106563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:46 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-509bc449-c4be-4f62-aeb1-d9023f1f1fea tempest-VolumeImageDependencyTests-1516718617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e9e2c2c-996b-42f3-a606-c384411dec6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8c9e226b-a25a-47da-8689-7e6888d70301', 'volume_name': 'volume-8c9e226b-a25a-47da-8689-7e6888d70301', 'volume_size': 1, 'image_id': 'f38859af-d836-44d7-9c33-bcd77967c02b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f38859af-d836-44d7-9c33-bcd77967c02b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '36a748dc5f85e162b11bbbbf6586bd0e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd8340ab9017c41c7966c080d9512b8c5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '45ae2a38779542b5cadcc4ee4462de8368a870d698936af3268d0e990df21552166d8658034eed85c9b20c6449461a495a40ae37e00b7aa38bb0d32413f98ae3', 'id': 'f38859af-d836-44d7-9c33-bcd77967c02b', 'created_at': datetime.datetime(2026, 7, 10, 8, 26, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 8, 26, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f38859af-d836-44d7-9c33-bcd77967c02b/file', 'properties': {}}, 'image_service': }' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:26:46 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-509bc449-c4be-4f62-aeb1-d9023f1f1fea tempest-VolumeImageDependencyTests-1516718617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06fcadd8-ef8a-41c9-b4d0-e1c2c3eb6f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:26:46 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-509bc449-c4be-4f62-aeb1-d9023f1f1fea tempest-VolumeImageDependencyTests-1516718617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06fcadd8-ef8a-41c9-b4d0-e1c2c3eb6f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:26:46 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-509bc449-c4be-4f62-aeb1-d9023f1f1fea tempest-VolumeImageDependencyTests-1516718617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81f480d3-64b2-404a-9f7f-21025e79253c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:26:46 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-509bc449-c4be-4f62-aeb1-d9023f1f1fea tempest-VolumeImageDependencyTests-1516718617 None] Volume 8c9e226b-a25a-47da-8689-7e6888d70301: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8c9e226b-a25a-47da-8689-7e6888d70301', 'volume_size': 1, 'image_id': 'f38859af-d836-44d7-9c33-bcd77967c02b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f38859af-d836-44d7-9c33-bcd77967c02b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '36a748dc5f85e162b11bbbbf6586bd0e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd8340ab9017c41c7966c080d9512b8c5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '45ae2a38779542b5cadcc4ee4462de8368a870d698936af3268d0e990df21552166d8658034eed85c9b20c6449461a495a40ae37e00b7aa38bb0d32413f98ae3', 'id': 'f38859af-d836-44d7-9c33-bcd77967c02b', 'created_at': datetime.datetime(2026, 7, 10, 8, 26, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 8, 26, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f38859af-d836-44d7-9c33-bcd77967c02b/file', 'properties': {}}, 'image_service': } Jul 10 10:26:46 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-509bc449-c4be-4f62-aeb1-d9023f1f1fea tempest-VolumeImageDependencyTests-1516718617 None] Trying to clone 8c9e226b-a25a-47da-8689-7e6888d70301 from image f38859af-d836-44d7-9c33-bcd77967c02b at location (None, [{'url': 'file:///opt/stack/data/glance/images/f38859af-d836-44d7-9c33-bcd77967c02b', 'metadata': {}}]). {{(pid=87234) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 10:26:46 devstack sudo[106560]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-dcba24a8-2230-4bec-a4ab-05a8897e3203 tempest-ProjectReaderTests-1990163970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:26:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-dcba24a8-2230-4bec-a4ab-05a8897e3203 tempest-ProjectReaderTests-1990163970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:26:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e43ddaef-313c-4e83-9edd-4901bf371f56 tempest-CinderUnicodeTest-1860234538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.905s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:46 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-e43ddaef-313c-4e83-9edd-4901bf371f56 tempest-CinderUnicodeTest-1860234538 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:26:46 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-e43ddaef-313c-4e83-9edd-4901bf371f56 tempest-CinderUnicodeTest-1860234538 None] Deleted volume successfully. Jul 10 10:26:46 devstack cinder-volume[87234]: DEBUG cinder.image.image_utils [None req-509bc449-c4be-4f62-aeb1-d9023f1f1fea tempest-VolumeImageDependencyTests-1516718617 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f38859af-d836-44d7-9c33-bcd77967c02b_hqf4gt4idevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87234) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 10:26:46 devstack cinder-volume[87234]: INFO cinder.image.image_utils [None req-509bc449-c4be-4f62-aeb1-d9023f1f1fea tempest-VolumeImageDependencyTests-1516718617 None] Image download 0.00 MB at 0.00 MB/s Jul 10 10:26:46 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-dcba24a8-2230-4bec-a4ab-05a8897e3203 tempest-ProjectReaderTests-1990163970 None] Creating offline snapshot 9ae9cb6c-a162-4f58-a1fe-5ea4fc5708e3 of volume ecf6457d-eda4-40cb-9286-4f5b70a14b25 {{(pid=87234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 10:26:46 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-e43ddaef-313c-4e83-9edd-4901bf371f56 tempest-CinderUnicodeTest-1860234538 None] Lock "cinder-d8d88311-aa4b-45c6-94b4-aeeb8a32f0f2-delete_volume" released by "delete_volume" :: held 2.866s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:26:46 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6340168-1044-47d3-b269-8cdf90841cb9]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:26:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-dcba24a8-2230-4bec-a4ab-05a8897e3203 tempest-ProjectReaderTests-1990163970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ecf6457d-eda4-40cb-9286-4f5b70a14b25 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:46 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7333ec6-d0ac-4fbe-b057-23c4b643855a]: (4, 'raw') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:26:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-509bc449-c4be-4f62-aeb1-d9023f1f1fea tempest-VolumeImageDependencyTests-1516718617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f38859af-d836-44d7-9c33-bcd77967c02b_hqf4gt4idevstack@QuobyteHD {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:46 devstack sudo[106566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ecf6457d-eda4-40cb-9286-4f5b70a14b25 Jul 10 10:26:46 devstack sudo[106566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:46 devstack sudo[106567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f38859af-d836-44d7-9c33-bcd77967c02b_hqf4gt4idevstack@QuobyteHD Jul 10 10:26:46 devstack sudo[106567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:46 devstack sudo[106563]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-6efaf8a7-9d82-45cd-b0a2-5a8ee4806e66 tempest-CinderUnicodeTest-1860234538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b02b661d-db5a-4cc1-8dc1-6d6bbdefafc9" returned: 0 in 0.857s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-6efaf8a7-9d82-45cd-b0a2-5a8ee4806e66 tempest-CinderUnicodeTest-1860234538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b02b661d-db5a-4cc1-8dc1-6d6bbdefafc9 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:46 devstack sudo[106574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b02b661d-db5a-4cc1-8dc1-6d6bbdefafc9 Jul 10 10:26:46 devstack sudo[106574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:47 devstack sudo[106566]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-dcba24a8-2230-4bec-a4ab-05a8897e3203 tempest-ProjectReaderTests-1990163970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ecf6457d-eda4-40cb-9286-4f5b70a14b25" returned: 0 in 0.806s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-dcba24a8-2230-4bec-a4ab-05a8897e3203 tempest-ProjectReaderTests-1990163970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ecf6457d-eda4-40cb-9286-4f5b70a14b25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ecf6457d-eda4-40cb-9286-4f5b70a14b25.9ae9cb6c-a162-4f58-a1fe-5ea4fc5708e3 1G {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:47 devstack sudo[106581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ecf6457d-eda4-40cb-9286-4f5b70a14b25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ecf6457d-eda4-40cb-9286-4f5b70a14b25.9ae9cb6c-a162-4f58-a1fe-5ea4fc5708e3 1G Jul 10 10:26:47 devstack sudo[106581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:47 devstack sudo[106567]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-509bc449-c4be-4f62-aeb1-d9023f1f1fea tempest-VolumeImageDependencyTests-1516718617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f38859af-d836-44d7-9c33-bcd77967c02b_hqf4gt4idevstack@QuobyteHD" returned: 0 in 0.817s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-509bc449-c4be-4f62-aeb1-d9023f1f1fea tempest-VolumeImageDependencyTests-1516718617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f38859af-d836-44d7-9c33-bcd77967c02b_hqf4gt4idevstack@QuobyteHD {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:47 devstack sudo[106583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f38859af-d836-44d7-9c33-bcd77967c02b_hqf4gt4idevstack@QuobyteHD Jul 10 10:26:47 devstack sudo[106583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:47 devstack sudo[106574]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-6efaf8a7-9d82-45cd-b0a2-5a8ee4806e66 tempest-CinderUnicodeTest-1860234538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b02b661d-db5a-4cc1-8dc1-6d6bbdefafc9" returned: 0 in 0.688s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:47 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-6efaf8a7-9d82-45cd-b0a2-5a8ee4806e66 tempest-CinderUnicodeTest-1860234538 None] Lock "cinder-quobyte-b02b661d-db5a-4cc1-8dc1-6d6bbdefafc9" released by "delete_volume" :: held 1.598s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:26:47 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-6efaf8a7-9d82-45cd-b0a2-5a8ee4806e66 tempest-CinderUnicodeTest-1860234538 None] Created reservations ['33890f3d-52a9-493e-a68f-95817f9c101f', 'bf06e626-4e0b-4b68-88e4-243fb62916df', 'bdfb7319-d9a1-45b2-8c0b-c4f05cae3dde', '75d7ffd7-09f6-4742-9152-51fc2ddb51fa'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:26:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-6efaf8a7-9d82-45cd-b0a2-5a8ee4806e66 tempest-CinderUnicodeTest-1860234538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:26:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-6efaf8a7-9d82-45cd-b0a2-5a8ee4806e66 tempest-CinderUnicodeTest-1860234538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:26:47 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-6efaf8a7-9d82-45cd-b0a2-5a8ee4806e66 tempest-CinderUnicodeTest-1860234538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:26:47 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-6efaf8a7-9d82-45cd-b0a2-5a8ee4806e66 tempest-CinderUnicodeTest-1860234538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:26:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-6efaf8a7-9d82-45cd-b0a2-5a8ee4806e66 tempest-CinderUnicodeTest-1860234538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:26:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-6efaf8a7-9d82-45cd-b0a2-5a8ee4806e66 tempest-CinderUnicodeTest-1860234538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:47 devstack sudo[106589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:26:47 devstack sudo[106589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:47 devstack sudo[106583]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-509bc449-c4be-4f62-aeb1-d9023f1f1fea tempest-VolumeImageDependencyTests-1516718617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f38859af-d836-44d7-9c33-bcd77967c02b_hqf4gt4idevstack@QuobyteHD" returned: 1 in 0.756s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-509bc449-c4be-4f62-aeb1-d9023f1f1fea tempest-VolumeImageDependencyTests-1516718617 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f38859af-d836-44d7-9c33-bcd77967c02b_hqf4gt4idevstack@QuobyteHD' failed. Not Retrying. {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 10:26:47 devstack cinder-volume[87234]: DEBUG cinder.image.image_utils [None req-509bc449-c4be-4f62-aeb1-d9023f1f1fea tempest-VolumeImageDependencyTests-1516718617 None] Temporary image f38859af-d836-44d7-9c33-bcd77967c02b is fetched for user 886d98f3810341d5890bea440ec530cd. {{(pid=87234) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 10:26:47 devstack sudo[106581]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-dcba24a8-2230-4bec-a4ab-05a8897e3203 tempest-ProjectReaderTests-1990163970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ecf6457d-eda4-40cb-9286-4f5b70a14b25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ecf6457d-eda4-40cb-9286-4f5b70a14b25.9ae9cb6c-a162-4f58-a1fe-5ea4fc5708e3 1G" returned: 0 in 0.839s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-dcba24a8-2230-4bec-a4ab-05a8897e3203 tempest-ProjectReaderTests-1990163970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecf6457d-eda4-40cb-9286-4f5b70a14b25 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ecf6457d-eda4-40cb-9286-4f5b70a14b25.9ae9cb6c-a162-4f58-a1fe-5ea4fc5708e3 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:47 devstack sudo[106596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecf6457d-eda4-40cb-9286-4f5b70a14b25 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ecf6457d-eda4-40cb-9286-4f5b70a14b25.9ae9cb6c-a162-4f58-a1fe-5ea4fc5708e3 Jul 10 10:26:47 devstack sudo[106596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:47 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[afedbf9a-6910-4610-a72c-e92daab4b600]: (4, 'raw') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:26:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-509bc449-c4be-4f62-aeb1-d9023f1f1fea tempest-VolumeImageDependencyTests-1516718617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f38859af-d836-44d7-9c33-bcd77967c02b_hqf4gt4idevstack@QuobyteHD {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:48 devstack sudo[106598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f38859af-d836-44d7-9c33-bcd77967c02b_hqf4gt4idevstack@QuobyteHD Jul 10 10:26:48 devstack sudo[106598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:48 devstack sudo[106589]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-6efaf8a7-9d82-45cd-b0a2-5a8ee4806e66 tempest-CinderUnicodeTest-1860234538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.742s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:48 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-6efaf8a7-9d82-45cd-b0a2-5a8ee4806e66 tempest-CinderUnicodeTest-1860234538 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:26:48 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-6efaf8a7-9d82-45cd-b0a2-5a8ee4806e66 tempest-CinderUnicodeTest-1860234538 None] Deleted volume successfully. Jul 10 10:26:48 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-6efaf8a7-9d82-45cd-b0a2-5a8ee4806e66 tempest-CinderUnicodeTest-1860234538 None] Lock "cinder-b02b661d-db5a-4cc1-8dc1-6d6bbdefafc9-delete_volume" released by "delete_volume" :: held 2.610s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:26:48 devstack sudo[106596]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-dcba24a8-2230-4bec-a4ab-05a8897e3203 tempest-ProjectReaderTests-1990163970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecf6457d-eda4-40cb-9286-4f5b70a14b25 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ecf6457d-eda4-40cb-9286-4f5b70a14b25.9ae9cb6c-a162-4f58-a1fe-5ea4fc5708e3" returned: 0 in 0.756s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:48 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-dcba24a8-2230-4bec-a4ab-05a8897e3203 tempest-ProjectReaderTests-1990163970 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ecf6457d-eda4-40cb-9286-4f5b70a14b25.9ae9cb6c-a162-4f58-a1fe-5ea4fc5708e3 is being set with open permissions: ugo+rw Jul 10 10:26:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-dcba24a8-2230-4bec-a4ab-05a8897e3203 tempest-ProjectReaderTests-1990163970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ecf6457d-eda4-40cb-9286-4f5b70a14b25.9ae9cb6c-a162-4f58-a1fe-5ea4fc5708e3 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:48 devstack sudo[106606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ecf6457d-eda4-40cb-9286-4f5b70a14b25.9ae9cb6c-a162-4f58-a1fe-5ea4fc5708e3 Jul 10 10:26:48 devstack sudo[106606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:48 devstack sudo[106598]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-509bc449-c4be-4f62-aeb1-d9023f1f1fea tempest-VolumeImageDependencyTests-1516718617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f38859af-d836-44d7-9c33-bcd77967c02b_hqf4gt4idevstack@QuobyteHD" returned: 0 in 0.821s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-509bc449-c4be-4f62-aeb1-d9023f1f1fea tempest-VolumeImageDependencyTests-1516718617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f38859af-d836-44d7-9c33-bcd77967c02b_hqf4gt4idevstack@QuobyteHD {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:48 devstack sudo[106608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f38859af-d836-44d7-9c33-bcd77967c02b_hqf4gt4idevstack@QuobyteHD Jul 10 10:26:48 devstack sudo[106608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:49 devstack sudo[106606]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-dcba24a8-2230-4bec-a4ab-05a8897e3203 tempest-ProjectReaderTests-1990163970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ecf6457d-eda4-40cb-9286-4f5b70a14b25.9ae9cb6c-a162-4f58-a1fe-5ea4fc5708e3" returned: 0 in 0.724s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-dcba24a8-2230-4bec-a4ab-05a8897e3203 tempest-ProjectReaderTests-1990163970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ecf6457d-eda4-40cb-9286-4f5b70a14b25.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:49 devstack sudo[106611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ecf6457d-eda4-40cb-9286-4f5b70a14b25.info Jul 10 10:26:49 devstack sudo[106611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:49 devstack sudo[106608]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-509bc449-c4be-4f62-aeb1-d9023f1f1fea tempest-VolumeImageDependencyTests-1516718617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f38859af-d836-44d7-9c33-bcd77967c02b_hqf4gt4idevstack@QuobyteHD" returned: 1 in 0.835s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-509bc449-c4be-4f62-aeb1-d9023f1f1fea tempest-VolumeImageDependencyTests-1516718617 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f38859af-d836-44d7-9c33-bcd77967c02b_hqf4gt4idevstack@QuobyteHD' failed. Not Retrying. {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 10:26:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-509bc449-c4be-4f62-aeb1-d9023f1f1fea tempest-VolumeImageDependencyTests-1516718617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:26:50 devstack sudo[106611]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-dcba24a8-2230-4bec-a4ab-05a8897e3203 tempest-ProjectReaderTests-1990163970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ecf6457d-eda4-40cb-9286-4f5b70a14b25.info" returned: 0 in 0.736s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:50 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-dcba24a8-2230-4bec-a4ab-05a8897e3203 tempest-ProjectReaderTests-1990163970 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ecf6457d-eda4-40cb-9286-4f5b70a14b25.info is being set with open permissions: ugo+rw Jul 10 10:26:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-dcba24a8-2230-4bec-a4ab-05a8897e3203 tempest-ProjectReaderTests-1990163970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ecf6457d-eda4-40cb-9286-4f5b70a14b25.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:50 devstack sudo[106617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ecf6457d-eda4-40cb-9286-4f5b70a14b25.info Jul 10 10:26:50 devstack sudo[106617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:50 devstack sudo[106617]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-dcba24a8-2230-4bec-a4ab-05a8897e3203 tempest-ProjectReaderTests-1990163970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ecf6457d-eda4-40cb-9286-4f5b70a14b25.info" returned: 0 in 0.691s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-dcba24a8-2230-4bec-a4ab-05a8897e3203 tempest-ProjectReaderTests-1990163970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.666s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:26:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-509bc449-c4be-4f62-aeb1-d9023f1f1fea tempest-VolumeImageDependencyTests-1516718617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.268s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:26:50 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-509bc449-c4be-4f62-aeb1-d9023f1f1fea tempest-VolumeImageDependencyTests-1516718617 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:26:45Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c9e226b-a25a-47da-8689-7e6888d70301,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8340ab9017c41c7966c080d9512b8c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:26:46Z,use_quota=True,user_id='886d98f3810341d5890bea440ec530cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:26:50 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-509bc449-c4be-4f62-aeb1-d9023f1f1fea tempest-VolumeImageDependencyTests-1516718617 None] Creating volume 8c9e226b-a25a-47da-8689-7e6888d70301 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:26:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-509bc449-c4be-4f62-aeb1-d9023f1f1fea tempest-VolumeImageDependencyTests-1516718617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:26:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-509bc449-c4be-4f62-aeb1-d9023f1f1fea tempest-VolumeImageDependencyTests-1516718617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:26:50 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-509bc449-c4be-4f62-aeb1-d9023f1f1fea tempest-VolumeImageDependencyTests-1516718617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:26:50 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-509bc449-c4be-4f62-aeb1-d9023f1f1fea tempest-VolumeImageDependencyTests-1516718617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:26:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-509bc449-c4be-4f62-aeb1-d9023f1f1fea tempest-VolumeImageDependencyTests-1516718617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:26:50 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-509bc449-c4be-4f62-aeb1-d9023f1f1fea tempest-VolumeImageDependencyTests-1516718617 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:26:50 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-509bc449-c4be-4f62-aeb1-d9023f1f1fea tempest-VolumeImageDependencyTests-1516718617 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:26:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-509bc449-c4be-4f62-aeb1-d9023f1f1fea tempest-VolumeImageDependencyTests-1516718617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8c9e226b-a25a-47da-8689-7e6888d70301 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:50 devstack sudo[106620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8c9e226b-a25a-47da-8689-7e6888d70301 1073741824 Jul 10 10:26:50 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-dcba24a8-2230-4bec-a4ab-05a8897e3203 tempest-ProjectReaderTests-1990163970 None] Create snapshot completed successfully Jul 10 10:26:50 devstack sudo[106620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:51 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f697106e-c246-4d73-a9bc-4876f2b8e7c6 tempest-ProjectReaderTests-1990163970 None] Acquiring lock "cinder-9ae9cb6c-a162-4f58-a1fe-5ea4fc5708e3-delete_snapshot" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:26:51 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f697106e-c246-4d73-a9bc-4876f2b8e7c6 tempest-ProjectReaderTests-1990163970 None] Lock "cinder-9ae9cb6c-a162-4f58-a1fe-5ea4fc5708e3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:26:51 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f697106e-c246-4d73-a9bc-4876f2b8e7c6 tempest-ProjectReaderTests-1990163970 None] Acquiring lock "cinder-quobyte-ecf6457d-eda4-40cb-9286-4f5b70a14b25" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:26:51 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f697106e-c246-4d73-a9bc-4876f2b8e7c6 tempest-ProjectReaderTests-1990163970 None] Lock "cinder-quobyte-ecf6457d-eda4-40cb-9286-4f5b70a14b25" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:26:51 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f697106e-c246-4d73-a9bc-4876f2b8e7c6 tempest-ProjectReaderTests-1990163970 None] Acquiring lock "cinder-quobyte-9ae9cb6c-a162-4f58-a1fe-5ea4fc5708e3" by "_delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:26:51 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-64ca72fb-9d14-42f8-8e75-b2c47bf5476b tempest-ProjectAdminTests-1226984320 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87234) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 10 10:26:51 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f697106e-c246-4d73-a9bc-4876f2b8e7c6 tempest-ProjectReaderTests-1990163970 None] Lock "cinder-quobyte-9ae9cb6c-a162-4f58-a1fe-5ea4fc5708e3" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:26:51 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-f697106e-c246-4d73-a9bc-4876f2b8e7c6 tempest-ProjectReaderTests-1990163970 None] Deleting offline snapshot 9ae9cb6c-a162-4f58-a1fe-5ea4fc5708e3 of volume ecf6457d-eda4-40cb-9286-4f5b70a14b25 {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 10:26:51 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-f697106e-c246-4d73-a9bc-4876f2b8e7c6 tempest-ProjectReaderTests-1990163970 None] snapshot_file for this snap is: volume-ecf6457d-eda4-40cb-9286-4f5b70a14b25.9ae9cb6c-a162-4f58-a1fe-5ea4fc5708e3 {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 10:26:51 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[483201ac-8109-43f4-866a-785bd5f6c6b9]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:26:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f697106e-c246-4d73-a9bc-4876f2b8e7c6 tempest-ProjectReaderTests-1990163970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ecf6457d-eda4-40cb-9286-4f5b70a14b25.9ae9cb6c-a162-4f58-a1fe-5ea4fc5708e3 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:51 devstack sudo[106620]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-509bc449-c4be-4f62-aeb1-d9023f1f1fea tempest-VolumeImageDependencyTests-1516718617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8c9e226b-a25a-47da-8689-7e6888d70301 1073741824" returned: 0 in 0.927s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:51 devstack sudo[106626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ecf6457d-eda4-40cb-9286-4f5b70a14b25.9ae9cb6c-a162-4f58-a1fe-5ea4fc5708e3 Jul 10 10:26:51 devstack sudo[106626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-509bc449-c4be-4f62-aeb1-d9023f1f1fea tempest-VolumeImageDependencyTests-1516718617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8c9e226b-a25a-47da-8689-7e6888d70301 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:51 devstack sudo[106628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8c9e226b-a25a-47da-8689-7e6888d70301 Jul 10 10:26:51 devstack sudo[106628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:52 devstack sudo[106626]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f697106e-c246-4d73-a9bc-4876f2b8e7c6 tempest-ProjectReaderTests-1990163970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ecf6457d-eda4-40cb-9286-4f5b70a14b25.9ae9cb6c-a162-4f58-a1fe-5ea4fc5708e3" returned: 0 in 0.835s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:52 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-f697106e-c246-4d73-a9bc-4876f2b8e7c6 tempest-ProjectReaderTests-1990163970 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ecf6457d-eda4-40cb-9286-4f5b70a14b25(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 10:26:52 devstack sudo[106628]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:52 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d2381d4-00ce-43c3-b6d3-e339f8e79983]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:26:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f697106e-c246-4d73-a9bc-4876f2b8e7c6 tempest-ProjectReaderTests-1990163970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ecf6457d-eda4-40cb-9286-4f5b70a14b25 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-509bc449-c4be-4f62-aeb1-d9023f1f1fea tempest-VolumeImageDependencyTests-1516718617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8c9e226b-a25a-47da-8689-7e6888d70301" returned: 0 in 0.748s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:52 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-509bc449-c4be-4f62-aeb1-d9023f1f1fea tempest-VolumeImageDependencyTests-1516718617 None] <== create_volume: return (1725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:26:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-509bc449-c4be-4f62-aeb1-d9023f1f1fea tempest-VolumeImageDependencyTests-1516718617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.728s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:26:52 devstack cinder-volume[87234]: DEBUG cinder.volume.volume_utils [None req-509bc449-c4be-4f62-aeb1-d9023f1f1fea tempest-VolumeImageDependencyTests-1516718617 None] Attempting download of f38859af-d836-44d7-9c33-bcd77967c02b ((None, [{'url': 'file:///opt/stack/data/glance/images/f38859af-d836-44d7-9c33-bcd77967c02b', 'metadata': {}}])) to volume 8c9e226b-a25a-47da-8689-7e6888d70301. {{(pid=87234) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 10:26:52 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae617153-9b95-4aef-b2f5-aaba02024b65]: (4, 'raw') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:26:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-509bc449-c4be-4f62-aeb1-d9023f1f1fea tempest-VolumeImageDependencyTests-1516718617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f38859af-d836-44d7-9c33-bcd77967c02b_1xt2i59w {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:52 devstack sudo[106634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ecf6457d-eda4-40cb-9286-4f5b70a14b25 Jul 10 10:26:52 devstack sudo[106634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:52 devstack sudo[106635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f38859af-d836-44d7-9c33-bcd77967c02b_1xt2i59w Jul 10 10:26:52 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:53 devstack sudo[106634]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f697106e-c246-4d73-a9bc-4876f2b8e7c6 tempest-ProjectReaderTests-1990163970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ecf6457d-eda4-40cb-9286-4f5b70a14b25" returned: 0 in 0.918s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f697106e-c246-4d73-a9bc-4876f2b8e7c6 tempest-ProjectReaderTests-1990163970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ecf6457d-eda4-40cb-9286-4f5b70a14b25.9ae9cb6c-a162-4f58-a1fe-5ea4fc5708e3 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:53 devstack sudo[106635]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-509bc449-c4be-4f62-aeb1-d9023f1f1fea tempest-VolumeImageDependencyTests-1516718617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f38859af-d836-44d7-9c33-bcd77967c02b_1xt2i59w" returned: 0 in 0.800s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-509bc449-c4be-4f62-aeb1-d9023f1f1fea tempest-VolumeImageDependencyTests-1516718617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f38859af-d836-44d7-9c33-bcd77967c02b_1xt2i59w {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:53 devstack sudo[106643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ecf6457d-eda4-40cb-9286-4f5b70a14b25.9ae9cb6c-a162-4f58-a1fe-5ea4fc5708e3 Jul 10 10:26:53 devstack sudo[106643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:53 devstack sudo[106645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f38859af-d836-44d7-9c33-bcd77967c02b_1xt2i59w Jul 10 10:26:53 devstack sudo[106645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:54 devstack sudo[106645]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:54 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-509bc449-c4be-4f62-aeb1-d9023f1f1fea tempest-VolumeImageDependencyTests-1516718617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f38859af-d836-44d7-9c33-bcd77967c02b_1xt2i59w" returned: 1 in 0.829s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:54 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-509bc449-c4be-4f62-aeb1-d9023f1f1fea tempest-VolumeImageDependencyTests-1516718617 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f38859af-d836-44d7-9c33-bcd77967c02b_1xt2i59w' failed. Not Retrying. {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 10:26:54 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08b57e9-7f41-4a0d-90fd-7d225e3a4acf]: (4, 'raw') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:26:54 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-509bc449-c4be-4f62-aeb1-d9023f1f1fea tempest-VolumeImageDependencyTests-1516718617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f38859af-d836-44d7-9c33-bcd77967c02b_hqf4gt4idevstack@QuobyteHD {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:54 devstack sudo[106643]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:54 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f697106e-c246-4d73-a9bc-4876f2b8e7c6 tempest-ProjectReaderTests-1990163970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ecf6457d-eda4-40cb-9286-4f5b70a14b25.9ae9cb6c-a162-4f58-a1fe-5ea4fc5708e3" returned: 0 in 0.881s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:54 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f697106e-c246-4d73-a9bc-4876f2b8e7c6 tempest-ProjectReaderTests-1990163970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ecf6457d-eda4-40cb-9286-4f5b70a14b25.9ae9cb6c-a162-4f58-a1fe-5ea4fc5708e3 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:54 devstack sudo[106653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ecf6457d-eda4-40cb-9286-4f5b70a14b25.9ae9cb6c-a162-4f58-a1fe-5ea4fc5708e3 Jul 10 10:26:54 devstack sudo[106653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:54 devstack sudo[106652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f38859af-d836-44d7-9c33-bcd77967c02b_hqf4gt4idevstack@QuobyteHD Jul 10 10:26:54 devstack sudo[106652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:55 devstack sudo[106652]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:55 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-509bc449-c4be-4f62-aeb1-d9023f1f1fea tempest-VolumeImageDependencyTests-1516718617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f38859af-d836-44d7-9c33-bcd77967c02b_hqf4gt4idevstack@QuobyteHD" returned: 0 in 0.754s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:55 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-509bc449-c4be-4f62-aeb1-d9023f1f1fea tempest-VolumeImageDependencyTests-1516718617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f38859af-d836-44d7-9c33-bcd77967c02b_hqf4gt4idevstack@QuobyteHD {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:55 devstack sudo[106653]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:55 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f697106e-c246-4d73-a9bc-4876f2b8e7c6 tempest-ProjectReaderTests-1990163970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ecf6457d-eda4-40cb-9286-4f5b70a14b25.9ae9cb6c-a162-4f58-a1fe-5ea4fc5708e3" returned: 0 in 0.751s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:55 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f697106e-c246-4d73-a9bc-4876f2b8e7c6 tempest-ProjectReaderTests-1990163970 None] Lock "cinder-quobyte-9ae9cb6c-a162-4f58-a1fe-5ea4fc5708e3" released by "_delete_snapshot" :: held 3.494s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:26:55 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f697106e-c246-4d73-a9bc-4876f2b8e7c6 tempest-ProjectReaderTests-1990163970 None] Lock "cinder-quobyte-ecf6457d-eda4-40cb-9286-4f5b70a14b25" released by "delete_snapshot" :: held 3.528s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:26:55 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-f697106e-c246-4d73-a9bc-4876f2b8e7c6 tempest-ProjectReaderTests-1990163970 None] Created reservations ['241005ff-7610-4cc7-9b2a-da1d84d43f21', '5f45fe3b-fd98-4100-9ebf-7f48695156cb', 'd7399760-debd-4d40-9962-5f3af3a23bf5', '18129145-5a5f-4eb6-bdf4-97266241382c'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:26:55 devstack sudo[106659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f38859af-d836-44d7-9c33-bcd77967c02b_hqf4gt4idevstack@QuobyteHD Jul 10 10:26:55 devstack sudo[106659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:55 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-f697106e-c246-4d73-a9bc-4876f2b8e7c6 tempest-ProjectReaderTests-1990163970 None] Delete snapshot completed successfully. Jul 10 10:26:55 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f697106e-c246-4d73-a9bc-4876f2b8e7c6 tempest-ProjectReaderTests-1990163970 None] Lock "cinder-9ae9cb6c-a162-4f58-a1fe-5ea4fc5708e3-delete_snapshot" released by "delete_snapshot" :: held 3.676s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:26:55 devstack sudo[106659]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:55 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-711d8ee2-1b77-45f5-ac90-1113527bc637 tempest-ProjectReaderTests-1990163970 None] Acquiring lock "cinder-ecf6457d-eda4-40cb-9286-4f5b70a14b25-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:26:55 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-509bc449-c4be-4f62-aeb1-d9023f1f1fea tempest-VolumeImageDependencyTests-1516718617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f38859af-d836-44d7-9c33-bcd77967c02b_hqf4gt4idevstack@QuobyteHD" returned: 1 in 0.784s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:55 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-509bc449-c4be-4f62-aeb1-d9023f1f1fea tempest-VolumeImageDependencyTests-1516718617 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f38859af-d836-44d7-9c33-bcd77967c02b_hqf4gt4idevstack@QuobyteHD' failed. Not Retrying. {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 10:26:55 devstack cinder-volume[87234]: DEBUG cinder.image.image_utils [None req-509bc449-c4be-4f62-aeb1-d9023f1f1fea tempest-VolumeImageDependencyTests-1516718617 None] f38859af-d836-44d7-9c33-bcd77967c02b was raw, converting to raw {{(pid=87234) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 10:26:55 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-509bc449-c4be-4f62-aeb1-d9023f1f1fea tempest-VolumeImageDependencyTests-1516718617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f38859af-d836-44d7-9c33-bcd77967c02b_hqf4gt4idevstack@QuobyteHD /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8c9e226b-a25a-47da-8689-7e6888d70301 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:55 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-711d8ee2-1b77-45f5-ac90-1113527bc637 tempest-ProjectReaderTests-1990163970 None] Lock "cinder-ecf6457d-eda4-40cb-9286-4f5b70a14b25-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:26:55 devstack sudo[106664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f38859af-d836-44d7-9c33-bcd77967c02b_hqf4gt4idevstack@QuobyteHD /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8c9e226b-a25a-47da-8689-7e6888d70301 Jul 10 10:26:55 devstack sudo[106664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:56 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-711d8ee2-1b77-45f5-ac90-1113527bc637 tempest-ProjectReaderTests-1990163970 None] Acquiring lock "cinder-quobyte-ecf6457d-eda4-40cb-9286-4f5b70a14b25" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:26:56 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-711d8ee2-1b77-45f5-ac90-1113527bc637 tempest-ProjectReaderTests-1990163970 None] Lock "cinder-quobyte-ecf6457d-eda4-40cb-9286-4f5b70a14b25" acquired by "delete_volume" :: waited 0.017s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:26:56 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[508a1bc3-b15b-4399-a24e-ab3c8ee073bc]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:26:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-711d8ee2-1b77-45f5-ac90-1113527bc637 tempest-ProjectReaderTests-1990163970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ecf6457d-eda4-40cb-9286-4f5b70a14b25 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:56 devstack sudo[106666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ecf6457d-eda4-40cb-9286-4f5b70a14b25 Jul 10 10:26:56 devstack sudo[106666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:56 devstack sudo[106664]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-509bc449-c4be-4f62-aeb1-d9023f1f1fea tempest-VolumeImageDependencyTests-1516718617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f38859af-d836-44d7-9c33-bcd77967c02b_hqf4gt4idevstack@QuobyteHD /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8c9e226b-a25a-47da-8689-7e6888d70301" returned: 0 in 0.741s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:56 devstack cinder-volume[87234]: DEBUG cinder.image.image_utils [None req-509bc449-c4be-4f62-aeb1-d9023f1f1fea tempest-VolumeImageDependencyTests-1516718617 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f38859af-d836-44d7-9c33-bcd77967c02b_hqf4gt4idevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8c9e226b-a25a-47da-8689-7e6888d70301 {{(pid=87234) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 10:26:56 devstack cinder-volume[87234]: INFO cinder.image.image_utils [None req-509bc449-c4be-4f62-aeb1-d9023f1f1fea tempest-VolumeImageDependencyTests-1516718617 None] Converted 0.00 MB image at 0.00 MB/s Jul 10 10:26:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-509bc449-c4be-4f62-aeb1-d9023f1f1fea tempest-VolumeImageDependencyTests-1516718617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8c9e226b-a25a-47da-8689-7e6888d70301 1G {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:56 devstack sudo[106671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8c9e226b-a25a-47da-8689-7e6888d70301 1G Jul 10 10:26:56 devstack sudo[106671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:56 devstack sudo[106666]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-711d8ee2-1b77-45f5-ac90-1113527bc637 tempest-ProjectReaderTests-1990163970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ecf6457d-eda4-40cb-9286-4f5b70a14b25" returned: 0 in 0.803s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-711d8ee2-1b77-45f5-ac90-1113527bc637 tempest-ProjectReaderTests-1990163970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ecf6457d-eda4-40cb-9286-4f5b70a14b25 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:56 devstack sudo[106676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ecf6457d-eda4-40cb-9286-4f5b70a14b25 Jul 10 10:26:56 devstack sudo[106676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:57 devstack sudo[106671]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:57 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-509bc449-c4be-4f62-aeb1-d9023f1f1fea tempest-VolumeImageDependencyTests-1516718617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8c9e226b-a25a-47da-8689-7e6888d70301 1G" returned: 0 in 0.712s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:57 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c095ce-9e1b-4249-b3cc-08a93d73e6fe]: (4, 'raw') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:26:57 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-509bc449-c4be-4f62-aeb1-d9023f1f1fea tempest-VolumeImageDependencyTests-1516718617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8c9e226b-a25a-47da-8689-7e6888d70301 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:57 devstack sudo[106681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8c9e226b-a25a-47da-8689-7e6888d70301 Jul 10 10:26:57 devstack sudo[106681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:57 devstack sudo[106676]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:57 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-711d8ee2-1b77-45f5-ac90-1113527bc637 tempest-ProjectReaderTests-1990163970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ecf6457d-eda4-40cb-9286-4f5b70a14b25" returned: 0 in 0.726s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:57 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-711d8ee2-1b77-45f5-ac90-1113527bc637 tempest-ProjectReaderTests-1990163970 None] Lock "cinder-quobyte-ecf6457d-eda4-40cb-9286-4f5b70a14b25" released by "delete_volume" :: held 1.599s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:26:57 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-711d8ee2-1b77-45f5-ac90-1113527bc637 tempest-ProjectReaderTests-1990163970 None] Created reservations ['56db615b-af7e-4211-b5dd-846126ca978a', '181dc05b-473b-41fe-904b-5f58a06d8f67', 'ebda6e12-c2f7-4fc8-aa2d-a92ea2d208df', 'd5b83ba8-03e1-4593-8b32-8f4229d191f1'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:26:57 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-711d8ee2-1b77-45f5-ac90-1113527bc637 tempest-ProjectReaderTests-1990163970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:26:57 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-711d8ee2-1b77-45f5-ac90-1113527bc637 tempest-ProjectReaderTests-1990163970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:26:57 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-711d8ee2-1b77-45f5-ac90-1113527bc637 tempest-ProjectReaderTests-1990163970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:26:57 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-711d8ee2-1b77-45f5-ac90-1113527bc637 tempest-ProjectReaderTests-1990163970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:26:57 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-711d8ee2-1b77-45f5-ac90-1113527bc637 tempest-ProjectReaderTests-1990163970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:26:57 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-711d8ee2-1b77-45f5-ac90-1113527bc637 tempest-ProjectReaderTests-1990163970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:57 devstack sudo[106685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:26:57 devstack sudo[106685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:58 devstack sudo[106681]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-509bc449-c4be-4f62-aeb1-d9023f1f1fea tempest-VolumeImageDependencyTests-1516718617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8c9e226b-a25a-47da-8689-7e6888d70301" returned: 0 in 0.909s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-509bc449-c4be-4f62-aeb1-d9023f1f1fea tempest-VolumeImageDependencyTests-1516718617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8c9e226b-a25a-47da-8689-7e6888d70301 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:58 devstack sudo[106689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8c9e226b-a25a-47da-8689-7e6888d70301 Jul 10 10:26:58 devstack sudo[106689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:58 devstack sudo[106685]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-711d8ee2-1b77-45f5-ac90-1113527bc637 tempest-ProjectReaderTests-1990163970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.831s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:58 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-711d8ee2-1b77-45f5-ac90-1113527bc637 tempest-ProjectReaderTests-1990163970 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:26:58 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-711d8ee2-1b77-45f5-ac90-1113527bc637 tempest-ProjectReaderTests-1990163970 None] Deleted volume successfully. Jul 10 10:26:58 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-711d8ee2-1b77-45f5-ac90-1113527bc637 tempest-ProjectReaderTests-1990163970 None] Lock "cinder-ecf6457d-eda4-40cb-9286-4f5b70a14b25-delete_volume" released by "delete_volume" :: held 2.659s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:26:58 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bb58e4a-9acd-43a8-8450-ef7d7c44ef09 tempest-ProjectReaderTests-1990163970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:26:58 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3bb58e4a-9acd-43a8-8450-ef7d7c44ef09 tempest-ProjectReaderTests-1990163970 None] Flow 'volume_create_manager' (8df4f321-368a-44bd-a5c8-32c55f4c5a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:26:58 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3bb58e4a-9acd-43a8-8450-ef7d7c44ef09 tempest-ProjectReaderTests-1990163970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9c21979-7ae3-4e39-9b0d-9fd3b4eba1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:26:58 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3bb58e4a-9acd-43a8-8450-ef7d7c44ef09 tempest-ProjectReaderTests-1990163970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9c21979-7ae3-4e39-9b0d-9fd3b4eba1b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:26:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1213500647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3a0035d-9013-436a-b2bc-08040855331c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9005996ee3c4fd79ff943ddef70d6a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:26:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:26:59Z,use_quota=True,user_id='af3da7e2db214368a3fb84a8cc08b50d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:26:58 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3bb58e4a-9acd-43a8-8450-ef7d7c44ef09 tempest-ProjectReaderTests-1990163970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b391827-cc5e-4a8a-80a9-f89f1f096c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:26:58 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3bb58e4a-9acd-43a8-8450-ef7d7c44ef09 tempest-ProjectReaderTests-1990163970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b391827-cc5e-4a8a-80a9-f89f1f096c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:26:58 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3bb58e4a-9acd-43a8-8450-ef7d7c44ef09 tempest-ProjectReaderTests-1990163970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (108dec05-1f9d-44c7-95a8-7bd81af980a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:26:58 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3bb58e4a-9acd-43a8-8450-ef7d7c44ef09 tempest-ProjectReaderTests-1990163970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (108dec05-1f9d-44c7-95a8-7bd81af980a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3a0035d-9013-436a-b2bc-08040855331c', 'volume_name': 'volume-e3a0035d-9013-436a-b2bc-08040855331c', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:26:58 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3bb58e4a-9acd-43a8-8450-ef7d7c44ef09 tempest-ProjectReaderTests-1990163970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (159a2067-dddf-4b32-981e-87401c5bdbbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:26:58 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3bb58e4a-9acd-43a8-8450-ef7d7c44ef09 tempest-ProjectReaderTests-1990163970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (159a2067-dddf-4b32-981e-87401c5bdbbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:26:58 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3bb58e4a-9acd-43a8-8450-ef7d7c44ef09 tempest-ProjectReaderTests-1990163970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adbb2300-3cdd-4ab4-9b22-6b84df090c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:26:58 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-3bb58e4a-9acd-43a8-8450-ef7d7c44ef09 tempest-ProjectReaderTests-1990163970 None] Volume e3a0035d-9013-436a-b2bc-08040855331c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3a0035d-9013-436a-b2bc-08040855331c', 'volume_size': 1} Jul 10 10:26:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-3bb58e4a-9acd-43a8-8450-ef7d7c44ef09 tempest-ProjectReaderTests-1990163970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:26:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-3bb58e4a-9acd-43a8-8450-ef7d7c44ef09 tempest-ProjectReaderTests-1990163970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:26:58 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-3bb58e4a-9acd-43a8-8450-ef7d7c44ef09 tempest-ProjectReaderTests-1990163970 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:26:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1213500647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3a0035d-9013-436a-b2bc-08040855331c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9005996ee3c4fd79ff943ddef70d6a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:26:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:26:59Z,use_quota=True,user_id='af3da7e2db214368a3fb84a8cc08b50d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:26:58 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-3bb58e4a-9acd-43a8-8450-ef7d7c44ef09 tempest-ProjectReaderTests-1990163970 None] Creating volume e3a0035d-9013-436a-b2bc-08040855331c {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:26:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-3bb58e4a-9acd-43a8-8450-ef7d7c44ef09 tempest-ProjectReaderTests-1990163970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:26:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-3bb58e4a-9acd-43a8-8450-ef7d7c44ef09 tempest-ProjectReaderTests-1990163970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:26:58 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-3bb58e4a-9acd-43a8-8450-ef7d7c44ef09 tempest-ProjectReaderTests-1990163970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:26:58 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-3bb58e4a-9acd-43a8-8450-ef7d7c44ef09 tempest-ProjectReaderTests-1990163970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:26:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-3bb58e4a-9acd-43a8-8450-ef7d7c44ef09 tempest-ProjectReaderTests-1990163970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:26:58 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-3bb58e4a-9acd-43a8-8450-ef7d7c44ef09 tempest-ProjectReaderTests-1990163970 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:26:58 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-3bb58e4a-9acd-43a8-8450-ef7d7c44ef09 tempest-ProjectReaderTests-1990163970 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:26:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3bb58e4a-9acd-43a8-8450-ef7d7c44ef09 tempest-ProjectReaderTests-1990163970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e3a0035d-9013-436a-b2bc-08040855331c 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:58 devstack sudo[106692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e3a0035d-9013-436a-b2bc-08040855331c 1073741824 Jul 10 10:26:58 devstack sudo[106692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:59 devstack sudo[106689]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:59 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-509bc449-c4be-4f62-aeb1-d9023f1f1fea tempest-VolumeImageDependencyTests-1516718617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8c9e226b-a25a-47da-8689-7e6888d70301" returned: 1 in 0.866s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:59 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-509bc449-c4be-4f62-aeb1-d9023f1f1fea tempest-VolumeImageDependencyTests-1516718617 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8c9e226b-a25a-47da-8689-7e6888d70301' failed. Not Retrying. {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 10:26:59 devstack cinder-volume[87234]: DEBUG cinder.volume.volume_utils [None req-509bc449-c4be-4f62-aeb1-d9023f1f1fea tempest-VolumeImageDependencyTests-1516718617 None] Downloaded image f38859af-d836-44d7-9c33-bcd77967c02b ((None, [{'url': 'file:///opt/stack/data/glance/images/f38859af-d836-44d7-9c33-bcd77967c02b', 'metadata': {}}])) to volume 8c9e226b-a25a-47da-8689-7e6888d70301 successfully. {{(pid=87234) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 10:26:59 devstack cinder-volume[87234]: DEBUG cinder.image.image_utils [None req-509bc449-c4be-4f62-aeb1-d9023f1f1fea tempest-VolumeImageDependencyTests-1516718617 None] Temporary image f38859af-d836-44d7-9c33-bcd77967c02b for user 886d98f3810341d5890bea440ec530cd is deleted. {{(pid=87234) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 10:26:59 devstack cinder-volume[87234]: DEBUG cinder.volume.volume_utils [None req-509bc449-c4be-4f62-aeb1-d9023f1f1fea tempest-VolumeImageDependencyTests-1516718617 None] Marking volume 8c9e226b-a25a-47da-8689-7e6888d70301 as bootable. {{(pid=87234) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 10:26:59 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-509bc449-c4be-4f62-aeb1-d9023f1f1fea tempest-VolumeImageDependencyTests-1516718617 None] Copying metadata from image f38859af-d836-44d7-9c33-bcd77967c02b to 8c9e226b-a25a-47da-8689-7e6888d70301. {{(pid=87234) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 10:26:59 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-509bc449-c4be-4f62-aeb1-d9023f1f1fea tempest-VolumeImageDependencyTests-1516718617 None] Creating volume glance metadata for volume 8c9e226b-a25a-47da-8689-7e6888d70301 backed by image f38859af-d836-44d7-9c33-bcd77967c02b with: {'image_id': 'f38859af-d836-44d7-9c33-bcd77967c02b', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '36a748dc5f85e162b11bbbbf6586bd0e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87234) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 10:26:59 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-509bc449-c4be-4f62-aeb1-d9023f1f1fea tempest-VolumeImageDependencyTests-1516718617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81f480d3-64b2-404a-9f7f-21025e79253c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c9e226b-a25a-47da-8689-7e6888d70301', 'volume_size': 1, 'image_id': 'f38859af-d836-44d7-9c33-bcd77967c02b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f38859af-d836-44d7-9c33-bcd77967c02b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '36a748dc5f85e162b11bbbbf6586bd0e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd8340ab9017c41c7966c080d9512b8c5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '45ae2a38779542b5cadcc4ee4462de8368a870d698936af3268d0e990df21552166d8658034eed85c9b20c6449461a495a40ae37e00b7aa38bb0d32413f98ae3', 'id': 'f38859af-d836-44d7-9c33-bcd77967c02b', 'created_at': datetime.datetime(2026, 7, 10, 8, 26, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 8, 26, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f38859af-d836-44d7-9c33-bcd77967c02b/file', 'properties': {}}, 'image_service': }' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:26:59 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-509bc449-c4be-4f62-aeb1-d9023f1f1fea tempest-VolumeImageDependencyTests-1516718617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54cf025d-d14e-4056-8afd-e36079179083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:26:59 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-509bc449-c4be-4f62-aeb1-d9023f1f1fea tempest-VolumeImageDependencyTests-1516718617 None] Volume volume-8c9e226b-a25a-47da-8689-7e6888d70301 (8c9e226b-a25a-47da-8689-7e6888d70301): created successfully Jul 10 10:26:59 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-509bc449-c4be-4f62-aeb1-d9023f1f1fea tempest-VolumeImageDependencyTests-1516718617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54cf025d-d14e-4056-8afd-e36079179083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:26:59 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-509bc449-c4be-4f62-aeb1-d9023f1f1fea tempest-VolumeImageDependencyTests-1516718617 None] Flow 'volume_create_manager' (afb99a1d-1a80-40af-9905-7fc05251fd60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:26:59 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-509bc449-c4be-4f62-aeb1-d9023f1f1fea tempest-VolumeImageDependencyTests-1516718617 None] Created volume successfully. Jul 10 10:26:59 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-e5f1e5f1-3e37-44d3-a6cb-1aac37e71a1f tempest-VolumeImageDependencyTests-1516718617 None] Acquiring lock "cinder-8c9e226b-a25a-47da-8689-7e6888d70301-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:26:59 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-e5f1e5f1-3e37-44d3-a6cb-1aac37e71a1f tempest-VolumeImageDependencyTests-1516718617 None] Lock "cinder-8c9e226b-a25a-47da-8689-7e6888d70301-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:26:59 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-e5f1e5f1-3e37-44d3-a6cb-1aac37e71a1f tempest-VolumeImageDependencyTests-1516718617 None] Acquiring lock "cinder-quobyte-8c9e226b-a25a-47da-8689-7e6888d70301" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:26:59 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-e5f1e5f1-3e37-44d3-a6cb-1aac37e71a1f tempest-VolumeImageDependencyTests-1516718617 None] Lock "cinder-quobyte-8c9e226b-a25a-47da-8689-7e6888d70301" acquired by "delete_volume" :: waited 0.029s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:26:59 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eadddd5-6b83-46e6-b5cb-9bee8d80674e]: (4, 'raw') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:26:59 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e5f1e5f1-3e37-44d3-a6cb-1aac37e71a1f tempest-VolumeImageDependencyTests-1516718617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8c9e226b-a25a-47da-8689-7e6888d70301 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:59 devstack sudo[106692]: pam_unix(sudo:session): session closed for user root Jul 10 10:26:59 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3bb58e4a-9acd-43a8-8450-ef7d7c44ef09 tempest-ProjectReaderTests-1990163970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e3a0035d-9013-436a-b2bc-08040855331c 1073741824" returned: 0 in 1.022s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:26:59 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3bb58e4a-9acd-43a8-8450-ef7d7c44ef09 tempest-ProjectReaderTests-1990163970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e3a0035d-9013-436a-b2bc-08040855331c {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:26:59 devstack sudo[106702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e3a0035d-9013-436a-b2bc-08040855331c Jul 10 10:26:59 devstack sudo[106702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:26:59 devstack sudo[106701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8c9e226b-a25a-47da-8689-7e6888d70301 Jul 10 10:26:59 devstack sudo[106701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:00 devstack sudo[106702]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:00 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3bb58e4a-9acd-43a8-8450-ef7d7c44ef09 tempest-ProjectReaderTests-1990163970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e3a0035d-9013-436a-b2bc-08040855331c" returned: 0 in 0.687s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:00 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-3bb58e4a-9acd-43a8-8450-ef7d7c44ef09 tempest-ProjectReaderTests-1990163970 None] <== create_volume: return (1752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:27:00 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-3bb58e4a-9acd-43a8-8450-ef7d7c44ef09 tempest-ProjectReaderTests-1990163970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.756s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:27:00 devstack sudo[106701]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:00 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e5f1e5f1-3e37-44d3-a6cb-1aac37e71a1f tempest-VolumeImageDependencyTests-1516718617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8c9e226b-a25a-47da-8689-7e6888d70301" returned: 0 in 0.781s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:00 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e5f1e5f1-3e37-44d3-a6cb-1aac37e71a1f tempest-VolumeImageDependencyTests-1516718617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8c9e226b-a25a-47da-8689-7e6888d70301 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:00 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3bb58e4a-9acd-43a8-8450-ef7d7c44ef09 tempest-ProjectReaderTests-1990163970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adbb2300-3cdd-4ab4-9b22-6b84df090c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3a0035d-9013-436a-b2bc-08040855331c', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:27:00 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3bb58e4a-9acd-43a8-8450-ef7d7c44ef09 tempest-ProjectReaderTests-1990163970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cc1b340-55fb-45a0-93e1-cf1279241c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:27:00 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-3bb58e4a-9acd-43a8-8450-ef7d7c44ef09 tempest-ProjectReaderTests-1990163970 None] Volume volume-e3a0035d-9013-436a-b2bc-08040855331c (e3a0035d-9013-436a-b2bc-08040855331c): created successfully Jul 10 10:27:00 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3bb58e4a-9acd-43a8-8450-ef7d7c44ef09 tempest-ProjectReaderTests-1990163970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cc1b340-55fb-45a0-93e1-cf1279241c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:27:00 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-3bb58e4a-9acd-43a8-8450-ef7d7c44ef09 tempest-ProjectReaderTests-1990163970 None] Flow 'volume_create_manager' (8df4f321-368a-44bd-a5c8-32c55f4c5a8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:27:00 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-3bb58e4a-9acd-43a8-8450-ef7d7c44ef09 tempest-ProjectReaderTests-1990163970 None] Created volume successfully. Jul 10 10:27:00 devstack sudo[106708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8c9e226b-a25a-47da-8689-7e6888d70301 Jul 10 10:27:00 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:01 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-5ab88bb2-eda0-4b47-8205-374a7acb3f02 tempest-ProjectReaderTests-1990163970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:27:01 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-5ab88bb2-eda0-4b47-8205-374a7acb3f02 tempest-ProjectReaderTests-1990163970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:27:01 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-5ab88bb2-eda0-4b47-8205-374a7acb3f02 tempest-ProjectReaderTests-1990163970 None] Creating offline snapshot 4353cb3a-a829-4270-8bc2-6ea0553127e0 of volume e3a0035d-9013-436a-b2bc-08040855331c {{(pid=87234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 10:27:01 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4544a4-9f73-478f-a1f6-e6f58c6e61aa]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:27:01 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5ab88bb2-eda0-4b47-8205-374a7acb3f02 tempest-ProjectReaderTests-1990163970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e3a0035d-9013-436a-b2bc-08040855331c {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:01 devstack sudo[106710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e3a0035d-9013-436a-b2bc-08040855331c Jul 10 10:27:01 devstack sudo[106710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:01 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:01 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e5f1e5f1-3e37-44d3-a6cb-1aac37e71a1f tempest-VolumeImageDependencyTests-1516718617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8c9e226b-a25a-47da-8689-7e6888d70301" returned: 1 in 0.917s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:01 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e5f1e5f1-3e37-44d3-a6cb-1aac37e71a1f tempest-VolumeImageDependencyTests-1516718617 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8c9e226b-a25a-47da-8689-7e6888d70301' failed. Not Retrying. {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 10:27:01 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e5f1e5f1-3e37-44d3-a6cb-1aac37e71a1f tempest-VolumeImageDependencyTests-1516718617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8c9e226b-a25a-47da-8689-7e6888d70301 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:01 devstack sudo[106715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8c9e226b-a25a-47da-8689-7e6888d70301 Jul 10 10:27:01 devstack sudo[106715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:01 devstack sudo[106710]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:01 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5ab88bb2-eda0-4b47-8205-374a7acb3f02 tempest-ProjectReaderTests-1990163970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e3a0035d-9013-436a-b2bc-08040855331c" returned: 0 in 0.859s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:01 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5ab88bb2-eda0-4b47-8205-374a7acb3f02 tempest-ProjectReaderTests-1990163970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e3a0035d-9013-436a-b2bc-08040855331c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e3a0035d-9013-436a-b2bc-08040855331c.4353cb3a-a829-4270-8bc2-6ea0553127e0 1G {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:01 devstack sudo[106720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e3a0035d-9013-436a-b2bc-08040855331c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e3a0035d-9013-436a-b2bc-08040855331c.4353cb3a-a829-4270-8bc2-6ea0553127e0 1G Jul 10 10:27:01 devstack sudo[106720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:02 devstack sudo[106715]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e5f1e5f1-3e37-44d3-a6cb-1aac37e71a1f tempest-VolumeImageDependencyTests-1516718617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-8c9e226b-a25a-47da-8689-7e6888d70301" returned: 0 in 0.718s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:02 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-e5f1e5f1-3e37-44d3-a6cb-1aac37e71a1f tempest-VolumeImageDependencyTests-1516718617 None] Lock "cinder-quobyte-8c9e226b-a25a-47da-8689-7e6888d70301" released by "delete_volume" :: held 2.513s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:27:02 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-e5f1e5f1-3e37-44d3-a6cb-1aac37e71a1f tempest-VolumeImageDependencyTests-1516718617 None] Created reservations ['f79a795b-871b-41f9-9f58-8c67328a5f76', '53fb8863-fde7-4aa9-bbce-6d3f1bceeb5b', '86b8dcd7-7e0e-4322-82a4-ac88ec1594f0', '4f4a643c-ae06-4cbe-ae5f-6e4cc4233ec1'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:27:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-e5f1e5f1-3e37-44d3-a6cb-1aac37e71a1f tempest-VolumeImageDependencyTests-1516718617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:27:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-e5f1e5f1-3e37-44d3-a6cb-1aac37e71a1f tempest-VolumeImageDependencyTests-1516718617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:27:02 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-e5f1e5f1-3e37-44d3-a6cb-1aac37e71a1f tempest-VolumeImageDependencyTests-1516718617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:27:02 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-e5f1e5f1-3e37-44d3-a6cb-1aac37e71a1f tempest-VolumeImageDependencyTests-1516718617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:27:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-e5f1e5f1-3e37-44d3-a6cb-1aac37e71a1f tempest-VolumeImageDependencyTests-1516718617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:27:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e5f1e5f1-3e37-44d3-a6cb-1aac37e71a1f tempest-VolumeImageDependencyTests-1516718617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:02 devstack sudo[106723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:27:02 devstack sudo[106723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:02 devstack sudo[106720]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5ab88bb2-eda0-4b47-8205-374a7acb3f02 tempest-ProjectReaderTests-1990163970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e3a0035d-9013-436a-b2bc-08040855331c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e3a0035d-9013-436a-b2bc-08040855331c.4353cb3a-a829-4270-8bc2-6ea0553127e0 1G" returned: 0 in 0.866s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5ab88bb2-eda0-4b47-8205-374a7acb3f02 tempest-ProjectReaderTests-1990163970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3a0035d-9013-436a-b2bc-08040855331c -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e3a0035d-9013-436a-b2bc-08040855331c.4353cb3a-a829-4270-8bc2-6ea0553127e0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:02 devstack sudo[106728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3a0035d-9013-436a-b2bc-08040855331c -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e3a0035d-9013-436a-b2bc-08040855331c.4353cb3a-a829-4270-8bc2-6ea0553127e0 Jul 10 10:27:02 devstack sudo[106728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:03 devstack sudo[106723]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e5f1e5f1-3e37-44d3-a6cb-1aac37e71a1f tempest-VolumeImageDependencyTests-1516718617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.825s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:03 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-e5f1e5f1-3e37-44d3-a6cb-1aac37e71a1f tempest-VolumeImageDependencyTests-1516718617 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:27:03 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-e5f1e5f1-3e37-44d3-a6cb-1aac37e71a1f tempest-VolumeImageDependencyTests-1516718617 None] Deleted volume successfully. Jul 10 10:27:03 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-e5f1e5f1-3e37-44d3-a6cb-1aac37e71a1f tempest-VolumeImageDependencyTests-1516718617 None] Lock "cinder-8c9e226b-a25a-47da-8689-7e6888d70301-delete_volume" released by "delete_volume" :: held 3.646s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:27:03 devstack sudo[106728]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5ab88bb2-eda0-4b47-8205-374a7acb3f02 tempest-ProjectReaderTests-1990163970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3a0035d-9013-436a-b2bc-08040855331c -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e3a0035d-9013-436a-b2bc-08040855331c.4353cb3a-a829-4270-8bc2-6ea0553127e0" returned: 0 in 0.861s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:03 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-5ab88bb2-eda0-4b47-8205-374a7acb3f02 tempest-ProjectReaderTests-1990163970 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e3a0035d-9013-436a-b2bc-08040855331c.4353cb3a-a829-4270-8bc2-6ea0553127e0 is being set with open permissions: ugo+rw Jul 10 10:27:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5ab88bb2-eda0-4b47-8205-374a7acb3f02 tempest-ProjectReaderTests-1990163970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e3a0035d-9013-436a-b2bc-08040855331c.4353cb3a-a829-4270-8bc2-6ea0553127e0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:03 devstack sudo[106734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e3a0035d-9013-436a-b2bc-08040855331c.4353cb3a-a829-4270-8bc2-6ea0553127e0 Jul 10 10:27:03 devstack sudo[106734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:04 devstack sudo[106734]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5ab88bb2-eda0-4b47-8205-374a7acb3f02 tempest-ProjectReaderTests-1990163970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e3a0035d-9013-436a-b2bc-08040855331c.4353cb3a-a829-4270-8bc2-6ea0553127e0" returned: 0 in 0.729s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5ab88bb2-eda0-4b47-8205-374a7acb3f02 tempest-ProjectReaderTests-1990163970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e3a0035d-9013-436a-b2bc-08040855331c.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:04 devstack sudo[106737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e3a0035d-9013-436a-b2bc-08040855331c.info Jul 10 10:27:04 devstack sudo[106737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:05 devstack sudo[106737]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5ab88bb2-eda0-4b47-8205-374a7acb3f02 tempest-ProjectReaderTests-1990163970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e3a0035d-9013-436a-b2bc-08040855331c.info" returned: 0 in 0.938s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:05 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-5ab88bb2-eda0-4b47-8205-374a7acb3f02 tempest-ProjectReaderTests-1990163970 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e3a0035d-9013-436a-b2bc-08040855331c.info is being set with open permissions: ugo+rw Jul 10 10:27:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5ab88bb2-eda0-4b47-8205-374a7acb3f02 tempest-ProjectReaderTests-1990163970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e3a0035d-9013-436a-b2bc-08040855331c.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:05 devstack sudo[106740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e3a0035d-9013-436a-b2bc-08040855331c.info Jul 10 10:27:05 devstack sudo[106740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:06 devstack sudo[106740]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5ab88bb2-eda0-4b47-8205-374a7acb3f02 tempest-ProjectReaderTests-1990163970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e3a0035d-9013-436a-b2bc-08040855331c.info" returned: 0 in 0.713s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-5ab88bb2-eda0-4b47-8205-374a7acb3f02 tempest-ProjectReaderTests-1990163970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.075s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:27:06 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-5ab88bb2-eda0-4b47-8205-374a7acb3f02 tempest-ProjectReaderTests-1990163970 None] Create snapshot completed successfully Jul 10 10:27:06 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f60c54ed-754f-45f7-9f83-d17879d43fd7 tempest-ProjectReaderTests-1990163970 None] Acquiring lock "cinder-4353cb3a-a829-4270-8bc2-6ea0553127e0-delete_snapshot" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:27:06 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f60c54ed-754f-45f7-9f83-d17879d43fd7 tempest-ProjectReaderTests-1990163970 None] Lock "cinder-4353cb3a-a829-4270-8bc2-6ea0553127e0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:27:06 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f60c54ed-754f-45f7-9f83-d17879d43fd7 tempest-ProjectReaderTests-1990163970 None] Acquiring lock "cinder-quobyte-e3a0035d-9013-436a-b2bc-08040855331c" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:27:06 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f60c54ed-754f-45f7-9f83-d17879d43fd7 tempest-ProjectReaderTests-1990163970 None] Lock "cinder-quobyte-e3a0035d-9013-436a-b2bc-08040855331c" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:27:06 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f60c54ed-754f-45f7-9f83-d17879d43fd7 tempest-ProjectReaderTests-1990163970 None] Acquiring lock "cinder-quobyte-4353cb3a-a829-4270-8bc2-6ea0553127e0" by "_delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:27:06 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f60c54ed-754f-45f7-9f83-d17879d43fd7 tempest-ProjectReaderTests-1990163970 None] Lock "cinder-quobyte-4353cb3a-a829-4270-8bc2-6ea0553127e0" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:27:06 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-f60c54ed-754f-45f7-9f83-d17879d43fd7 tempest-ProjectReaderTests-1990163970 None] Deleting offline snapshot 4353cb3a-a829-4270-8bc2-6ea0553127e0 of volume e3a0035d-9013-436a-b2bc-08040855331c {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 10:27:06 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-f60c54ed-754f-45f7-9f83-d17879d43fd7 tempest-ProjectReaderTests-1990163970 None] snapshot_file for this snap is: volume-e3a0035d-9013-436a-b2bc-08040855331c.4353cb3a-a829-4270-8bc2-6ea0553127e0 {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 10:27:06 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[948632f7-38da-43bc-aa00-f6b8edea4595]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:27:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f60c54ed-754f-45f7-9f83-d17879d43fd7 tempest-ProjectReaderTests-1990163970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e3a0035d-9013-436a-b2bc-08040855331c.4353cb3a-a829-4270-8bc2-6ea0553127e0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:06 devstack sudo[106743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e3a0035d-9013-436a-b2bc-08040855331c.4353cb3a-a829-4270-8bc2-6ea0553127e0 Jul 10 10:27:06 devstack sudo[106743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:07 devstack sudo[106743]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f60c54ed-754f-45f7-9f83-d17879d43fd7 tempest-ProjectReaderTests-1990163970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e3a0035d-9013-436a-b2bc-08040855331c.4353cb3a-a829-4270-8bc2-6ea0553127e0" returned: 0 in 0.885s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:07 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-f60c54ed-754f-45f7-9f83-d17879d43fd7 tempest-ProjectReaderTests-1990163970 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e3a0035d-9013-436a-b2bc-08040855331c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 10:27:07 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff7b6b3-faac-471f-beb7-aa68a71a98e8]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:27:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f60c54ed-754f-45f7-9f83-d17879d43fd7 tempest-ProjectReaderTests-1990163970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e3a0035d-9013-436a-b2bc-08040855331c {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:07 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-f81ecae8-d497-43d0-a8fa-115720ba4f1d tempest-ProjectMemberTests-915988921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:27:07 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f81ecae8-d497-43d0-a8fa-115720ba4f1d tempest-ProjectMemberTests-915988921 None] Flow 'volume_create_manager' (2f8d6913-f6b4-40b7-9be8-f6e35e537e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:27:07 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f81ecae8-d497-43d0-a8fa-115720ba4f1d tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0473891-097f-4189-b023-5b27a79b1b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:27:07 devstack sudo[106749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e3a0035d-9013-436a-b2bc-08040855331c Jul 10 10:27:07 devstack sudo[106749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:07 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f81ecae8-d497-43d0-a8fa-115720ba4f1d tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0473891-097f-4189-b023-5b27a79b1b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:27:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1232577254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94a490e8-5b51-4cc1-9466-0f0f03af2a1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac4b039bd3aa49f393fe3462e2fed6d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:27:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:27:07Z,use_quota=True,user_id='cc3f433661ac4946825a66613f6d748c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:27:07 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f81ecae8-d497-43d0-a8fa-115720ba4f1d tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88f120ed-e320-4793-9eb2-1370da648228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:27:07 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f81ecae8-d497-43d0-a8fa-115720ba4f1d tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88f120ed-e320-4793-9eb2-1370da648228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:27:07 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f81ecae8-d497-43d0-a8fa-115720ba4f1d tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5085582a-d9e0-49b0-826d-ef6f5c91358d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:27:07 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f81ecae8-d497-43d0-a8fa-115720ba4f1d tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5085582a-d9e0-49b0-826d-ef6f5c91358d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94a490e8-5b51-4cc1-9466-0f0f03af2a1e', 'volume_name': 'volume-94a490e8-5b51-4cc1-9466-0f0f03af2a1e', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:27:07 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f81ecae8-d497-43d0-a8fa-115720ba4f1d tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e22a98e-46bb-47be-8bdd-8a4a46a4f9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:27:07 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f81ecae8-d497-43d0-a8fa-115720ba4f1d tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e22a98e-46bb-47be-8bdd-8a4a46a4f9cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:27:07 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f81ecae8-d497-43d0-a8fa-115720ba4f1d tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02dc02c5-d846-4118-99fd-bf6b0a133cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:27:07 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-f81ecae8-d497-43d0-a8fa-115720ba4f1d tempest-ProjectMemberTests-915988921 None] Volume 94a490e8-5b51-4cc1-9466-0f0f03af2a1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94a490e8-5b51-4cc1-9466-0f0f03af2a1e', 'volume_size': 1} Jul 10 10:27:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f81ecae8-d497-43d0-a8fa-115720ba4f1d tempest-ProjectMemberTests-915988921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:27:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f81ecae8-d497-43d0-a8fa-115720ba4f1d tempest-ProjectMemberTests-915988921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:27:07 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f81ecae8-d497-43d0-a8fa-115720ba4f1d tempest-ProjectMemberTests-915988921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:27:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1232577254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94a490e8-5b51-4cc1-9466-0f0f03af2a1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac4b039bd3aa49f393fe3462e2fed6d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:27:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:27:07Z,use_quota=True,user_id='cc3f433661ac4946825a66613f6d748c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:27:07 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-f81ecae8-d497-43d0-a8fa-115720ba4f1d tempest-ProjectMemberTests-915988921 None] Creating volume 94a490e8-5b51-4cc1-9466-0f0f03af2a1e {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:27:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f81ecae8-d497-43d0-a8fa-115720ba4f1d tempest-ProjectMemberTests-915988921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:27:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f81ecae8-d497-43d0-a8fa-115720ba4f1d tempest-ProjectMemberTests-915988921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:27:07 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f81ecae8-d497-43d0-a8fa-115720ba4f1d tempest-ProjectMemberTests-915988921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:27:07 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f81ecae8-d497-43d0-a8fa-115720ba4f1d tempest-ProjectMemberTests-915988921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:27:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f81ecae8-d497-43d0-a8fa-115720ba4f1d tempest-ProjectMemberTests-915988921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:27:07 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f81ecae8-d497-43d0-a8fa-115720ba4f1d tempest-ProjectMemberTests-915988921 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:27:07 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-f81ecae8-d497-43d0-a8fa-115720ba4f1d tempest-ProjectMemberTests-915988921 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:27:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f81ecae8-d497-43d0-a8fa-115720ba4f1d tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94a490e8-5b51-4cc1-9466-0f0f03af2a1e 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:07 devstack sudo[106752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94a490e8-5b51-4cc1-9466-0f0f03af2a1e 1073741824 Jul 10 10:27:07 devstack sudo[106752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:08 devstack sudo[106749]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:08 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f60c54ed-754f-45f7-9f83-d17879d43fd7 tempest-ProjectReaderTests-1990163970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e3a0035d-9013-436a-b2bc-08040855331c" returned: 0 in 0.962s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:08 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f60c54ed-754f-45f7-9f83-d17879d43fd7 tempest-ProjectReaderTests-1990163970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e3a0035d-9013-436a-b2bc-08040855331c.4353cb3a-a829-4270-8bc2-6ea0553127e0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:08 devstack sudo[106760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e3a0035d-9013-436a-b2bc-08040855331c.4353cb3a-a829-4270-8bc2-6ea0553127e0 Jul 10 10:27:08 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:08 devstack sudo[106752]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:08 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f81ecae8-d497-43d0-a8fa-115720ba4f1d tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94a490e8-5b51-4cc1-9466-0f0f03af2a1e 1073741824" returned: 0 in 1.111s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:08 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f81ecae8-d497-43d0-a8fa-115720ba4f1d tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94a490e8-5b51-4cc1-9466-0f0f03af2a1e {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:08 devstack sudo[106763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94a490e8-5b51-4cc1-9466-0f0f03af2a1e Jul 10 10:27:08 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:09 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:09 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f60c54ed-754f-45f7-9f83-d17879d43fd7 tempest-ProjectReaderTests-1990163970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e3a0035d-9013-436a-b2bc-08040855331c.4353cb3a-a829-4270-8bc2-6ea0553127e0" returned: 0 in 0.843s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:09 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f60c54ed-754f-45f7-9f83-d17879d43fd7 tempest-ProjectReaderTests-1990163970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e3a0035d-9013-436a-b2bc-08040855331c.4353cb3a-a829-4270-8bc2-6ea0553127e0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:09 devstack sudo[106769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e3a0035d-9013-436a-b2bc-08040855331c.4353cb3a-a829-4270-8bc2-6ea0553127e0 Jul 10 10:27:09 devstack sudo[106769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:09 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:09 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f81ecae8-d497-43d0-a8fa-115720ba4f1d tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94a490e8-5b51-4cc1-9466-0f0f03af2a1e" returned: 0 in 0.743s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:09 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f81ecae8-d497-43d0-a8fa-115720ba4f1d tempest-ProjectMemberTests-915988921 None] <== create_volume: return (1909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:27:09 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f81ecae8-d497-43d0-a8fa-115720ba4f1d tempest-ProjectMemberTests-915988921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.911s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:27:09 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f81ecae8-d497-43d0-a8fa-115720ba4f1d tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02dc02c5-d846-4118-99fd-bf6b0a133cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94a490e8-5b51-4cc1-9466-0f0f03af2a1e', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:27:09 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f81ecae8-d497-43d0-a8fa-115720ba4f1d tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45955ab0-8184-4234-bcd2-57c9a3eceffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:27:09 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-f81ecae8-d497-43d0-a8fa-115720ba4f1d tempest-ProjectMemberTests-915988921 None] Volume volume-94a490e8-5b51-4cc1-9466-0f0f03af2a1e (94a490e8-5b51-4cc1-9466-0f0f03af2a1e): created successfully Jul 10 10:27:09 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f81ecae8-d497-43d0-a8fa-115720ba4f1d tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45955ab0-8184-4234-bcd2-57c9a3eceffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:27:09 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-f81ecae8-d497-43d0-a8fa-115720ba4f1d tempest-ProjectMemberTests-915988921 None] Flow 'volume_create_manager' (2f8d6913-f6b4-40b7-9be8-f6e35e537e1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:27:09 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-f81ecae8-d497-43d0-a8fa-115720ba4f1d tempest-ProjectMemberTests-915988921 None] Created volume successfully. Jul 10 10:27:09 devstack sudo[106769]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:09 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f60c54ed-754f-45f7-9f83-d17879d43fd7 tempest-ProjectReaderTests-1990163970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e3a0035d-9013-436a-b2bc-08040855331c.4353cb3a-a829-4270-8bc2-6ea0553127e0" returned: 0 in 0.762s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:10 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f60c54ed-754f-45f7-9f83-d17879d43fd7 tempest-ProjectReaderTests-1990163970 None] Lock "cinder-quobyte-4353cb3a-a829-4270-8bc2-6ea0553127e0" released by "_delete_snapshot" :: held 3.598s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:27:10 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f60c54ed-754f-45f7-9f83-d17879d43fd7 tempest-ProjectReaderTests-1990163970 None] Lock "cinder-quobyte-e3a0035d-9013-436a-b2bc-08040855331c" released by "delete_snapshot" :: held 3.629s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:27:10 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-f60c54ed-754f-45f7-9f83-d17879d43fd7 tempest-ProjectReaderTests-1990163970 None] Created reservations ['288e5ccb-d811-4f97-9d74-c32bc42c0b0e', '4ca28205-c13e-48a2-9a47-2d2200e336ec', '3c0bdfbc-d052-41ff-8944-ca9e8c05e8d2', '7c15e389-8694-443c-a95e-50688ec95316'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:27:10 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-f60c54ed-754f-45f7-9f83-d17879d43fd7 tempest-ProjectReaderTests-1990163970 None] Delete snapshot completed successfully. Jul 10 10:27:10 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f60c54ed-754f-45f7-9f83-d17879d43fd7 tempest-ProjectReaderTests-1990163970 None] Lock "cinder-4353cb3a-a829-4270-8bc2-6ea0553127e0-delete_snapshot" released by "delete_snapshot" :: held 3.778s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:27:10 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-5af881c2-81a9-499e-8198-b60e1b60c5c3 tempest-ProjectReaderTests-1990163970 None] Acquiring lock "cinder-e3a0035d-9013-436a-b2bc-08040855331c-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:27:10 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-5af881c2-81a9-499e-8198-b60e1b60c5c3 tempest-ProjectReaderTests-1990163970 None] Lock "cinder-e3a0035d-9013-436a-b2bc-08040855331c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:27:10 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-5af881c2-81a9-499e-8198-b60e1b60c5c3 tempest-ProjectReaderTests-1990163970 None] Acquiring lock "cinder-quobyte-e3a0035d-9013-436a-b2bc-08040855331c" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:27:10 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-5af881c2-81a9-499e-8198-b60e1b60c5c3 tempest-ProjectReaderTests-1990163970 None] Lock "cinder-quobyte-e3a0035d-9013-436a-b2bc-08040855331c" acquired by "delete_volume" :: waited 0.023s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:27:10 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5135215-ea9e-4960-85f1-c8a88bf94dc3]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:27:10 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5af881c2-81a9-499e-8198-b60e1b60c5c3 tempest-ProjectReaderTests-1990163970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e3a0035d-9013-436a-b2bc-08040855331c {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:10 devstack sudo[106773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e3a0035d-9013-436a-b2bc-08040855331c Jul 10 10:27:10 devstack sudo[106773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:11 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-065020d2-14c0-41ec-abbf-d2fe2476139a tempest-ProjectMemberTests-915988921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:27:11 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-065020d2-14c0-41ec-abbf-d2fe2476139a tempest-ProjectMemberTests-915988921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:27:11 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-065020d2-14c0-41ec-abbf-d2fe2476139a tempest-ProjectMemberTests-915988921 None] Creating offline snapshot 18d248b3-98e4-47c4-b3dd-2ac000b05225 of volume 94a490e8-5b51-4cc1-9466-0f0f03af2a1e {{(pid=87234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 10:27:11 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b552fce-3fa0-4a85-b51f-9243fed2083e]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:27:11 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-065020d2-14c0-41ec-abbf-d2fe2476139a tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94a490e8-5b51-4cc1-9466-0f0f03af2a1e {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:11 devstack sudo[106775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94a490e8-5b51-4cc1-9466-0f0f03af2a1e Jul 10 10:27:11 devstack sudo[106775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:11 devstack sudo[106773]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:11 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5af881c2-81a9-499e-8198-b60e1b60c5c3 tempest-ProjectReaderTests-1990163970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e3a0035d-9013-436a-b2bc-08040855331c" returned: 0 in 1.141s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:11 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5af881c2-81a9-499e-8198-b60e1b60c5c3 tempest-ProjectReaderTests-1990163970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e3a0035d-9013-436a-b2bc-08040855331c {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:11 devstack sudo[106780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e3a0035d-9013-436a-b2bc-08040855331c Jul 10 10:27:11 devstack sudo[106780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:12 devstack sudo[106775]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-065020d2-14c0-41ec-abbf-d2fe2476139a tempest-ProjectMemberTests-915988921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94a490e8-5b51-4cc1-9466-0f0f03af2a1e" returned: 0 in 0.873s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-065020d2-14c0-41ec-abbf-d2fe2476139a tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94a490e8-5b51-4cc1-9466-0f0f03af2a1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94a490e8-5b51-4cc1-9466-0f0f03af2a1e.18d248b3-98e4-47c4-b3dd-2ac000b05225 1G {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:12 devstack sudo[106785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94a490e8-5b51-4cc1-9466-0f0f03af2a1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94a490e8-5b51-4cc1-9466-0f0f03af2a1e.18d248b3-98e4-47c4-b3dd-2ac000b05225 1G Jul 10 10:27:12 devstack sudo[106785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:12 devstack sudo[106780]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5af881c2-81a9-499e-8198-b60e1b60c5c3 tempest-ProjectReaderTests-1990163970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-e3a0035d-9013-436a-b2bc-08040855331c" returned: 0 in 0.725s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:12 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-5af881c2-81a9-499e-8198-b60e1b60c5c3 tempest-ProjectReaderTests-1990163970 None] Lock "cinder-quobyte-e3a0035d-9013-436a-b2bc-08040855331c" released by "delete_volume" :: held 1.945s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:27:12 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-5af881c2-81a9-499e-8198-b60e1b60c5c3 tempest-ProjectReaderTests-1990163970 None] Created reservations ['2a77461e-95f3-467a-9707-acbbd45d08f5', '7dd088ae-5481-4919-a0c1-7f0798087876', 'ac171105-1c8f-4372-b15b-adaa841dc0d3', 'dd6df0d0-f866-4be5-ad9e-26dcc678497b'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:27:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-5af881c2-81a9-499e-8198-b60e1b60c5c3 tempest-ProjectReaderTests-1990163970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:27:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-5af881c2-81a9-499e-8198-b60e1b60c5c3 tempest-ProjectReaderTests-1990163970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:27:12 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-5af881c2-81a9-499e-8198-b60e1b60c5c3 tempest-ProjectReaderTests-1990163970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:27:12 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-5af881c2-81a9-499e-8198-b60e1b60c5c3 tempest-ProjectReaderTests-1990163970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:27:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-5af881c2-81a9-499e-8198-b60e1b60c5c3 tempest-ProjectReaderTests-1990163970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:27:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5af881c2-81a9-499e-8198-b60e1b60c5c3 tempest-ProjectReaderTests-1990163970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:12 devstack sudo[106791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:27:12 devstack sudo[106791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:13 devstack sudo[106785]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:13 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-065020d2-14c0-41ec-abbf-d2fe2476139a tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94a490e8-5b51-4cc1-9466-0f0f03af2a1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94a490e8-5b51-4cc1-9466-0f0f03af2a1e.18d248b3-98e4-47c4-b3dd-2ac000b05225 1G" returned: 0 in 0.992s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:13 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-065020d2-14c0-41ec-abbf-d2fe2476139a tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94a490e8-5b51-4cc1-9466-0f0f03af2a1e -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94a490e8-5b51-4cc1-9466-0f0f03af2a1e.18d248b3-98e4-47c4-b3dd-2ac000b05225 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:13 devstack sudo[106793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94a490e8-5b51-4cc1-9466-0f0f03af2a1e -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94a490e8-5b51-4cc1-9466-0f0f03af2a1e.18d248b3-98e4-47c4-b3dd-2ac000b05225 Jul 10 10:27:13 devstack sudo[106793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:13 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-b66c56e9-3ca4-4478-9105-183191dde3c0 tempest-ProjectReaderTests-1990163970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:27:13 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-b66c56e9-3ca4-4478-9105-183191dde3c0 tempest-ProjectReaderTests-1990163970 None] Flow 'volume_create_manager' (e32ad9c6-eb25-4e1e-a89a-9f4c9bed850d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:27:13 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-b66c56e9-3ca4-4478-9105-183191dde3c0 tempest-ProjectReaderTests-1990163970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (673adfa2-e858-426a-b4ad-d417add3a1c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:27:13 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-b66c56e9-3ca4-4478-9105-183191dde3c0 tempest-ProjectReaderTests-1990163970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (673adfa2-e858-426a-b4ad-d417add3a1c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:27:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-290102251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=983acae2-9a54-417c-a9d8-4ffb038f3c91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9005996ee3c4fd79ff943ddef70d6a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:27:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:27:14Z,use_quota=True,user_id='af3da7e2db214368a3fb84a8cc08b50d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:27:13 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-b66c56e9-3ca4-4478-9105-183191dde3c0 tempest-ProjectReaderTests-1990163970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1448e18-41f5-4985-9200-9106c2741860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:27:13 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-b66c56e9-3ca4-4478-9105-183191dde3c0 tempest-ProjectReaderTests-1990163970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1448e18-41f5-4985-9200-9106c2741860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:27:13 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-b66c56e9-3ca4-4478-9105-183191dde3c0 tempest-ProjectReaderTests-1990163970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fabff1e-e6c0-4339-8120-859a3daf2922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:27:13 devstack sudo[106791]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:13 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-b66c56e9-3ca4-4478-9105-183191dde3c0 tempest-ProjectReaderTests-1990163970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fabff1e-e6c0-4339-8120-859a3daf2922) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '983acae2-9a54-417c-a9d8-4ffb038f3c91', 'volume_name': 'volume-983acae2-9a54-417c-a9d8-4ffb038f3c91', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:27:13 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-b66c56e9-3ca4-4478-9105-183191dde3c0 tempest-ProjectReaderTests-1990163970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6486c7df-661b-4e94-bbd2-ddd4288cac93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:27:13 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-b66c56e9-3ca4-4478-9105-183191dde3c0 tempest-ProjectReaderTests-1990163970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6486c7df-661b-4e94-bbd2-ddd4288cac93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:27:13 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-b66c56e9-3ca4-4478-9105-183191dde3c0 tempest-ProjectReaderTests-1990163970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (204ff3c6-78e8-4cf6-bcb8-e36245f19804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:27:13 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-b66c56e9-3ca4-4478-9105-183191dde3c0 tempest-ProjectReaderTests-1990163970 None] Volume 983acae2-9a54-417c-a9d8-4ffb038f3c91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-983acae2-9a54-417c-a9d8-4ffb038f3c91', 'volume_size': 1} Jul 10 10:27:13 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-b66c56e9-3ca4-4478-9105-183191dde3c0 tempest-ProjectReaderTests-1990163970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:27:13 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5af881c2-81a9-499e-8198-b60e1b60c5c3 tempest-ProjectReaderTests-1990163970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.916s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:13 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-5af881c2-81a9-499e-8198-b60e1b60c5c3 tempest-ProjectReaderTests-1990163970 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:27:13 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-5af881c2-81a9-499e-8198-b60e1b60c5c3 tempest-ProjectReaderTests-1990163970 None] Deleted volume successfully. Jul 10 10:27:13 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-5af881c2-81a9-499e-8198-b60e1b60c5c3 tempest-ProjectReaderTests-1990163970 None] Lock "cinder-e3a0035d-9013-436a-b2bc-08040855331c-delete_volume" released by "delete_volume" :: held 3.110s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:27:13 devstack sudo[106793]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:13 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-065020d2-14c0-41ec-abbf-d2fe2476139a tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94a490e8-5b51-4cc1-9466-0f0f03af2a1e -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94a490e8-5b51-4cc1-9466-0f0f03af2a1e.18d248b3-98e4-47c4-b3dd-2ac000b05225" returned: 0 in 0.865s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:13 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-065020d2-14c0-41ec-abbf-d2fe2476139a tempest-ProjectMemberTests-915988921 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94a490e8-5b51-4cc1-9466-0f0f03af2a1e.18d248b3-98e4-47c4-b3dd-2ac000b05225 is being set with open permissions: ugo+rw Jul 10 10:27:13 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-065020d2-14c0-41ec-abbf-d2fe2476139a tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94a490e8-5b51-4cc1-9466-0f0f03af2a1e.18d248b3-98e4-47c4-b3dd-2ac000b05225 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:14 devstack sudo[106800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94a490e8-5b51-4cc1-9466-0f0f03af2a1e.18d248b3-98e4-47c4-b3dd-2ac000b05225 Jul 10 10:27:14 devstack sudo[106800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:14 devstack sudo[106800]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:14 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-065020d2-14c0-41ec-abbf-d2fe2476139a tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94a490e8-5b51-4cc1-9466-0f0f03af2a1e.18d248b3-98e4-47c4-b3dd-2ac000b05225" returned: 0 in 0.666s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:14 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-065020d2-14c0-41ec-abbf-d2fe2476139a tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94a490e8-5b51-4cc1-9466-0f0f03af2a1e.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:14 devstack sudo[106803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94a490e8-5b51-4cc1-9466-0f0f03af2a1e.info Jul 10 10:27:14 devstack sudo[106803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:15 devstack sudo[106803]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:15 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-065020d2-14c0-41ec-abbf-d2fe2476139a tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94a490e8-5b51-4cc1-9466-0f0f03af2a1e.info" returned: 0 in 0.710s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:15 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-065020d2-14c0-41ec-abbf-d2fe2476139a tempest-ProjectMemberTests-915988921 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94a490e8-5b51-4cc1-9466-0f0f03af2a1e.info is being set with open permissions: ugo+rw Jul 10 10:27:15 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-065020d2-14c0-41ec-abbf-d2fe2476139a tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94a490e8-5b51-4cc1-9466-0f0f03af2a1e.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:15 devstack sudo[106806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94a490e8-5b51-4cc1-9466-0f0f03af2a1e.info Jul 10 10:27:15 devstack sudo[106806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:16 devstack sudo[106806]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-065020d2-14c0-41ec-abbf-d2fe2476139a tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94a490e8-5b51-4cc1-9466-0f0f03af2a1e.info" returned: 0 in 0.703s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-065020d2-14c0-41ec-abbf-d2fe2476139a tempest-ProjectMemberTests-915988921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.913s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:27:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-b66c56e9-3ca4-4478-9105-183191dde3c0 tempest-ProjectReaderTests-1990163970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.382s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:27:16 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-b66c56e9-3ca4-4478-9105-183191dde3c0 tempest-ProjectReaderTests-1990163970 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:27:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-290102251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=983acae2-9a54-417c-a9d8-4ffb038f3c91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9005996ee3c4fd79ff943ddef70d6a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:27:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:27:14Z,use_quota=True,user_id='af3da7e2db214368a3fb84a8cc08b50d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:27:16 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-b66c56e9-3ca4-4478-9105-183191dde3c0 tempest-ProjectReaderTests-1990163970 None] Creating volume 983acae2-9a54-417c-a9d8-4ffb038f3c91 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:27:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-b66c56e9-3ca4-4478-9105-183191dde3c0 tempest-ProjectReaderTests-1990163970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:27:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-b66c56e9-3ca4-4478-9105-183191dde3c0 tempest-ProjectReaderTests-1990163970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:27:16 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-b66c56e9-3ca4-4478-9105-183191dde3c0 tempest-ProjectReaderTests-1990163970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:27:16 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-b66c56e9-3ca4-4478-9105-183191dde3c0 tempest-ProjectReaderTests-1990163970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:27:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-b66c56e9-3ca4-4478-9105-183191dde3c0 tempest-ProjectReaderTests-1990163970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:27:16 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-b66c56e9-3ca4-4478-9105-183191dde3c0 tempest-ProjectReaderTests-1990163970 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:27:16 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-b66c56e9-3ca4-4478-9105-183191dde3c0 tempest-ProjectReaderTests-1990163970 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:27:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-b66c56e9-3ca4-4478-9105-183191dde3c0 tempest-ProjectReaderTests-1990163970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-983acae2-9a54-417c-a9d8-4ffb038f3c91 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:16 devstack sudo[106809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-983acae2-9a54-417c-a9d8-4ffb038f3c91 1073741824 Jul 10 10:27:16 devstack sudo[106809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:16 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-065020d2-14c0-41ec-abbf-d2fe2476139a tempest-ProjectMemberTests-915988921 None] Create snapshot completed successfully Jul 10 10:27:16 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-5427d759-be06-4f9c-a242-ef734b7d6561 tempest-ProjectMemberTests-915988921 None] Acquiring lock "cinder-18d248b3-98e4-47c4-b3dd-2ac000b05225-delete_snapshot" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:27:16 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-5427d759-be06-4f9c-a242-ef734b7d6561 tempest-ProjectMemberTests-915988921 None] Lock "cinder-18d248b3-98e4-47c4-b3dd-2ac000b05225-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:27:16 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-5427d759-be06-4f9c-a242-ef734b7d6561 tempest-ProjectMemberTests-915988921 None] Acquiring lock "cinder-quobyte-94a490e8-5b51-4cc1-9466-0f0f03af2a1e" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:27:16 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-5427d759-be06-4f9c-a242-ef734b7d6561 tempest-ProjectMemberTests-915988921 None] Lock "cinder-quobyte-94a490e8-5b51-4cc1-9466-0f0f03af2a1e" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:27:16 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-5427d759-be06-4f9c-a242-ef734b7d6561 tempest-ProjectMemberTests-915988921 None] Acquiring lock "cinder-quobyte-18d248b3-98e4-47c4-b3dd-2ac000b05225" by "_delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:27:16 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-5427d759-be06-4f9c-a242-ef734b7d6561 tempest-ProjectMemberTests-915988921 None] Lock "cinder-quobyte-18d248b3-98e4-47c4-b3dd-2ac000b05225" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:27:16 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-5427d759-be06-4f9c-a242-ef734b7d6561 tempest-ProjectMemberTests-915988921 None] Deleting offline snapshot 18d248b3-98e4-47c4-b3dd-2ac000b05225 of volume 94a490e8-5b51-4cc1-9466-0f0f03af2a1e {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 10:27:16 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-5427d759-be06-4f9c-a242-ef734b7d6561 tempest-ProjectMemberTests-915988921 None] snapshot_file for this snap is: volume-94a490e8-5b51-4cc1-9466-0f0f03af2a1e.18d248b3-98e4-47c4-b3dd-2ac000b05225 {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 10:27:16 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5763824-8bdc-440c-a6aa-d2a414d143e8]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:27:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5427d759-be06-4f9c-a242-ef734b7d6561 tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94a490e8-5b51-4cc1-9466-0f0f03af2a1e.18d248b3-98e4-47c4-b3dd-2ac000b05225 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:16 devstack sudo[106811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94a490e8-5b51-4cc1-9466-0f0f03af2a1e.18d248b3-98e4-47c4-b3dd-2ac000b05225 Jul 10 10:27:16 devstack sudo[106811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:17 devstack sudo[106809]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-b66c56e9-3ca4-4478-9105-183191dde3c0 tempest-ProjectReaderTests-1990163970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-983acae2-9a54-417c-a9d8-4ffb038f3c91 1073741824" returned: 0 in 0.888s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-b66c56e9-3ca4-4478-9105-183191dde3c0 tempest-ProjectReaderTests-1990163970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-983acae2-9a54-417c-a9d8-4ffb038f3c91 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:17 devstack sudo[106816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-983acae2-9a54-417c-a9d8-4ffb038f3c91 Jul 10 10:27:17 devstack sudo[106816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:17 devstack sudo[106811]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5427d759-be06-4f9c-a242-ef734b7d6561 tempest-ProjectMemberTests-915988921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94a490e8-5b51-4cc1-9466-0f0f03af2a1e.18d248b3-98e4-47c4-b3dd-2ac000b05225" returned: 0 in 0.926s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:17 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-5427d759-be06-4f9c-a242-ef734b7d6561 tempest-ProjectMemberTests-915988921 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94a490e8-5b51-4cc1-9466-0f0f03af2a1e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 10:27:17 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb87cb1-6376-43e2-9129-aa03873c09c3]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:27:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5427d759-be06-4f9c-a242-ef734b7d6561 tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94a490e8-5b51-4cc1-9466-0f0f03af2a1e {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:17 devstack sudo[106822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94a490e8-5b51-4cc1-9466-0f0f03af2a1e Jul 10 10:27:17 devstack sudo[106822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:17 devstack sudo[106816]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-b66c56e9-3ca4-4478-9105-183191dde3c0 tempest-ProjectReaderTests-1990163970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-983acae2-9a54-417c-a9d8-4ffb038f3c91" returned: 0 in 0.819s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:17 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-b66c56e9-3ca4-4478-9105-183191dde3c0 tempest-ProjectReaderTests-1990163970 None] <== create_volume: return (1788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:27:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-b66c56e9-3ca4-4478-9105-183191dde3c0 tempest-ProjectReaderTests-1990163970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.791s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:27:17 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-b66c56e9-3ca4-4478-9105-183191dde3c0 tempest-ProjectReaderTests-1990163970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (204ff3c6-78e8-4cf6-bcb8-e36245f19804) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-983acae2-9a54-417c-a9d8-4ffb038f3c91', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:27:17 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-b66c56e9-3ca4-4478-9105-183191dde3c0 tempest-ProjectReaderTests-1990163970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bc8fb5e-ede3-4cd3-b0ad-f218399fe42d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:27:17 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-b66c56e9-3ca4-4478-9105-183191dde3c0 tempest-ProjectReaderTests-1990163970 None] Volume volume-983acae2-9a54-417c-a9d8-4ffb038f3c91 (983acae2-9a54-417c-a9d8-4ffb038f3c91): created successfully Jul 10 10:27:17 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-b66c56e9-3ca4-4478-9105-183191dde3c0 tempest-ProjectReaderTests-1990163970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bc8fb5e-ede3-4cd3-b0ad-f218399fe42d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:27:17 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-b66c56e9-3ca4-4478-9105-183191dde3c0 tempest-ProjectReaderTests-1990163970 None] Flow 'volume_create_manager' (e32ad9c6-eb25-4e1e-a89a-9f4c9bed850d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:27:17 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-b66c56e9-3ca4-4478-9105-183191dde3c0 tempest-ProjectReaderTests-1990163970 None] Created volume successfully. Jul 10 10:27:18 devstack sudo[106822]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:18 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5427d759-be06-4f9c-a242-ef734b7d6561 tempest-ProjectMemberTests-915988921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94a490e8-5b51-4cc1-9466-0f0f03af2a1e" returned: 0 in 0.957s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:18 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5427d759-be06-4f9c-a242-ef734b7d6561 tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94a490e8-5b51-4cc1-9466-0f0f03af2a1e.18d248b3-98e4-47c4-b3dd-2ac000b05225 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:18 devstack sudo[106829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94a490e8-5b51-4cc1-9466-0f0f03af2a1e.18d248b3-98e4-47c4-b3dd-2ac000b05225 Jul 10 10:27:18 devstack sudo[106829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:19 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-fcd4069d-a6ef-4189-a831-b088d8a86f0b tempest-ProjectReaderTests-1990163970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:27:19 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-fcd4069d-a6ef-4189-a831-b088d8a86f0b tempest-ProjectReaderTests-1990163970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:27:19 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-fcd4069d-a6ef-4189-a831-b088d8a86f0b tempest-ProjectReaderTests-1990163970 None] Creating offline snapshot b4379f9b-8ee6-45a4-b34b-53a42e454b61 of volume 983acae2-9a54-417c-a9d8-4ffb038f3c91 {{(pid=87234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 10:27:19 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[c26ab4ab-89e3-46cd-841b-3f8083d96e3e]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:27:19 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fcd4069d-a6ef-4189-a831-b088d8a86f0b tempest-ProjectReaderTests-1990163970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-983acae2-9a54-417c-a9d8-4ffb038f3c91 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:19 devstack sudo[106835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-983acae2-9a54-417c-a9d8-4ffb038f3c91 Jul 10 10:27:19 devstack sudo[106835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:19 devstack sudo[106829]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:19 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5427d759-be06-4f9c-a242-ef734b7d6561 tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94a490e8-5b51-4cc1-9466-0f0f03af2a1e.18d248b3-98e4-47c4-b3dd-2ac000b05225" returned: 0 in 1.000s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:19 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5427d759-be06-4f9c-a242-ef734b7d6561 tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94a490e8-5b51-4cc1-9466-0f0f03af2a1e.18d248b3-98e4-47c4-b3dd-2ac000b05225 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:19 devstack sudo[106837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94a490e8-5b51-4cc1-9466-0f0f03af2a1e.18d248b3-98e4-47c4-b3dd-2ac000b05225 Jul 10 10:27:19 devstack sudo[106837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:20 devstack sudo[106835]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:20 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fcd4069d-a6ef-4189-a831-b088d8a86f0b tempest-ProjectReaderTests-1990163970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-983acae2-9a54-417c-a9d8-4ffb038f3c91" returned: 0 in 0.911s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:20 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fcd4069d-a6ef-4189-a831-b088d8a86f0b tempest-ProjectReaderTests-1990163970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-983acae2-9a54-417c-a9d8-4ffb038f3c91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-983acae2-9a54-417c-a9d8-4ffb038f3c91.b4379f9b-8ee6-45a4-b34b-53a42e454b61 1G {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:20 devstack sudo[106844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-983acae2-9a54-417c-a9d8-4ffb038f3c91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-983acae2-9a54-417c-a9d8-4ffb038f3c91.b4379f9b-8ee6-45a4-b34b-53a42e454b61 1G Jul 10 10:27:20 devstack sudo[106844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:20 devstack sudo[106837]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:20 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5427d759-be06-4f9c-a242-ef734b7d6561 tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94a490e8-5b51-4cc1-9466-0f0f03af2a1e.18d248b3-98e4-47c4-b3dd-2ac000b05225" returned: 0 in 0.809s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:20 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-5427d759-be06-4f9c-a242-ef734b7d6561 tempest-ProjectMemberTests-915988921 None] Lock "cinder-quobyte-18d248b3-98e4-47c4-b3dd-2ac000b05225" released by "_delete_snapshot" :: held 3.814s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:27:20 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-5427d759-be06-4f9c-a242-ef734b7d6561 tempest-ProjectMemberTests-915988921 None] Lock "cinder-quobyte-94a490e8-5b51-4cc1-9466-0f0f03af2a1e" released by "delete_snapshot" :: held 3.842s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:27:20 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-5427d759-be06-4f9c-a242-ef734b7d6561 tempest-ProjectMemberTests-915988921 None] Created reservations ['e96cd86e-d24d-42a8-9f97-b6ae6c3ef297', 'c76e1b67-8c7f-40e5-85a3-39cbbc89c54c', '555f1815-535a-4777-84e2-270d50b84125', '6a933224-df38-4216-8cc9-1289df59bfdc'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:27:20 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-5427d759-be06-4f9c-a242-ef734b7d6561 tempest-ProjectMemberTests-915988921 None] Delete snapshot completed successfully. Jul 10 10:27:20 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-5427d759-be06-4f9c-a242-ef734b7d6561 tempest-ProjectMemberTests-915988921 None] Lock "cinder-18d248b3-98e4-47c4-b3dd-2ac000b05225-delete_snapshot" released by "delete_snapshot" :: held 3.998s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:27:20 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-375662f1-f4f5-4231-9dcb-2773fd8c9008 tempest-ProjectMemberTests-915988921 None] Acquiring lock "cinder-94a490e8-5b51-4cc1-9466-0f0f03af2a1e-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:27:20 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-375662f1-f4f5-4231-9dcb-2773fd8c9008 tempest-ProjectMemberTests-915988921 None] Lock "cinder-94a490e8-5b51-4cc1-9466-0f0f03af2a1e-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:27:20 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-375662f1-f4f5-4231-9dcb-2773fd8c9008 tempest-ProjectMemberTests-915988921 None] Acquiring lock "cinder-quobyte-94a490e8-5b51-4cc1-9466-0f0f03af2a1e" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:27:20 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-375662f1-f4f5-4231-9dcb-2773fd8c9008 tempest-ProjectMemberTests-915988921 None] Lock "cinder-quobyte-94a490e8-5b51-4cc1-9466-0f0f03af2a1e" acquired by "delete_volume" :: waited 0.031s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:27:20 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e17f31-102d-4cbc-8451-81ed3c65f7d1]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:27:20 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-375662f1-f4f5-4231-9dcb-2773fd8c9008 tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94a490e8-5b51-4cc1-9466-0f0f03af2a1e {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:21 devstack sudo[106849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94a490e8-5b51-4cc1-9466-0f0f03af2a1e Jul 10 10:27:21 devstack sudo[106849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:21 devstack sudo[106844]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:21 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fcd4069d-a6ef-4189-a831-b088d8a86f0b tempest-ProjectReaderTests-1990163970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-983acae2-9a54-417c-a9d8-4ffb038f3c91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-983acae2-9a54-417c-a9d8-4ffb038f3c91.b4379f9b-8ee6-45a4-b34b-53a42e454b61 1G" returned: 0 in 1.225s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:21 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fcd4069d-a6ef-4189-a831-b088d8a86f0b tempest-ProjectReaderTests-1990163970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-983acae2-9a54-417c-a9d8-4ffb038f3c91 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-983acae2-9a54-417c-a9d8-4ffb038f3c91.b4379f9b-8ee6-45a4-b34b-53a42e454b61 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:21 devstack sudo[106887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-983acae2-9a54-417c-a9d8-4ffb038f3c91 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-983acae2-9a54-417c-a9d8-4ffb038f3c91.b4379f9b-8ee6-45a4-b34b-53a42e454b61 Jul 10 10:27:21 devstack sudo[106887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:22 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-92e23a2c-f028-400c-8587-65c8de3bc2b3 tempest-SnapshotDependencyTests-1564145450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:27:22 devstack sudo[106849]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-92e23a2c-f028-400c-8587-65c8de3bc2b3 tempest-SnapshotDependencyTests-1564145450 None] Flow 'volume_create_manager' (1a32a9b2-7af4-495f-b20c-eac1186d52c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:27:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-92e23a2c-f028-400c-8587-65c8de3bc2b3 tempest-SnapshotDependencyTests-1564145450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf8a2831-34ad-4dc4-a21b-a77a92e6cfc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:27:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-375662f1-f4f5-4231-9dcb-2773fd8c9008 tempest-ProjectMemberTests-915988921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94a490e8-5b51-4cc1-9466-0f0f03af2a1e" returned: 0 in 1.280s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-375662f1-f4f5-4231-9dcb-2773fd8c9008 tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94a490e8-5b51-4cc1-9466-0f0f03af2a1e {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-92e23a2c-f028-400c-8587-65c8de3bc2b3 tempest-SnapshotDependencyTests-1564145450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf8a2831-34ad-4dc4-a21b-a77a92e6cfc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:27:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-845810795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=264154ad-4da3-4ac0-b509-452b8009e34b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6694d3f15c2a447dad3e45b2e1a62a22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:27:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:27:22Z,use_quota=True,user_id='eb068bd899664eb194616af18d82f612',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:27:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-92e23a2c-f028-400c-8587-65c8de3bc2b3 tempest-SnapshotDependencyTests-1564145450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c026b2b-30b0-4bf5-a9e9-35e5f35560f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:27:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-92e23a2c-f028-400c-8587-65c8de3bc2b3 tempest-SnapshotDependencyTests-1564145450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c026b2b-30b0-4bf5-a9e9-35e5f35560f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:27:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-92e23a2c-f028-400c-8587-65c8de3bc2b3 tempest-SnapshotDependencyTests-1564145450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fdf60a1-c30d-4767-a427-a913f3bfbeec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:27:22 devstack sudo[106894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94a490e8-5b51-4cc1-9466-0f0f03af2a1e Jul 10 10:27:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-92e23a2c-f028-400c-8587-65c8de3bc2b3 tempest-SnapshotDependencyTests-1564145450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fdf60a1-c30d-4767-a427-a913f3bfbeec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '264154ad-4da3-4ac0-b509-452b8009e34b', 'volume_name': 'volume-264154ad-4da3-4ac0-b509-452b8009e34b', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:27:22 devstack sudo[106894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-92e23a2c-f028-400c-8587-65c8de3bc2b3 tempest-SnapshotDependencyTests-1564145450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11e48e39-dc1d-43a4-b41c-89a680d85476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:27:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-92e23a2c-f028-400c-8587-65c8de3bc2b3 tempest-SnapshotDependencyTests-1564145450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11e48e39-dc1d-43a4-b41c-89a680d85476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:27:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-92e23a2c-f028-400c-8587-65c8de3bc2b3 tempest-SnapshotDependencyTests-1564145450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d2b7b04-ce5f-4b8b-8631-bc230f959878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:27:22 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-92e23a2c-f028-400c-8587-65c8de3bc2b3 tempest-SnapshotDependencyTests-1564145450 None] Volume 264154ad-4da3-4ac0-b509-452b8009e34b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-264154ad-4da3-4ac0-b509-452b8009e34b', 'volume_size': 1} Jul 10 10:27:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-92e23a2c-f028-400c-8587-65c8de3bc2b3 tempest-SnapshotDependencyTests-1564145450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:27:22 devstack sudo[106887]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fcd4069d-a6ef-4189-a831-b088d8a86f0b tempest-ProjectReaderTests-1990163970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-983acae2-9a54-417c-a9d8-4ffb038f3c91 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-983acae2-9a54-417c-a9d8-4ffb038f3c91.b4379f9b-8ee6-45a4-b34b-53a42e454b61" returned: 0 in 1.017s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:22 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-fcd4069d-a6ef-4189-a831-b088d8a86f0b tempest-ProjectReaderTests-1990163970 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-983acae2-9a54-417c-a9d8-4ffb038f3c91.b4379f9b-8ee6-45a4-b34b-53a42e454b61 is being set with open permissions: ugo+rw Jul 10 10:27:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fcd4069d-a6ef-4189-a831-b088d8a86f0b tempest-ProjectReaderTests-1990163970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-983acae2-9a54-417c-a9d8-4ffb038f3c91.b4379f9b-8ee6-45a4-b34b-53a42e454b61 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:22 devstack sudo[106900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-983acae2-9a54-417c-a9d8-4ffb038f3c91.b4379f9b-8ee6-45a4-b34b-53a42e454b61 Jul 10 10:27:22 devstack sudo[106900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:22 devstack sudo[106894]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-375662f1-f4f5-4231-9dcb-2773fd8c9008 tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-94a490e8-5b51-4cc1-9466-0f0f03af2a1e" returned: 0 in 0.680s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:22 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-375662f1-f4f5-4231-9dcb-2773fd8c9008 tempest-ProjectMemberTests-915988921 None] Lock "cinder-quobyte-94a490e8-5b51-4cc1-9466-0f0f03af2a1e" released by "delete_volume" :: held 2.044s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:27:23 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-375662f1-f4f5-4231-9dcb-2773fd8c9008 tempest-ProjectMemberTests-915988921 None] Created reservations ['e91b1aae-82c5-46aa-af8c-857bbd77da06', 'a204f5f3-e9fa-4a5b-97ee-f0235a55d2df', '53c72cd9-5a63-4af5-8985-bcbe2f68845c', 'ca7b853f-bb0e-4c31-8673-a1ab3b4b636f'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:27:23 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-375662f1-f4f5-4231-9dcb-2773fd8c9008 tempest-ProjectMemberTests-915988921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:27:23 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-375662f1-f4f5-4231-9dcb-2773fd8c9008 tempest-ProjectMemberTests-915988921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:27:23 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-375662f1-f4f5-4231-9dcb-2773fd8c9008 tempest-ProjectMemberTests-915988921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:27:23 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-375662f1-f4f5-4231-9dcb-2773fd8c9008 tempest-ProjectMemberTests-915988921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:27:23 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-375662f1-f4f5-4231-9dcb-2773fd8c9008 tempest-ProjectMemberTests-915988921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:27:23 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-375662f1-f4f5-4231-9dcb-2773fd8c9008 tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:23 devstack sudo[106900]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:23 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fcd4069d-a6ef-4189-a831-b088d8a86f0b tempest-ProjectReaderTests-1990163970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-983acae2-9a54-417c-a9d8-4ffb038f3c91.b4379f9b-8ee6-45a4-b34b-53a42e454b61" returned: 0 in 0.680s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:23 devstack sudo[106904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:27:23 devstack sudo[106904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:23 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fcd4069d-a6ef-4189-a831-b088d8a86f0b tempest-ProjectReaderTests-1990163970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-983acae2-9a54-417c-a9d8-4ffb038f3c91.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:23 devstack sudo[106906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-983acae2-9a54-417c-a9d8-4ffb038f3c91.info Jul 10 10:27:23 devstack sudo[106906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:23 devstack sudo[106904]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:23 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-375662f1-f4f5-4231-9dcb-2773fd8c9008 tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.658s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:23 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-375662f1-f4f5-4231-9dcb-2773fd8c9008 tempest-ProjectMemberTests-915988921 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:27:23 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-375662f1-f4f5-4231-9dcb-2773fd8c9008 tempest-ProjectMemberTests-915988921 None] Deleted volume successfully. Jul 10 10:27:23 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-375662f1-f4f5-4231-9dcb-2773fd8c9008 tempest-ProjectMemberTests-915988921 None] Lock "cinder-94a490e8-5b51-4cc1-9466-0f0f03af2a1e-delete_volume" released by "delete_volume" :: held 2.993s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:27:23 devstack sudo[106906]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:23 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fcd4069d-a6ef-4189-a831-b088d8a86f0b tempest-ProjectReaderTests-1990163970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-983acae2-9a54-417c-a9d8-4ffb038f3c91.info" returned: 0 in 0.662s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:23 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-fcd4069d-a6ef-4189-a831-b088d8a86f0b tempest-ProjectReaderTests-1990163970 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-983acae2-9a54-417c-a9d8-4ffb038f3c91.info is being set with open permissions: ugo+rw Jul 10 10:27:23 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fcd4069d-a6ef-4189-a831-b088d8a86f0b tempest-ProjectReaderTests-1990163970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-983acae2-9a54-417c-a9d8-4ffb038f3c91.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:23 devstack sudo[106910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-983acae2-9a54-417c-a9d8-4ffb038f3c91.info Jul 10 10:27:23 devstack sudo[106910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:24 devstack sudo[106910]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fcd4069d-a6ef-4189-a831-b088d8a86f0b tempest-ProjectReaderTests-1990163970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-983acae2-9a54-417c-a9d8-4ffb038f3c91.info" returned: 0 in 0.686s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-fcd4069d-a6ef-4189-a831-b088d8a86f0b tempest-ProjectReaderTests-1990163970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.272s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:27:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-92e23a2c-f028-400c-8587-65c8de3bc2b3 tempest-SnapshotDependencyTests-1564145450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.175s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:27:24 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-92e23a2c-f028-400c-8587-65c8de3bc2b3 tempest-SnapshotDependencyTests-1564145450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:27:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-845810795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=264154ad-4da3-4ac0-b509-452b8009e34b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6694d3f15c2a447dad3e45b2e1a62a22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:27:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:27:22Z,use_quota=True,user_id='eb068bd899664eb194616af18d82f612',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:27:24 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-92e23a2c-f028-400c-8587-65c8de3bc2b3 tempest-SnapshotDependencyTests-1564145450 None] Creating volume 264154ad-4da3-4ac0-b509-452b8009e34b {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:27:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-92e23a2c-f028-400c-8587-65c8de3bc2b3 tempest-SnapshotDependencyTests-1564145450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:27:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-92e23a2c-f028-400c-8587-65c8de3bc2b3 tempest-SnapshotDependencyTests-1564145450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:27:24 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-92e23a2c-f028-400c-8587-65c8de3bc2b3 tempest-SnapshotDependencyTests-1564145450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:27:24 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-92e23a2c-f028-400c-8587-65c8de3bc2b3 tempest-SnapshotDependencyTests-1564145450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:27:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-92e23a2c-f028-400c-8587-65c8de3bc2b3 tempest-SnapshotDependencyTests-1564145450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:27:24 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-92e23a2c-f028-400c-8587-65c8de3bc2b3 tempest-SnapshotDependencyTests-1564145450 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:27:24 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-92e23a2c-f028-400c-8587-65c8de3bc2b3 tempest-SnapshotDependencyTests-1564145450 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:27:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-92e23a2c-f028-400c-8587-65c8de3bc2b3 tempest-SnapshotDependencyTests-1564145450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-264154ad-4da3-4ac0-b509-452b8009e34b 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:24 devstack sudo[106913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-264154ad-4da3-4ac0-b509-452b8009e34b 1073741824 Jul 10 10:27:24 devstack sudo[106913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:24 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-fcd4069d-a6ef-4189-a831-b088d8a86f0b tempest-ProjectReaderTests-1990163970 None] Create snapshot completed successfully Jul 10 10:27:24 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-cee4cfa0-7434-4ac9-8a45-cf075dde2910 tempest-ProjectMemberTests-915988921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:27:24 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-cee4cfa0-7434-4ac9-8a45-cf075dde2910 tempest-ProjectMemberTests-915988921 None] Flow 'volume_create_manager' (a7979cb7-1d60-487e-a520-a05ae8bf0618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:27:24 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-cee4cfa0-7434-4ac9-8a45-cf075dde2910 tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e22b9b2-5e20-49c2-bd4d-0e885638d24c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:27:24 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-cee4cfa0-7434-4ac9-8a45-cf075dde2910 tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e22b9b2-5e20-49c2-bd4d-0e885638d24c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:27:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1348860526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=540f5a2b-3bde-4aa6-b674-16a0c0b4df15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac4b039bd3aa49f393fe3462e2fed6d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:27:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:27:25Z,use_quota=True,user_id='cc3f433661ac4946825a66613f6d748c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:27:24 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-cee4cfa0-7434-4ac9-8a45-cf075dde2910 tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (badde0c8-afc1-4685-979b-b11d427f1e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:27:24 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-cee4cfa0-7434-4ac9-8a45-cf075dde2910 tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (badde0c8-afc1-4685-979b-b11d427f1e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:27:24 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-cee4cfa0-7434-4ac9-8a45-cf075dde2910 tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e854bec8-e500-4e34-a894-169bd4851057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:27:24 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-cee4cfa0-7434-4ac9-8a45-cf075dde2910 tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e854bec8-e500-4e34-a894-169bd4851057) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '540f5a2b-3bde-4aa6-b674-16a0c0b4df15', 'volume_name': 'volume-540f5a2b-3bde-4aa6-b674-16a0c0b4df15', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:27:24 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-cee4cfa0-7434-4ac9-8a45-cf075dde2910 tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (646cbf62-7a52-4584-b777-9c02333a2374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:27:24 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-cee4cfa0-7434-4ac9-8a45-cf075dde2910 tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (646cbf62-7a52-4584-b777-9c02333a2374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:27:24 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-cee4cfa0-7434-4ac9-8a45-cf075dde2910 tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a747778-568e-4be9-b722-c9049dac2406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:27:24 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-cee4cfa0-7434-4ac9-8a45-cf075dde2910 tempest-ProjectMemberTests-915988921 None] Volume 540f5a2b-3bde-4aa6-b674-16a0c0b4df15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-540f5a2b-3bde-4aa6-b674-16a0c0b4df15', 'volume_size': 1} Jul 10 10:27:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-cee4cfa0-7434-4ac9-8a45-cf075dde2910 tempest-ProjectMemberTests-915988921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:27:25 devstack sudo[106913]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:25 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-92e23a2c-f028-400c-8587-65c8de3bc2b3 tempest-SnapshotDependencyTests-1564145450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-264154ad-4da3-4ac0-b509-452b8009e34b 1073741824" returned: 0 in 0.829s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:25 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-92e23a2c-f028-400c-8587-65c8de3bc2b3 tempest-SnapshotDependencyTests-1564145450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-264154ad-4da3-4ac0-b509-452b8009e34b {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:25 devstack sudo[106918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-264154ad-4da3-4ac0-b509-452b8009e34b Jul 10 10:27:25 devstack sudo[106918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:25 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-e3ca8e46-ca5b-4842-8396-e2b1a9afc4b7 tempest-ProjectReaderTests-1990163970 None] Acquiring lock "cinder-b4379f9b-8ee6-45a4-b34b-53a42e454b61-delete_snapshot" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:27:25 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-e3ca8e46-ca5b-4842-8396-e2b1a9afc4b7 tempest-ProjectReaderTests-1990163970 None] Lock "cinder-b4379f9b-8ee6-45a4-b34b-53a42e454b61-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:27:25 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-e3ca8e46-ca5b-4842-8396-e2b1a9afc4b7 tempest-ProjectReaderTests-1990163970 None] Acquiring lock "cinder-quobyte-983acae2-9a54-417c-a9d8-4ffb038f3c91" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:27:25 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-e3ca8e46-ca5b-4842-8396-e2b1a9afc4b7 tempest-ProjectReaderTests-1990163970 None] Lock "cinder-quobyte-983acae2-9a54-417c-a9d8-4ffb038f3c91" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:27:25 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-e3ca8e46-ca5b-4842-8396-e2b1a9afc4b7 tempest-ProjectReaderTests-1990163970 None] Acquiring lock "cinder-quobyte-b4379f9b-8ee6-45a4-b34b-53a42e454b61" by "_delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:27:25 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-e3ca8e46-ca5b-4842-8396-e2b1a9afc4b7 tempest-ProjectReaderTests-1990163970 None] Lock "cinder-quobyte-b4379f9b-8ee6-45a4-b34b-53a42e454b61" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:27:25 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-e3ca8e46-ca5b-4842-8396-e2b1a9afc4b7 tempest-ProjectReaderTests-1990163970 None] Deleting offline snapshot b4379f9b-8ee6-45a4-b34b-53a42e454b61 of volume 983acae2-9a54-417c-a9d8-4ffb038f3c91 {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 10:27:25 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-e3ca8e46-ca5b-4842-8396-e2b1a9afc4b7 tempest-ProjectReaderTests-1990163970 None] snapshot_file for this snap is: volume-983acae2-9a54-417c-a9d8-4ffb038f3c91.b4379f9b-8ee6-45a4-b34b-53a42e454b61 {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 10:27:25 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c53160-90dc-46ad-8bd0-ac381b246bf9]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:27:25 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e3ca8e46-ca5b-4842-8396-e2b1a9afc4b7 tempest-ProjectReaderTests-1990163970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-983acae2-9a54-417c-a9d8-4ffb038f3c91.b4379f9b-8ee6-45a4-b34b-53a42e454b61 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:25 devstack sudo[106920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-983acae2-9a54-417c-a9d8-4ffb038f3c91.b4379f9b-8ee6-45a4-b34b-53a42e454b61 Jul 10 10:27:25 devstack sudo[106920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:26 devstack sudo[106918]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-92e23a2c-f028-400c-8587-65c8de3bc2b3 tempest-SnapshotDependencyTests-1564145450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-264154ad-4da3-4ac0-b509-452b8009e34b" returned: 0 in 0.669s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:26 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-92e23a2c-f028-400c-8587-65c8de3bc2b3 tempest-SnapshotDependencyTests-1564145450 None] <== create_volume: return (1534ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:27:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-92e23a2c-f028-400c-8587-65c8de3bc2b3 tempest-SnapshotDependencyTests-1564145450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.538s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:27:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-cee4cfa0-7434-4ac9-8a45-cf075dde2910 tempest-ProjectMemberTests-915988921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.374s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:27:26 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-cee4cfa0-7434-4ac9-8a45-cf075dde2910 tempest-ProjectMemberTests-915988921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:27:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1348860526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=540f5a2b-3bde-4aa6-b674-16a0c0b4df15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac4b039bd3aa49f393fe3462e2fed6d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:27:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:27:25Z,use_quota=True,user_id='cc3f433661ac4946825a66613f6d748c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:27:26 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-cee4cfa0-7434-4ac9-8a45-cf075dde2910 tempest-ProjectMemberTests-915988921 None] Creating volume 540f5a2b-3bde-4aa6-b674-16a0c0b4df15 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:27:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-cee4cfa0-7434-4ac9-8a45-cf075dde2910 tempest-ProjectMemberTests-915988921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:27:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-cee4cfa0-7434-4ac9-8a45-cf075dde2910 tempest-ProjectMemberTests-915988921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:27:26 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-cee4cfa0-7434-4ac9-8a45-cf075dde2910 tempest-ProjectMemberTests-915988921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:27:26 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-cee4cfa0-7434-4ac9-8a45-cf075dde2910 tempest-ProjectMemberTests-915988921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:27:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-cee4cfa0-7434-4ac9-8a45-cf075dde2910 tempest-ProjectMemberTests-915988921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:27:26 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-cee4cfa0-7434-4ac9-8a45-cf075dde2910 tempest-ProjectMemberTests-915988921 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:27:26 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-cee4cfa0-7434-4ac9-8a45-cf075dde2910 tempest-ProjectMemberTests-915988921 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:27:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-cee4cfa0-7434-4ac9-8a45-cf075dde2910 tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-540f5a2b-3bde-4aa6-b674-16a0c0b4df15 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:26 devstack sudo[106923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-540f5a2b-3bde-4aa6-b674-16a0c0b4df15 1073741824 Jul 10 10:27:26 devstack sudo[106923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:26 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-92e23a2c-f028-400c-8587-65c8de3bc2b3 tempest-SnapshotDependencyTests-1564145450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d2b7b04-ce5f-4b8b-8631-bc230f959878) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-264154ad-4da3-4ac0-b509-452b8009e34b', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:27:26 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-92e23a2c-f028-400c-8587-65c8de3bc2b3 tempest-SnapshotDependencyTests-1564145450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fcedb2c-c1d1-4280-8cfc-e96d60602ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:27:26 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-92e23a2c-f028-400c-8587-65c8de3bc2b3 tempest-SnapshotDependencyTests-1564145450 None] Volume volume-264154ad-4da3-4ac0-b509-452b8009e34b (264154ad-4da3-4ac0-b509-452b8009e34b): created successfully Jul 10 10:27:26 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-92e23a2c-f028-400c-8587-65c8de3bc2b3 tempest-SnapshotDependencyTests-1564145450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fcedb2c-c1d1-4280-8cfc-e96d60602ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:27:26 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-92e23a2c-f028-400c-8587-65c8de3bc2b3 tempest-SnapshotDependencyTests-1564145450 None] Flow 'volume_create_manager' (1a32a9b2-7af4-495f-b20c-eac1186d52c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:27:26 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-92e23a2c-f028-400c-8587-65c8de3bc2b3 tempest-SnapshotDependencyTests-1564145450 None] Created volume successfully. Jul 10 10:27:26 devstack sudo[106920]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e3ca8e46-ca5b-4842-8396-e2b1a9afc4b7 tempest-ProjectReaderTests-1990163970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-983acae2-9a54-417c-a9d8-4ffb038f3c91.b4379f9b-8ee6-45a4-b34b-53a42e454b61" returned: 0 in 0.845s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:26 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-e3ca8e46-ca5b-4842-8396-e2b1a9afc4b7 tempest-ProjectReaderTests-1990163970 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-983acae2-9a54-417c-a9d8-4ffb038f3c91(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 10:27:26 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb16272d-13bb-442d-b612-d416b355552e]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:27:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e3ca8e46-ca5b-4842-8396-e2b1a9afc4b7 tempest-ProjectReaderTests-1990163970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-983acae2-9a54-417c-a9d8-4ffb038f3c91 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:26 devstack sudo[106928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-983acae2-9a54-417c-a9d8-4ffb038f3c91 Jul 10 10:27:26 devstack sudo[106928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-fe6b774e-001f-4554-95e0-8b81de61f716 tempest-SnapshotDependencyTests-1564145450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:27:26 devstack sudo[106923]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-cee4cfa0-7434-4ac9-8a45-cf075dde2910 tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-540f5a2b-3bde-4aa6-b674-16a0c0b4df15 1073741824" returned: 0 in 0.905s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-cee4cfa0-7434-4ac9-8a45-cf075dde2910 tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-540f5a2b-3bde-4aa6-b674-16a0c0b4df15 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:27 devstack sudo[106933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-540f5a2b-3bde-4aa6-b674-16a0c0b4df15 Jul 10 10:27:27 devstack sudo[106933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:27 devstack sudo[106928]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e3ca8e46-ca5b-4842-8396-e2b1a9afc4b7 tempest-ProjectReaderTests-1990163970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-983acae2-9a54-417c-a9d8-4ffb038f3c91" returned: 0 in 0.813s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e3ca8e46-ca5b-4842-8396-e2b1a9afc4b7 tempest-ProjectReaderTests-1990163970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-983acae2-9a54-417c-a9d8-4ffb038f3c91.b4379f9b-8ee6-45a4-b34b-53a42e454b61 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:27 devstack sudo[106938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-983acae2-9a54-417c-a9d8-4ffb038f3c91.b4379f9b-8ee6-45a4-b34b-53a42e454b61 Jul 10 10:27:27 devstack sudo[106938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:27 devstack sudo[106933]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-cee4cfa0-7434-4ac9-8a45-cf075dde2910 tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-540f5a2b-3bde-4aa6-b674-16a0c0b4df15" returned: 0 in 0.667s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:27 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-cee4cfa0-7434-4ac9-8a45-cf075dde2910 tempest-ProjectMemberTests-915988921 None] <== create_volume: return (1615ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:27:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-cee4cfa0-7434-4ac9-8a45-cf075dde2910 tempest-ProjectMemberTests-915988921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.618s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:27:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-fe6b774e-001f-4554-95e0-8b81de61f716 tempest-SnapshotDependencyTests-1564145450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.939s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:27:27 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-cee4cfa0-7434-4ac9-8a45-cf075dde2910 tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a747778-568e-4be9-b722-c9049dac2406) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-540f5a2b-3bde-4aa6-b674-16a0c0b4df15', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:27:27 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-cee4cfa0-7434-4ac9-8a45-cf075dde2910 tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c23eb597-b137-4e96-9389-5cfe6487457d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:27:27 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-fe6b774e-001f-4554-95e0-8b81de61f716 tempest-SnapshotDependencyTests-1564145450 None] Creating offline snapshot f4e5b08c-8000-482a-bf42-49226a4446b2 of volume 264154ad-4da3-4ac0-b509-452b8009e34b {{(pid=87234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 10:27:27 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-cee4cfa0-7434-4ac9-8a45-cf075dde2910 tempest-ProjectMemberTests-915988921 None] Volume volume-540f5a2b-3bde-4aa6-b674-16a0c0b4df15 (540f5a2b-3bde-4aa6-b674-16a0c0b4df15): created successfully Jul 10 10:27:27 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-cee4cfa0-7434-4ac9-8a45-cf075dde2910 tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c23eb597-b137-4e96-9389-5cfe6487457d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:27:27 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-cee4cfa0-7434-4ac9-8a45-cf075dde2910 tempest-ProjectMemberTests-915988921 None] Flow 'volume_create_manager' (a7979cb7-1d60-487e-a520-a05ae8bf0618) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:27:27 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f3d1b7-8e14-448a-89ee-2d0de61d84e2]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:27:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fe6b774e-001f-4554-95e0-8b81de61f716 tempest-SnapshotDependencyTests-1564145450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-264154ad-4da3-4ac0-b509-452b8009e34b {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:27 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-cee4cfa0-7434-4ac9-8a45-cf075dde2910 tempest-ProjectMemberTests-915988921 None] Created volume successfully. Jul 10 10:27:27 devstack sudo[106942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-264154ad-4da3-4ac0-b509-452b8009e34b Jul 10 10:27:27 devstack sudo[106942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:28 devstack sudo[106938]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e3ca8e46-ca5b-4842-8396-e2b1a9afc4b7 tempest-ProjectReaderTests-1990163970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-983acae2-9a54-417c-a9d8-4ffb038f3c91.b4379f9b-8ee6-45a4-b34b-53a42e454b61" returned: 0 in 0.763s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e3ca8e46-ca5b-4842-8396-e2b1a9afc4b7 tempest-ProjectReaderTests-1990163970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-983acae2-9a54-417c-a9d8-4ffb038f3c91.b4379f9b-8ee6-45a4-b34b-53a42e454b61 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:28 devstack sudo[106948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-983acae2-9a54-417c-a9d8-4ffb038f3c91.b4379f9b-8ee6-45a4-b34b-53a42e454b61 Jul 10 10:27:28 devstack sudo[106948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:28 devstack sudo[106942]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fe6b774e-001f-4554-95e0-8b81de61f716 tempest-SnapshotDependencyTests-1564145450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-264154ad-4da3-4ac0-b509-452b8009e34b" returned: 0 in 0.794s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fe6b774e-001f-4554-95e0-8b81de61f716 tempest-SnapshotDependencyTests-1564145450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-264154ad-4da3-4ac0-b509-452b8009e34b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-264154ad-4da3-4ac0-b509-452b8009e34b.f4e5b08c-8000-482a-bf42-49226a4446b2 1G {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:28 devstack sudo[106953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-264154ad-4da3-4ac0-b509-452b8009e34b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-264154ad-4da3-4ac0-b509-452b8009e34b.f4e5b08c-8000-482a-bf42-49226a4446b2 1G Jul 10 10:27:28 devstack sudo[106953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:28 devstack sudo[106948]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e3ca8e46-ca5b-4842-8396-e2b1a9afc4b7 tempest-ProjectReaderTests-1990163970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-983acae2-9a54-417c-a9d8-4ffb038f3c91.b4379f9b-8ee6-45a4-b34b-53a42e454b61" returned: 0 in 0.643s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:28 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-e3ca8e46-ca5b-4842-8396-e2b1a9afc4b7 tempest-ProjectReaderTests-1990163970 None] Lock "cinder-quobyte-b4379f9b-8ee6-45a4-b34b-53a42e454b61" released by "_delete_snapshot" :: held 3.193s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:27:28 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-e3ca8e46-ca5b-4842-8396-e2b1a9afc4b7 tempest-ProjectReaderTests-1990163970 None] Lock "cinder-quobyte-983acae2-9a54-417c-a9d8-4ffb038f3c91" released by "delete_snapshot" :: held 3.216s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:27:28 devstack cinder-volume[87234]: DEBUG dbcounter [-] [87234] Writing DB stats cinder:UPDATE=143,cinder:SELECT=124,cinder:INSERT=33,cinder:DELETE=13 {{(pid=87234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 10:27:28 devstack cinder-volume[87234]: DEBUG dbcounter [-] [87234] Writing DB stats cinder:UPDATE=156,cinder:DELETE=12,cinder:SELECT=114,cinder:INSERT=54 {{(pid=87234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 10:27:28 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-e3ca8e46-ca5b-4842-8396-e2b1a9afc4b7 tempest-ProjectReaderTests-1990163970 None] Created reservations ['481e00d4-1ed1-4707-bac9-bd11bbeb3e2a', '7e678948-96ea-4369-b16d-be13f3ed7160', '48fea949-e1fd-4255-96c2-35681a9c256f', '7cefc739-5874-42f2-9039-5145752345f8'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:27:28 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-e3ca8e46-ca5b-4842-8396-e2b1a9afc4b7 tempest-ProjectReaderTests-1990163970 None] Delete snapshot completed successfully. Jul 10 10:27:28 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-e3ca8e46-ca5b-4842-8396-e2b1a9afc4b7 tempest-ProjectReaderTests-1990163970 None] Lock "cinder-b4379f9b-8ee6-45a4-b34b-53a42e454b61-delete_snapshot" released by "delete_snapshot" :: held 3.376s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:27:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-9232c157-6d50-477e-bd74-49ea479ae86b tempest-ProjectMemberTests-915988921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:27:29 devstack sudo[106953]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:29 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fe6b774e-001f-4554-95e0-8b81de61f716 tempest-SnapshotDependencyTests-1564145450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-264154ad-4da3-4ac0-b509-452b8009e34b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-264154ad-4da3-4ac0-b509-452b8009e34b.f4e5b08c-8000-482a-bf42-49226a4446b2 1G" returned: 0 in 0.886s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:29 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fe6b774e-001f-4554-95e0-8b81de61f716 tempest-SnapshotDependencyTests-1564145450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-264154ad-4da3-4ac0-b509-452b8009e34b -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-264154ad-4da3-4ac0-b509-452b8009e34b.f4e5b08c-8000-482a-bf42-49226a4446b2 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:29 devstack sudo[106960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-264154ad-4da3-4ac0-b509-452b8009e34b -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-264154ad-4da3-4ac0-b509-452b8009e34b.f4e5b08c-8000-482a-bf42-49226a4446b2 Jul 10 10:27:29 devstack sudo[106960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:29 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-184836a7-985f-40da-a31f-3d3805522fb5 tempest-ProjectReaderTests-1990163970 None] Acquiring lock "cinder-983acae2-9a54-417c-a9d8-4ffb038f3c91-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:27:29 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-184836a7-985f-40da-a31f-3d3805522fb5 tempest-ProjectReaderTests-1990163970 None] Lock "cinder-983acae2-9a54-417c-a9d8-4ffb038f3c91-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:27:29 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-184836a7-985f-40da-a31f-3d3805522fb5 tempest-ProjectReaderTests-1990163970 None] Acquiring lock "cinder-quobyte-983acae2-9a54-417c-a9d8-4ffb038f3c91" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:27:29 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-184836a7-985f-40da-a31f-3d3805522fb5 tempest-ProjectReaderTests-1990163970 None] Lock "cinder-quobyte-983acae2-9a54-417c-a9d8-4ffb038f3c91" acquired by "delete_volume" :: waited 0.016s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:27:29 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[213eeab8-351a-424f-a0e4-9680293fbf3f]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:27:29 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-184836a7-985f-40da-a31f-3d3805522fb5 tempest-ProjectReaderTests-1990163970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-983acae2-9a54-417c-a9d8-4ffb038f3c91 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:30 devstack sudo[106962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-983acae2-9a54-417c-a9d8-4ffb038f3c91 Jul 10 10:27:30 devstack sudo[106962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:30 devstack sudo[106960]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fe6b774e-001f-4554-95e0-8b81de61f716 tempest-SnapshotDependencyTests-1564145450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-264154ad-4da3-4ac0-b509-452b8009e34b -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-264154ad-4da3-4ac0-b509-452b8009e34b.f4e5b08c-8000-482a-bf42-49226a4446b2" returned: 0 in 0.708s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:30 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-fe6b774e-001f-4554-95e0-8b81de61f716 tempest-SnapshotDependencyTests-1564145450 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-264154ad-4da3-4ac0-b509-452b8009e34b.f4e5b08c-8000-482a-bf42-49226a4446b2 is being set with open permissions: ugo+rw Jul 10 10:27:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fe6b774e-001f-4554-95e0-8b81de61f716 tempest-SnapshotDependencyTests-1564145450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-264154ad-4da3-4ac0-b509-452b8009e34b.f4e5b08c-8000-482a-bf42-49226a4446b2 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:30 devstack sudo[106967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-264154ad-4da3-4ac0-b509-452b8009e34b.f4e5b08c-8000-482a-bf42-49226a4446b2 Jul 10 10:27:30 devstack sudo[106967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:30 devstack sudo[106962]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-184836a7-985f-40da-a31f-3d3805522fb5 tempest-ProjectReaderTests-1990163970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-983acae2-9a54-417c-a9d8-4ffb038f3c91" returned: 0 in 0.784s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-184836a7-985f-40da-a31f-3d3805522fb5 tempest-ProjectReaderTests-1990163970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-983acae2-9a54-417c-a9d8-4ffb038f3c91 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:30 devstack sudo[106973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-983acae2-9a54-417c-a9d8-4ffb038f3c91 Jul 10 10:27:30 devstack sudo[106973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:30 devstack sudo[106967]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fe6b774e-001f-4554-95e0-8b81de61f716 tempest-SnapshotDependencyTests-1564145450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-264154ad-4da3-4ac0-b509-452b8009e34b.f4e5b08c-8000-482a-bf42-49226a4446b2" returned: 0 in 0.637s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fe6b774e-001f-4554-95e0-8b81de61f716 tempest-SnapshotDependencyTests-1564145450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-264154ad-4da3-4ac0-b509-452b8009e34b.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:30 devstack sudo[106981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-264154ad-4da3-4ac0-b509-452b8009e34b.info Jul 10 10:27:30 devstack sudo[106981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:31 devstack sudo[106973]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-184836a7-985f-40da-a31f-3d3805522fb5 tempest-ProjectReaderTests-1990163970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-983acae2-9a54-417c-a9d8-4ffb038f3c91" returned: 0 in 0.657s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:31 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-184836a7-985f-40da-a31f-3d3805522fb5 tempest-ProjectReaderTests-1990163970 None] Lock "cinder-quobyte-983acae2-9a54-417c-a9d8-4ffb038f3c91" released by "delete_volume" :: held 1.503s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:27:31 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-184836a7-985f-40da-a31f-3d3805522fb5 tempest-ProjectReaderTests-1990163970 None] Created reservations ['456c536d-9737-45fc-b193-fd970ff62777', 'e32de8af-f402-4b96-87b5-10583d4f1e2f', '512aee99-ade6-4da5-93b5-6af2f78558a7', '80894396-39da-44a0-8720-6419e2aadb6a'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:27:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-184836a7-985f-40da-a31f-3d3805522fb5 tempest-ProjectReaderTests-1990163970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:27:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-184836a7-985f-40da-a31f-3d3805522fb5 tempest-ProjectReaderTests-1990163970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:27:31 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-184836a7-985f-40da-a31f-3d3805522fb5 tempest-ProjectReaderTests-1990163970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:27:31 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-184836a7-985f-40da-a31f-3d3805522fb5 tempest-ProjectReaderTests-1990163970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:27:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-184836a7-985f-40da-a31f-3d3805522fb5 tempest-ProjectReaderTests-1990163970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:27:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-184836a7-985f-40da-a31f-3d3805522fb5 tempest-ProjectReaderTests-1990163970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:31 devstack sudo[106981]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fe6b774e-001f-4554-95e0-8b81de61f716 tempest-SnapshotDependencyTests-1564145450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-264154ad-4da3-4ac0-b509-452b8009e34b.info" returned: 0 in 0.678s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:31 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-fe6b774e-001f-4554-95e0-8b81de61f716 tempest-SnapshotDependencyTests-1564145450 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-264154ad-4da3-4ac0-b509-452b8009e34b.info is being set with open permissions: ugo+rw Jul 10 10:27:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fe6b774e-001f-4554-95e0-8b81de61f716 tempest-SnapshotDependencyTests-1564145450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-264154ad-4da3-4ac0-b509-452b8009e34b.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:31 devstack sudo[106985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:27:31 devstack sudo[106985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:31 devstack sudo[106986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-264154ad-4da3-4ac0-b509-452b8009e34b.info Jul 10 10:27:31 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:32 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:32 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fe6b774e-001f-4554-95e0-8b81de61f716 tempest-SnapshotDependencyTests-1564145450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-264154ad-4da3-4ac0-b509-452b8009e34b.info" returned: 0 in 0.656s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:32 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-fe6b774e-001f-4554-95e0-8b81de61f716 tempest-SnapshotDependencyTests-1564145450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.571s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:27:32 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-9232c157-6d50-477e-bd74-49ea479ae86b tempest-ProjectMemberTests-915988921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.239s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:27:32 devstack sudo[106985]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:32 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-184836a7-985f-40da-a31f-3d3805522fb5 tempest-ProjectReaderTests-1990163970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.729s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:32 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-184836a7-985f-40da-a31f-3d3805522fb5 tempest-ProjectReaderTests-1990163970 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:27:32 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-9232c157-6d50-477e-bd74-49ea479ae86b tempest-ProjectMemberTests-915988921 None] Creating offline snapshot be6e60e5-6bd6-4051-b92a-aaf297470bed of volume 540f5a2b-3bde-4aa6-b674-16a0c0b4df15 {{(pid=87234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 10:27:32 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-184836a7-985f-40da-a31f-3d3805522fb5 tempest-ProjectReaderTests-1990163970 None] Deleted volume successfully. Jul 10 10:27:32 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e6a3c1-2ffb-45e7-89a3-27bf7352b768]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:27:32 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9232c157-6d50-477e-bd74-49ea479ae86b tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-540f5a2b-3bde-4aa6-b674-16a0c0b4df15 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:32 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-fe6b774e-001f-4554-95e0-8b81de61f716 tempest-SnapshotDependencyTests-1564145450 None] Create snapshot completed successfully Jul 10 10:27:32 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-184836a7-985f-40da-a31f-3d3805522fb5 tempest-ProjectReaderTests-1990163970 None] Lock "cinder-983acae2-9a54-417c-a9d8-4ffb038f3c91-delete_volume" released by "delete_volume" :: held 2.480s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:27:32 devstack sudo[106991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-540f5a2b-3bde-4aa6-b674-16a0c0b4df15 Jul 10 10:27:32 devstack sudo[106991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:32 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b97a15f-c10f-4782-887e-f84078e4b1e4 tempest-ProjectReaderTests-1990163970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:27:32 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8b97a15f-c10f-4782-887e-f84078e4b1e4 tempest-ProjectReaderTests-1990163970 None] Flow 'volume_create_manager' (190f9f7a-f037-442a-81cb-6b0b57af983c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:27:32 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8b97a15f-c10f-4782-887e-f84078e4b1e4 tempest-ProjectReaderTests-1990163970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25532a48-b69c-4956-b39c-400a9705d409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:27:32 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8b97a15f-c10f-4782-887e-f84078e4b1e4 tempest-ProjectReaderTests-1990163970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25532a48-b69c-4956-b39c-400a9705d409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:27:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2082471108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f34ec296-4e47-494e-a9d8-d762b8fd6e60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9005996ee3c4fd79ff943ddef70d6a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:27:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:27:32Z,use_quota=True,user_id='af3da7e2db214368a3fb84a8cc08b50d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:27:32 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8b97a15f-c10f-4782-887e-f84078e4b1e4 tempest-ProjectReaderTests-1990163970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ae9a300-fb11-4c50-a9a5-8eb8f40923ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:27:32 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8b97a15f-c10f-4782-887e-f84078e4b1e4 tempest-ProjectReaderTests-1990163970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ae9a300-fb11-4c50-a9a5-8eb8f40923ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:27:32 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8b97a15f-c10f-4782-887e-f84078e4b1e4 tempest-ProjectReaderTests-1990163970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61a7c03b-f078-4660-abe4-231c57734369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:27:32 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8b97a15f-c10f-4782-887e-f84078e4b1e4 tempest-ProjectReaderTests-1990163970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61a7c03b-f078-4660-abe4-231c57734369) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f34ec296-4e47-494e-a9d8-d762b8fd6e60', 'volume_name': 'volume-f34ec296-4e47-494e-a9d8-d762b8fd6e60', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:27:32 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8b97a15f-c10f-4782-887e-f84078e4b1e4 tempest-ProjectReaderTests-1990163970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1f847ee-35e4-4985-84c0-68b235f950a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:27:32 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8b97a15f-c10f-4782-887e-f84078e4b1e4 tempest-ProjectReaderTests-1990163970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1f847ee-35e4-4985-84c0-68b235f950a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:27:32 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8b97a15f-c10f-4782-887e-f84078e4b1e4 tempest-ProjectReaderTests-1990163970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9ca1917-3fb2-40cc-bf83-6a636270a317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:27:32 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-8b97a15f-c10f-4782-887e-f84078e4b1e4 tempest-ProjectReaderTests-1990163970 None] Volume f34ec296-4e47-494e-a9d8-d762b8fd6e60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f34ec296-4e47-494e-a9d8-d762b8fd6e60', 'volume_size': 1} Jul 10 10:27:32 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-8b97a15f-c10f-4782-887e-f84078e4b1e4 tempest-ProjectReaderTests-1990163970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:27:33 devstack sudo[106991]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9232c157-6d50-477e-bd74-49ea479ae86b tempest-ProjectMemberTests-915988921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-540f5a2b-3bde-4aa6-b674-16a0c0b4df15" returned: 0 in 0.810s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9232c157-6d50-477e-bd74-49ea479ae86b tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-540f5a2b-3bde-4aa6-b674-16a0c0b4df15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-540f5a2b-3bde-4aa6-b674-16a0c0b4df15.be6e60e5-6bd6-4051-b92a-aaf297470bed 1G {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:33 devstack sudo[106996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-540f5a2b-3bde-4aa6-b674-16a0c0b4df15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-540f5a2b-3bde-4aa6-b674-16a0c0b4df15.be6e60e5-6bd6-4051-b92a-aaf297470bed 1G Jul 10 10:27:33 devstack sudo[106996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:33 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-e39e8fcd-218b-43de-acc6-cdc85544c39d tempest-SnapshotDependencyTests-1564145450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:27:33 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-e39e8fcd-218b-43de-acc6-cdc85544c39d tempest-SnapshotDependencyTests-1564145450 None] Flow 'volume_create_manager' (11d7b65b-f64d-4764-a185-4b13a49ce527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:27:33 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-e39e8fcd-218b-43de-acc6-cdc85544c39d tempest-SnapshotDependencyTests-1564145450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a75ed51-4cf6-46a7-b053-7241d00eadaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:27:33 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-e39e8fcd-218b-43de-acc6-cdc85544c39d tempest-SnapshotDependencyTests-1564145450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a75ed51-4cf6-46a7-b053-7241d00eadaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7779011-7322-471e-9140-2d418155dbfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6694d3f15c2a447dad3e45b2e1a62a22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:27:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f4e5b08c-8000-482a-bf42-49226a4446b2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:27:34Z,use_quota=True,user_id='eb068bd899664eb194616af18d82f612',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:27:33 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-e39e8fcd-218b-43de-acc6-cdc85544c39d tempest-SnapshotDependencyTests-1564145450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66cccf71-586f-4b05-b27f-c14d1136b4fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:27:33 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-e39e8fcd-218b-43de-acc6-cdc85544c39d tempest-SnapshotDependencyTests-1564145450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66cccf71-586f-4b05-b27f-c14d1136b4fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:27:33 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-e39e8fcd-218b-43de-acc6-cdc85544c39d tempest-SnapshotDependencyTests-1564145450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69647c30-d815-44b6-b1c3-52080f6f3ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:27:33 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-e39e8fcd-218b-43de-acc6-cdc85544c39d tempest-SnapshotDependencyTests-1564145450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69647c30-d815-44b6-b1c3-52080f6f3ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd7779011-7322-471e-9140-2d418155dbfb', 'volume_name': 'volume-d7779011-7322-471e-9140-2d418155dbfb', 'volume_size': 1, 'snapshot_id': 'f4e5b08c-8000-482a-bf42-49226a4446b2'}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:27:33 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-e39e8fcd-218b-43de-acc6-cdc85544c39d tempest-SnapshotDependencyTests-1564145450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52e46684-f1e7-4bf6-aaf0-057b4b2eafab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:27:33 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-e39e8fcd-218b-43de-acc6-cdc85544c39d tempest-SnapshotDependencyTests-1564145450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52e46684-f1e7-4bf6-aaf0-057b4b2eafab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:27:33 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-e39e8fcd-218b-43de-acc6-cdc85544c39d tempest-SnapshotDependencyTests-1564145450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d1a758f-5788-4cec-8a8f-1f4812c928cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:27:33 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-e39e8fcd-218b-43de-acc6-cdc85544c39d tempest-SnapshotDependencyTests-1564145450 None] Volume d7779011-7322-471e-9140-2d418155dbfb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d7779011-7322-471e-9140-2d418155dbfb', 'volume_size': 1, 'snapshot_id': 'f4e5b08c-8000-482a-bf42-49226a4446b2'} Jul 10 10:27:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-e39e8fcd-218b-43de-acc6-cdc85544c39d tempest-SnapshotDependencyTests-1564145450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:27:33 devstack sudo[106996]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9232c157-6d50-477e-bd74-49ea479ae86b tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-540f5a2b-3bde-4aa6-b674-16a0c0b4df15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-540f5a2b-3bde-4aa6-b674-16a0c0b4df15.be6e60e5-6bd6-4051-b92a-aaf297470bed 1G" returned: 0 in 0.814s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9232c157-6d50-477e-bd74-49ea479ae86b tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-540f5a2b-3bde-4aa6-b674-16a0c0b4df15 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-540f5a2b-3bde-4aa6-b674-16a0c0b4df15.be6e60e5-6bd6-4051-b92a-aaf297470bed {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:33 devstack sudo[107002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-540f5a2b-3bde-4aa6-b674-16a0c0b4df15 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-540f5a2b-3bde-4aa6-b674-16a0c0b4df15.be6e60e5-6bd6-4051-b92a-aaf297470bed Jul 10 10:27:33 devstack sudo[107002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:34 devstack sudo[107002]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:34 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9232c157-6d50-477e-bd74-49ea479ae86b tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-540f5a2b-3bde-4aa6-b674-16a0c0b4df15 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-540f5a2b-3bde-4aa6-b674-16a0c0b4df15.be6e60e5-6bd6-4051-b92a-aaf297470bed" returned: 0 in 0.690s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:34 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-9232c157-6d50-477e-bd74-49ea479ae86b tempest-ProjectMemberTests-915988921 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-540f5a2b-3bde-4aa6-b674-16a0c0b4df15.be6e60e5-6bd6-4051-b92a-aaf297470bed is being set with open permissions: ugo+rw Jul 10 10:27:34 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9232c157-6d50-477e-bd74-49ea479ae86b tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-540f5a2b-3bde-4aa6-b674-16a0c0b4df15.be6e60e5-6bd6-4051-b92a-aaf297470bed {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:34 devstack sudo[107007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-540f5a2b-3bde-4aa6-b674-16a0c0b4df15.be6e60e5-6bd6-4051-b92a-aaf297470bed Jul 10 10:27:34 devstack sudo[107007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:35 devstack sudo[107007]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:35 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9232c157-6d50-477e-bd74-49ea479ae86b tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-540f5a2b-3bde-4aa6-b674-16a0c0b4df15.be6e60e5-6bd6-4051-b92a-aaf297470bed" returned: 0 in 0.643s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:35 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9232c157-6d50-477e-bd74-49ea479ae86b tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-540f5a2b-3bde-4aa6-b674-16a0c0b4df15.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:35 devstack sudo[107010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-540f5a2b-3bde-4aa6-b674-16a0c0b4df15.info Jul 10 10:27:35 devstack sudo[107010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:35 devstack sudo[107010]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:35 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9232c157-6d50-477e-bd74-49ea479ae86b tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-540f5a2b-3bde-4aa6-b674-16a0c0b4df15.info" returned: 0 in 0.639s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:35 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-9232c157-6d50-477e-bd74-49ea479ae86b tempest-ProjectMemberTests-915988921 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-540f5a2b-3bde-4aa6-b674-16a0c0b4df15.info is being set with open permissions: ugo+rw Jul 10 10:27:35 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9232c157-6d50-477e-bd74-49ea479ae86b tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-540f5a2b-3bde-4aa6-b674-16a0c0b4df15.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:35 devstack sudo[107013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-540f5a2b-3bde-4aa6-b674-16a0c0b4df15.info Jul 10 10:27:35 devstack sudo[107013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:36 devstack sudo[107013]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:36 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9232c157-6d50-477e-bd74-49ea479ae86b tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-540f5a2b-3bde-4aa6-b674-16a0c0b4df15.info" returned: 0 in 0.654s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:36 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-9232c157-6d50-477e-bd74-49ea479ae86b tempest-ProjectMemberTests-915988921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.361s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:27:36 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-8b97a15f-c10f-4782-887e-f84078e4b1e4 tempest-ProjectReaderTests-1990163970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.012s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:27:36 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-8b97a15f-c10f-4782-887e-f84078e4b1e4 tempest-ProjectReaderTests-1990163970 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:27:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2082471108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f34ec296-4e47-494e-a9d8-d762b8fd6e60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9005996ee3c4fd79ff943ddef70d6a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:27:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:27:32Z,use_quota=True,user_id='af3da7e2db214368a3fb84a8cc08b50d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:27:36 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-8b97a15f-c10f-4782-887e-f84078e4b1e4 tempest-ProjectReaderTests-1990163970 None] Creating volume f34ec296-4e47-494e-a9d8-d762b8fd6e60 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:27:36 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-8b97a15f-c10f-4782-887e-f84078e4b1e4 tempest-ProjectReaderTests-1990163970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:27:36 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-8b97a15f-c10f-4782-887e-f84078e4b1e4 tempest-ProjectReaderTests-1990163970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:27:36 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-8b97a15f-c10f-4782-887e-f84078e4b1e4 tempest-ProjectReaderTests-1990163970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:27:36 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-8b97a15f-c10f-4782-887e-f84078e4b1e4 tempest-ProjectReaderTests-1990163970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:27:36 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-8b97a15f-c10f-4782-887e-f84078e4b1e4 tempest-ProjectReaderTests-1990163970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:27:36 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-8b97a15f-c10f-4782-887e-f84078e4b1e4 tempest-ProjectReaderTests-1990163970 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:27:36 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-8b97a15f-c10f-4782-887e-f84078e4b1e4 tempest-ProjectReaderTests-1990163970 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:27:36 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-8b97a15f-c10f-4782-887e-f84078e4b1e4 tempest-ProjectReaderTests-1990163970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f34ec296-4e47-494e-a9d8-d762b8fd6e60 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:36 devstack sudo[107016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f34ec296-4e47-494e-a9d8-d762b8fd6e60 1073741824 Jul 10 10:27:36 devstack sudo[107016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:36 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-9232c157-6d50-477e-bd74-49ea479ae86b tempest-ProjectMemberTests-915988921 None] Create snapshot completed successfully Jul 10 10:27:37 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-7168124c-6da8-4ea7-8bf1-1d71f563b885 tempest-ProjectMemberTests-915988921 None] Acquiring lock "cinder-be6e60e5-6bd6-4051-b92a-aaf297470bed-delete_snapshot" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:27:37 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-7168124c-6da8-4ea7-8bf1-1d71f563b885 tempest-ProjectMemberTests-915988921 None] Lock "cinder-be6e60e5-6bd6-4051-b92a-aaf297470bed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:27:37 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-7168124c-6da8-4ea7-8bf1-1d71f563b885 tempest-ProjectMemberTests-915988921 None] Acquiring lock "cinder-quobyte-540f5a2b-3bde-4aa6-b674-16a0c0b4df15" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:27:37 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-7168124c-6da8-4ea7-8bf1-1d71f563b885 tempest-ProjectMemberTests-915988921 None] Lock "cinder-quobyte-540f5a2b-3bde-4aa6-b674-16a0c0b4df15" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:27:37 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-7168124c-6da8-4ea7-8bf1-1d71f563b885 tempest-ProjectMemberTests-915988921 None] Acquiring lock "cinder-quobyte-be6e60e5-6bd6-4051-b92a-aaf297470bed" by "_delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:27:37 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-7168124c-6da8-4ea7-8bf1-1d71f563b885 tempest-ProjectMemberTests-915988921 None] Lock "cinder-quobyte-be6e60e5-6bd6-4051-b92a-aaf297470bed" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:27:37 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-7168124c-6da8-4ea7-8bf1-1d71f563b885 tempest-ProjectMemberTests-915988921 None] Deleting offline snapshot be6e60e5-6bd6-4051-b92a-aaf297470bed of volume 540f5a2b-3bde-4aa6-b674-16a0c0b4df15 {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 10:27:37 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-7168124c-6da8-4ea7-8bf1-1d71f563b885 tempest-ProjectMemberTests-915988921 None] snapshot_file for this snap is: volume-540f5a2b-3bde-4aa6-b674-16a0c0b4df15.be6e60e5-6bd6-4051-b92a-aaf297470bed {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 10:27:37 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f05ff19-2b17-4ac5-9ba9-0ec39eb9dff2]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:27:37 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-7168124c-6da8-4ea7-8bf1-1d71f563b885 tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-540f5a2b-3bde-4aa6-b674-16a0c0b4df15.be6e60e5-6bd6-4051-b92a-aaf297470bed {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:37 devstack sudo[107016]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:37 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-8b97a15f-c10f-4782-887e-f84078e4b1e4 tempest-ProjectReaderTests-1990163970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f34ec296-4e47-494e-a9d8-d762b8fd6e60 1073741824" returned: 0 in 0.876s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:37 devstack sudo[107022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-540f5a2b-3bde-4aa6-b674-16a0c0b4df15.be6e60e5-6bd6-4051-b92a-aaf297470bed Jul 10 10:27:37 devstack sudo[107022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:37 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-8b97a15f-c10f-4782-887e-f84078e4b1e4 tempest-ProjectReaderTests-1990163970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f34ec296-4e47-494e-a9d8-d762b8fd6e60 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:37 devstack sudo[107025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f34ec296-4e47-494e-a9d8-d762b8fd6e60 Jul 10 10:27:37 devstack sudo[107025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:38 devstack sudo[107022]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-7168124c-6da8-4ea7-8bf1-1d71f563b885 tempest-ProjectMemberTests-915988921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-540f5a2b-3bde-4aa6-b674-16a0c0b4df15.be6e60e5-6bd6-4051-b92a-aaf297470bed" returned: 0 in 0.794s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:38 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-7168124c-6da8-4ea7-8bf1-1d71f563b885 tempest-ProjectMemberTests-915988921 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-540f5a2b-3bde-4aa6-b674-16a0c0b4df15(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 10:27:38 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe6f8c7-cfdf-4d2c-a330-e102a5df59e9]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:27:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-7168124c-6da8-4ea7-8bf1-1d71f563b885 tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-540f5a2b-3bde-4aa6-b674-16a0c0b4df15 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:38 devstack sudo[107025]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-8b97a15f-c10f-4782-887e-f84078e4b1e4 tempest-ProjectReaderTests-1990163970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f34ec296-4e47-494e-a9d8-d762b8fd6e60" returned: 0 in 0.695s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:38 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-8b97a15f-c10f-4782-887e-f84078e4b1e4 tempest-ProjectReaderTests-1990163970 None] <== create_volume: return (1618ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:27:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-8b97a15f-c10f-4782-887e-f84078e4b1e4 tempest-ProjectReaderTests-1990163970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.622s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:27:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-e39e8fcd-218b-43de-acc6-cdc85544c39d tempest-SnapshotDependencyTests-1564145450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.550s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:27:38 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-e39e8fcd-218b-43de-acc6-cdc85544c39d tempest-SnapshotDependencyTests-1564145450 None] Acquiring lock "cinder-quobyte-f4e5b08c-8000-482a-bf42-49226a4446b2-d7779011-7322-471e-9140-2d418155dbfb" by "_create_volume_from_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:27:38 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8b97a15f-c10f-4782-887e-f84078e4b1e4 tempest-ProjectReaderTests-1990163970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9ca1917-3fb2-40cc-bf83-6a636270a317) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f34ec296-4e47-494e-a9d8-d762b8fd6e60', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:27:38 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8b97a15f-c10f-4782-887e-f84078e4b1e4 tempest-ProjectReaderTests-1990163970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (939db9c0-6c97-4a35-8c70-a8db75a5f61f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:27:38 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-e39e8fcd-218b-43de-acc6-cdc85544c39d tempest-SnapshotDependencyTests-1564145450 None] Lock "cinder-quobyte-f4e5b08c-8000-482a-bf42-49226a4446b2-d7779011-7322-471e-9140-2d418155dbfb" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:27:38 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-e39e8fcd-218b-43de-acc6-cdc85544c39d tempest-SnapshotDependencyTests-1564145450 None] Creating volume d7779011-7322-471e-9140-2d418155dbfb from snapshot f4e5b08c-8000-482a-bf42-49226a4446b2 {{(pid=87234) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 10:27:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-e39e8fcd-218b-43de-acc6-cdc85544c39d tempest-SnapshotDependencyTests-1564145450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:27:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-e39e8fcd-218b-43de-acc6-cdc85544c39d tempest-SnapshotDependencyTests-1564145450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:27:38 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-e39e8fcd-218b-43de-acc6-cdc85544c39d tempest-SnapshotDependencyTests-1564145450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:27:38 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-e39e8fcd-218b-43de-acc6-cdc85544c39d tempest-SnapshotDependencyTests-1564145450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:27:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-e39e8fcd-218b-43de-acc6-cdc85544c39d tempest-SnapshotDependencyTests-1564145450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:27:38 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-e39e8fcd-218b-43de-acc6-cdc85544c39d tempest-SnapshotDependencyTests-1564145450 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:27:38 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-e39e8fcd-218b-43de-acc6-cdc85544c39d tempest-SnapshotDependencyTests-1564145450 None] Acquiring lock "cinder-quobyte-d7779011-7322-471e-9140-2d418155dbfb" by "_copy_volume_from_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:27:38 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-8b97a15f-c10f-4782-887e-f84078e4b1e4 tempest-ProjectReaderTests-1990163970 None] Volume volume-f34ec296-4e47-494e-a9d8-d762b8fd6e60 (f34ec296-4e47-494e-a9d8-d762b8fd6e60): created successfully Jul 10 10:27:38 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8b97a15f-c10f-4782-887e-f84078e4b1e4 tempest-ProjectReaderTests-1990163970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (939db9c0-6c97-4a35-8c70-a8db75a5f61f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:27:38 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8b97a15f-c10f-4782-887e-f84078e4b1e4 tempest-ProjectReaderTests-1990163970 None] Flow 'volume_create_manager' (190f9f7a-f037-442a-81cb-6b0b57af983c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:27:38 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-e39e8fcd-218b-43de-acc6-cdc85544c39d tempest-SnapshotDependencyTests-1564145450 None] Lock "cinder-quobyte-d7779011-7322-471e-9140-2d418155dbfb" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:27:38 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-e39e8fcd-218b-43de-acc6-cdc85544c39d tempest-SnapshotDependencyTests-1564145450 None] snapshot: f4e5b08c-8000-482a-bf42-49226a4446b2, volume: d7779011-7322-471e-9140-2d418155dbfb, {{(pid=87234) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 10:27:38 devstack sudo[107031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-540f5a2b-3bde-4aa6-b674-16a0c0b4df15 Jul 10 10:27:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-e39e8fcd-218b-43de-acc6-cdc85544c39d tempest-SnapshotDependencyTests-1564145450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:27:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-e39e8fcd-218b-43de-acc6-cdc85544c39d tempest-SnapshotDependencyTests-1564145450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:27:38 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-e39e8fcd-218b-43de-acc6-cdc85544c39d tempest-SnapshotDependencyTests-1564145450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:27:38 devstack sudo[107031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:38 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-e39e8fcd-218b-43de-acc6-cdc85544c39d tempest-SnapshotDependencyTests-1564145450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:27:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-e39e8fcd-218b-43de-acc6-cdc85544c39d tempest-SnapshotDependencyTests-1564145450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:27:38 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-8b97a15f-c10f-4782-887e-f84078e4b1e4 tempest-ProjectReaderTests-1990163970 None] Created volume successfully. Jul 10 10:27:38 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[f55a5292-c023-4c52-bbc1-057355f1eb2c]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:27:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e39e8fcd-218b-43de-acc6-cdc85544c39d tempest-SnapshotDependencyTests-1564145450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-264154ad-4da3-4ac0-b509-452b8009e34b.f4e5b08c-8000-482a-bf42-49226a4446b2 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:38 devstack sudo[107033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-264154ad-4da3-4ac0-b509-452b8009e34b.f4e5b08c-8000-482a-bf42-49226a4446b2 Jul 10 10:27:38 devstack sudo[107033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:39 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-3cb0d350-7938-4345-8c29-348084184cdd tempest-ProjectReaderTests-1990163970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:27:39 devstack sudo[107031]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:39 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-7168124c-6da8-4ea7-8bf1-1d71f563b885 tempest-ProjectMemberTests-915988921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-540f5a2b-3bde-4aa6-b674-16a0c0b4df15" returned: 0 in 0.873s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:39 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-7168124c-6da8-4ea7-8bf1-1d71f563b885 tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-540f5a2b-3bde-4aa6-b674-16a0c0b4df15.be6e60e5-6bd6-4051-b92a-aaf297470bed {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:39 devstack sudo[107041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-540f5a2b-3bde-4aa6-b674-16a0c0b4df15.be6e60e5-6bd6-4051-b92a-aaf297470bed Jul 10 10:27:39 devstack sudo[107041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:39 devstack sudo[107033]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:39 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e39e8fcd-218b-43de-acc6-cdc85544c39d tempest-SnapshotDependencyTests-1564145450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-264154ad-4da3-4ac0-b509-452b8009e34b.f4e5b08c-8000-482a-bf42-49226a4446b2" returned: 0 in 0.799s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:39 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-e39e8fcd-218b-43de-acc6-cdc85544c39d tempest-SnapshotDependencyTests-1564145450 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-264154ad-4da3-4ac0-b509-452b8009e34b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 10:27:39 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-e39e8fcd-218b-43de-acc6-cdc85544c39d tempest-SnapshotDependencyTests-1564145450 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-264154ad-4da3-4ac0-b509-452b8009e34b {{(pid=87234) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 10:27:39 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-e39e8fcd-218b-43de-acc6-cdc85544c39d tempest-SnapshotDependencyTests-1564145450 None] Creating direct copy from snapshot {{(pid=87234) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 10:27:39 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ee0ee0-3f03-4451-bf57-7225365f5312]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:27:39 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e39e8fcd-218b-43de-acc6-cdc85544c39d tempest-SnapshotDependencyTests-1564145450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-264154ad-4da3-4ac0-b509-452b8009e34b {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:39 devstack sudo[107043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-264154ad-4da3-4ac0-b509-452b8009e34b Jul 10 10:27:39 devstack sudo[107043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:39 devstack sudo[107041]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:39 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-7168124c-6da8-4ea7-8bf1-1d71f563b885 tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-540f5a2b-3bde-4aa6-b674-16a0c0b4df15.be6e60e5-6bd6-4051-b92a-aaf297470bed" returned: 0 in 0.763s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:39 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-7168124c-6da8-4ea7-8bf1-1d71f563b885 tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-540f5a2b-3bde-4aa6-b674-16a0c0b4df15.be6e60e5-6bd6-4051-b92a-aaf297470bed {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:39 devstack sudo[107052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-540f5a2b-3bde-4aa6-b674-16a0c0b4df15.be6e60e5-6bd6-4051-b92a-aaf297470bed Jul 10 10:27:39 devstack sudo[107052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:39 devstack sudo[107043]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:39 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e39e8fcd-218b-43de-acc6-cdc85544c39d tempest-SnapshotDependencyTests-1564145450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-264154ad-4da3-4ac0-b509-452b8009e34b" returned: 0 in 0.774s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:39 devstack cinder-volume[87234]: DEBUG cinder.utils [None req-e39e8fcd-218b-43de-acc6-cdc85544c39d tempest-SnapshotDependencyTests-1564145450 None] Path /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d7779011-7322-471e-9140-2d418155dbfb not found in is_blk_device check {{(pid=87234) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 10:27:39 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e39e8fcd-218b-43de-acc6-cdc85544c39d tempest-SnapshotDependencyTests-1564145450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-264154ad-4da3-4ac0-b509-452b8009e34b /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d7779011-7322-471e-9140-2d418155dbfb {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:39 devstack sudo[107054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-264154ad-4da3-4ac0-b509-452b8009e34b /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d7779011-7322-471e-9140-2d418155dbfb Jul 10 10:27:39 devstack sudo[107054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:40 devstack sudo[107052]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-7168124c-6da8-4ea7-8bf1-1d71f563b885 tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-540f5a2b-3bde-4aa6-b674-16a0c0b4df15.be6e60e5-6bd6-4051-b92a-aaf297470bed" returned: 0 in 0.661s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:40 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-7168124c-6da8-4ea7-8bf1-1d71f563b885 tempest-ProjectMemberTests-915988921 None] Lock "cinder-quobyte-be6e60e5-6bd6-4051-b92a-aaf297470bed" released by "_delete_snapshot" :: held 3.198s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:27:40 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-7168124c-6da8-4ea7-8bf1-1d71f563b885 tempest-ProjectMemberTests-915988921 None] Lock "cinder-quobyte-540f5a2b-3bde-4aa6-b674-16a0c0b4df15" released by "delete_snapshot" :: held 3.220s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:27:40 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-7168124c-6da8-4ea7-8bf1-1d71f563b885 tempest-ProjectMemberTests-915988921 None] Created reservations ['97dc7e83-c74c-43f0-9b32-c695a477123c', 'b75bd6f5-ce48-408e-ad30-ed63b2080b0c', 'bd8ccac6-b874-4f95-b21c-9f17e0c9ea99', '95543a44-553b-4aa7-b6df-736ad0e9ac35'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:27:40 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-7168124c-6da8-4ea7-8bf1-1d71f563b885 tempest-ProjectMemberTests-915988921 None] Delete snapshot completed successfully. Jul 10 10:27:40 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-7168124c-6da8-4ea7-8bf1-1d71f563b885 tempest-ProjectMemberTests-915988921 None] Lock "cinder-be6e60e5-6bd6-4051-b92a-aaf297470bed-delete_snapshot" released by "delete_snapshot" :: held 3.362s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:27:41 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-851dfdce-d130-4ac5-a19c-29f5086f77ef tempest-ProjectMemberTests-915988921 None] Acquiring lock "cinder-540f5a2b-3bde-4aa6-b674-16a0c0b4df15-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:27:41 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-851dfdce-d130-4ac5-a19c-29f5086f77ef tempest-ProjectMemberTests-915988921 None] Lock "cinder-540f5a2b-3bde-4aa6-b674-16a0c0b4df15-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:27:41 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-851dfdce-d130-4ac5-a19c-29f5086f77ef tempest-ProjectMemberTests-915988921 None] Acquiring lock "cinder-quobyte-540f5a2b-3bde-4aa6-b674-16a0c0b4df15" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:27:41 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-851dfdce-d130-4ac5-a19c-29f5086f77ef tempest-ProjectMemberTests-915988921 None] Lock "cinder-quobyte-540f5a2b-3bde-4aa6-b674-16a0c0b4df15" acquired by "delete_volume" :: waited 0.042s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:27:42 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c99f4b-dcb5-4634-a928-d85600f21faa]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:27:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-851dfdce-d130-4ac5-a19c-29f5086f77ef tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-540f5a2b-3bde-4aa6-b674-16a0c0b4df15 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:42 devstack cinder-volume[87234]: DEBUG oslo_service.periodic_task [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 10:27:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:27:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:27:42 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:27:42 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:27:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:27:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:42 devstack sudo[107068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:27:42 devstack sudo[107068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:42 devstack sudo[107067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-540f5a2b-3bde-4aa6-b674-16a0c0b4df15 Jul 10 10:27:42 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:43 devstack sudo[107068]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 1.365s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:43 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:27:43 devstack cinder-volume[87234]: DEBUG oslo_service.periodic_task [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Running periodic task VolumeManager._thread_info {{(pid=87234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 10:27:43 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] thread count: 28 {{(pid=87234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 10:27:43 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] thread info: [<_MainThread(MainThread, started 131600773742720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 10:27:44 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-851dfdce-d130-4ac5-a19c-29f5086f77ef tempest-ProjectMemberTests-915988921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-540f5a2b-3bde-4aa6-b674-16a0c0b4df15" returned: 0 in 2.245s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-851dfdce-d130-4ac5-a19c-29f5086f77ef tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-540f5a2b-3bde-4aa6-b674-16a0c0b4df15 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:44 devstack sudo[107075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-540f5a2b-3bde-4aa6-b674-16a0c0b4df15 Jul 10 10:27:44 devstack sudo[107075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:44 devstack sudo[107054]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e39e8fcd-218b-43de-acc6-cdc85544c39d tempest-SnapshotDependencyTests-1564145450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-264154ad-4da3-4ac0-b509-452b8009e34b /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d7779011-7322-471e-9140-2d418155dbfb" returned: 0 in 5.002s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:44 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4c5a74-aafb-4acd-b60b-5c716fe5e027]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:27:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e39e8fcd-218b-43de-acc6-cdc85544c39d tempest-SnapshotDependencyTests-1564145450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-264154ad-4da3-4ac0-b509-452b8009e34b {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:45 devstack sudo[107077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-264154ad-4da3-4ac0-b509-452b8009e34b Jul 10 10:27:45 devstack sudo[107077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:45 devstack sudo[107075]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-851dfdce-d130-4ac5-a19c-29f5086f77ef tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-540f5a2b-3bde-4aa6-b674-16a0c0b4df15" returned: 0 in 0.979s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:45 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-851dfdce-d130-4ac5-a19c-29f5086f77ef tempest-ProjectMemberTests-915988921 None] Lock "cinder-quobyte-540f5a2b-3bde-4aa6-b674-16a0c0b4df15" released by "delete_volume" :: held 3.333s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:27:45 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-851dfdce-d130-4ac5-a19c-29f5086f77ef tempest-ProjectMemberTests-915988921 None] Created reservations ['5796f32f-4edc-43c7-8553-a60db513dd70', 'd526f2f5-49c2-40e3-854c-5e6986519e41', '0e06f267-2bff-4c14-bafc-abd9d32e7c81', '0dff0bd9-53c3-4228-bbe6-13bcf7a6b442'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:27:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-851dfdce-d130-4ac5-a19c-29f5086f77ef tempest-ProjectMemberTests-915988921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:27:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-851dfdce-d130-4ac5-a19c-29f5086f77ef tempest-ProjectMemberTests-915988921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:27:45 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-851dfdce-d130-4ac5-a19c-29f5086f77ef tempest-ProjectMemberTests-915988921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:27:45 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-851dfdce-d130-4ac5-a19c-29f5086f77ef tempest-ProjectMemberTests-915988921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:27:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-851dfdce-d130-4ac5-a19c-29f5086f77ef tempest-ProjectMemberTests-915988921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:27:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-851dfdce-d130-4ac5-a19c-29f5086f77ef tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:45 devstack sudo[107080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:27:45 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:45 devstack sudo[107077]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e39e8fcd-218b-43de-acc6-cdc85544c39d tempest-SnapshotDependencyTests-1564145450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-264154ad-4da3-4ac0-b509-452b8009e34b" returned: 0 in 0.943s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:45 devstack cinder-volume[87234]: DEBUG cinder.image.image_utils [None req-e39e8fcd-218b-43de-acc6-cdc85544c39d tempest-SnapshotDependencyTests-1564145450 None] Image conversion details: src /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-264154ad-4da3-4ac0-b509-452b8009e34b, size 1024.00 MB, duration 5.00 sec, destination /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d7779011-7322-471e-9140-2d418155dbfb {{(pid=87234) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 10:27:45 devstack cinder-volume[87234]: INFO cinder.image.image_utils [None req-e39e8fcd-218b-43de-acc6-cdc85544c39d tempest-SnapshotDependencyTests-1564145450 None] Converted 1024.00 MB image at 204.68 MB/s Jul 10 10:27:45 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-e39e8fcd-218b-43de-acc6-cdc85544c39d tempest-SnapshotDependencyTests-1564145450 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d7779011-7322-471e-9140-2d418155dbfb is being set with open permissions: ugo+rw Jul 10 10:27:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e39e8fcd-218b-43de-acc6-cdc85544c39d tempest-SnapshotDependencyTests-1564145450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d7779011-7322-471e-9140-2d418155dbfb {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:45 devstack sudo[107086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d7779011-7322-471e-9140-2d418155dbfb Jul 10 10:27:45 devstack sudo[107086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:45 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-851dfdce-d130-4ac5-a19c-29f5086f77ef tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.638s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:46 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-851dfdce-d130-4ac5-a19c-29f5086f77ef tempest-ProjectMemberTests-915988921 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:27:46 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-851dfdce-d130-4ac5-a19c-29f5086f77ef tempest-ProjectMemberTests-915988921 None] Deleted volume successfully. Jul 10 10:27:46 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-851dfdce-d130-4ac5-a19c-29f5086f77ef tempest-ProjectMemberTests-915988921 None] Lock "cinder-540f5a2b-3bde-4aa6-b674-16a0c0b4df15-delete_volume" released by "delete_volume" :: held 4.268s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:27:46 devstack sudo[107086]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e39e8fcd-218b-43de-acc6-cdc85544c39d tempest-SnapshotDependencyTests-1564145450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d7779011-7322-471e-9140-2d418155dbfb" returned: 0 in 0.625s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:46 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-e39e8fcd-218b-43de-acc6-cdc85544c39d tempest-SnapshotDependencyTests-1564145450 None] Lock "cinder-quobyte-d7779011-7322-471e-9140-2d418155dbfb" released by "_copy_volume_from_snapshot" :: held 8.264s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:27:46 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-e39e8fcd-218b-43de-acc6-cdc85544c39d tempest-SnapshotDependencyTests-1564145450 None] Lock "cinder-quobyte-f4e5b08c-8000-482a-bf42-49226a4446b2-d7779011-7322-471e-9140-2d418155dbfb" released by "_create_volume_from_snapshot" :: held 8.306s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:27:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-e39e8fcd-218b-43de-acc6-cdc85544c39d tempest-SnapshotDependencyTests-1564145450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.341s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:27:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-3cb0d350-7938-4345-8c29-348084184cdd tempest-ProjectReaderTests-1990163970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.526s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:27:46 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-3cb0d350-7938-4345-8c29-348084184cdd tempest-ProjectReaderTests-1990163970 None] Creating offline snapshot ca226875-a984-4f9f-8019-a496cdbcd801 of volume f34ec296-4e47-494e-a9d8-d762b8fd6e60 {{(pid=87234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 10:27:46 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-e39e8fcd-218b-43de-acc6-cdc85544c39d tempest-SnapshotDependencyTests-1564145450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d1a758f-5788-4cec-8a8f-1f4812c928cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7779011-7322-471e-9140-2d418155dbfb', 'volume_size': 1, 'snapshot_id': 'f4e5b08c-8000-482a-bf42-49226a4446b2'}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:27:46 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-e39e8fcd-218b-43de-acc6-cdc85544c39d tempest-SnapshotDependencyTests-1564145450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4f0afdf-f2e2-4e07-b322-74da15d81045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:27:46 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5852234-6004-4b6a-8f8a-fc33b42050f2]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:27:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3cb0d350-7938-4345-8c29-348084184cdd tempest-ProjectReaderTests-1990163970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f34ec296-4e47-494e-a9d8-d762b8fd6e60 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:46 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-e39e8fcd-218b-43de-acc6-cdc85544c39d tempest-SnapshotDependencyTests-1564145450 None] Volume volume-d7779011-7322-471e-9140-2d418155dbfb (d7779011-7322-471e-9140-2d418155dbfb): created successfully Jul 10 10:27:46 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-e39e8fcd-218b-43de-acc6-cdc85544c39d tempest-SnapshotDependencyTests-1564145450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4f0afdf-f2e2-4e07-b322-74da15d81045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:27:46 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-e39e8fcd-218b-43de-acc6-cdc85544c39d tempest-SnapshotDependencyTests-1564145450 None] Flow 'volume_create_manager' (11d7b65b-f64d-4764-a185-4b13a49ce527) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:27:46 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-e39e8fcd-218b-43de-acc6-cdc85544c39d tempest-SnapshotDependencyTests-1564145450 None] Created volume successfully. Jul 10 10:27:46 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-00f3fa95-5446-4e14-ab8f-d6d1e924e211 tempest-ProjectMemberTests-915988921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:27:46 devstack sudo[107089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f34ec296-4e47-494e-a9d8-d762b8fd6e60 Jul 10 10:27:46 devstack sudo[107089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:46 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-00f3fa95-5446-4e14-ab8f-d6d1e924e211 tempest-ProjectMemberTests-915988921 None] Flow 'volume_create_manager' (f881ae65-36be-4c8e-80a5-df720a0ad442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:27:46 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-00f3fa95-5446-4e14-ab8f-d6d1e924e211 tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b8e1b8d-9192-4041-b414-93ed1cc868a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:27:46 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-00f3fa95-5446-4e14-ab8f-d6d1e924e211 tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b8e1b8d-9192-4041-b414-93ed1cc868a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1743109965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e2643dd-e3c9-4b6f-9a1d-300534360d79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac4b039bd3aa49f393fe3462e2fed6d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:27:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:27:47Z,use_quota=True,user_id='cc3f433661ac4946825a66613f6d748c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:27:46 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-00f3fa95-5446-4e14-ab8f-d6d1e924e211 tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a02c7063-4faa-4f6c-8637-822e1435e554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:27:46 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-00f3fa95-5446-4e14-ab8f-d6d1e924e211 tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a02c7063-4faa-4f6c-8637-822e1435e554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:27:46 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-00f3fa95-5446-4e14-ab8f-d6d1e924e211 tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (188df04f-378a-42fc-ac61-332b18172377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:27:46 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-00f3fa95-5446-4e14-ab8f-d6d1e924e211 tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (188df04f-378a-42fc-ac61-332b18172377) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e2643dd-e3c9-4b6f-9a1d-300534360d79', 'volume_name': 'volume-5e2643dd-e3c9-4b6f-9a1d-300534360d79', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:27:46 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-00f3fa95-5446-4e14-ab8f-d6d1e924e211 tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7680724-36a6-471e-bf19-9a37110ac807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:27:46 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-00f3fa95-5446-4e14-ab8f-d6d1e924e211 tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7680724-36a6-471e-bf19-9a37110ac807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:27:46 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-00f3fa95-5446-4e14-ab8f-d6d1e924e211 tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86511cb6-350b-4113-9a7f-a08109b8f450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:27:46 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-00f3fa95-5446-4e14-ab8f-d6d1e924e211 tempest-ProjectMemberTests-915988921 None] Volume 5e2643dd-e3c9-4b6f-9a1d-300534360d79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e2643dd-e3c9-4b6f-9a1d-300534360d79', 'volume_size': 1} Jul 10 10:27:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-00f3fa95-5446-4e14-ab8f-d6d1e924e211 tempest-ProjectMemberTests-915988921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:27:47 devstack sudo[107089]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3cb0d350-7938-4345-8c29-348084184cdd tempest-ProjectReaderTests-1990163970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f34ec296-4e47-494e-a9d8-d762b8fd6e60" returned: 0 in 0.729s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3cb0d350-7938-4345-8c29-348084184cdd tempest-ProjectReaderTests-1990163970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f34ec296-4e47-494e-a9d8-d762b8fd6e60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f34ec296-4e47-494e-a9d8-d762b8fd6e60.ca226875-a984-4f9f-8019-a496cdbcd801 1G {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:47 devstack sudo[107094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f34ec296-4e47-494e-a9d8-d762b8fd6e60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f34ec296-4e47-494e-a9d8-d762b8fd6e60.ca226875-a984-4f9f-8019-a496cdbcd801 1G Jul 10 10:27:47 devstack sudo[107094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:47 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-60165046-a5ee-47d7-a33f-f8e1c34b70a9 tempest-SnapshotDependencyTests-1564145450 None] Acquiring lock "cinder-f4e5b08c-8000-482a-bf42-49226a4446b2-delete_snapshot" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:27:47 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-60165046-a5ee-47d7-a33f-f8e1c34b70a9 tempest-SnapshotDependencyTests-1564145450 None] Lock "cinder-f4e5b08c-8000-482a-bf42-49226a4446b2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:27:47 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-60165046-a5ee-47d7-a33f-f8e1c34b70a9 tempest-SnapshotDependencyTests-1564145450 None] Acquiring lock "cinder-quobyte-264154ad-4da3-4ac0-b509-452b8009e34b" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:27:47 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-60165046-a5ee-47d7-a33f-f8e1c34b70a9 tempest-SnapshotDependencyTests-1564145450 None] Lock "cinder-quobyte-264154ad-4da3-4ac0-b509-452b8009e34b" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:27:47 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-60165046-a5ee-47d7-a33f-f8e1c34b70a9 tempest-SnapshotDependencyTests-1564145450 None] Acquiring lock "cinder-quobyte-f4e5b08c-8000-482a-bf42-49226a4446b2" by "_delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:27:47 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-60165046-a5ee-47d7-a33f-f8e1c34b70a9 tempest-SnapshotDependencyTests-1564145450 None] Lock "cinder-quobyte-f4e5b08c-8000-482a-bf42-49226a4446b2" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:27:47 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-60165046-a5ee-47d7-a33f-f8e1c34b70a9 tempest-SnapshotDependencyTests-1564145450 None] Deleting offline snapshot f4e5b08c-8000-482a-bf42-49226a4446b2 of volume 264154ad-4da3-4ac0-b509-452b8009e34b {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 10:27:47 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-60165046-a5ee-47d7-a33f-f8e1c34b70a9 tempest-SnapshotDependencyTests-1564145450 None] snapshot_file for this snap is: volume-264154ad-4da3-4ac0-b509-452b8009e34b.f4e5b08c-8000-482a-bf42-49226a4446b2 {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 10:27:47 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce31ffa-d90c-44f0-9d1f-3c04f6f0a5d0]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:27:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-60165046-a5ee-47d7-a33f-f8e1c34b70a9 tempest-SnapshotDependencyTests-1564145450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-264154ad-4da3-4ac0-b509-452b8009e34b.f4e5b08c-8000-482a-bf42-49226a4446b2 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:47 devstack sudo[107097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-264154ad-4da3-4ac0-b509-452b8009e34b.f4e5b08c-8000-482a-bf42-49226a4446b2 Jul 10 10:27:47 devstack sudo[107097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:48 devstack sudo[107094]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3cb0d350-7938-4345-8c29-348084184cdd tempest-ProjectReaderTests-1990163970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f34ec296-4e47-494e-a9d8-d762b8fd6e60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f34ec296-4e47-494e-a9d8-d762b8fd6e60.ca226875-a984-4f9f-8019-a496cdbcd801 1G" returned: 0 in 0.771s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3cb0d350-7938-4345-8c29-348084184cdd tempest-ProjectReaderTests-1990163970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f34ec296-4e47-494e-a9d8-d762b8fd6e60 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f34ec296-4e47-494e-a9d8-d762b8fd6e60.ca226875-a984-4f9f-8019-a496cdbcd801 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:48 devstack sudo[107102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f34ec296-4e47-494e-a9d8-d762b8fd6e60 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f34ec296-4e47-494e-a9d8-d762b8fd6e60.ca226875-a984-4f9f-8019-a496cdbcd801 Jul 10 10:27:48 devstack sudo[107102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:48 devstack sudo[107097]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-60165046-a5ee-47d7-a33f-f8e1c34b70a9 tempest-SnapshotDependencyTests-1564145450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-264154ad-4da3-4ac0-b509-452b8009e34b.f4e5b08c-8000-482a-bf42-49226a4446b2" returned: 0 in 0.774s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:48 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-60165046-a5ee-47d7-a33f-f8e1c34b70a9 tempest-SnapshotDependencyTests-1564145450 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-264154ad-4da3-4ac0-b509-452b8009e34b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 10:27:48 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[e777a3ab-1ead-4f8b-b4a5-bed3435f4536]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:27:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-60165046-a5ee-47d7-a33f-f8e1c34b70a9 tempest-SnapshotDependencyTests-1564145450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-264154ad-4da3-4ac0-b509-452b8009e34b {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:48 devstack sudo[107109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-264154ad-4da3-4ac0-b509-452b8009e34b Jul 10 10:27:48 devstack sudo[107109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:48 devstack sudo[107102]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3cb0d350-7938-4345-8c29-348084184cdd tempest-ProjectReaderTests-1990163970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f34ec296-4e47-494e-a9d8-d762b8fd6e60 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f34ec296-4e47-494e-a9d8-d762b8fd6e60.ca226875-a984-4f9f-8019-a496cdbcd801" returned: 0 in 0.686s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:48 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-3cb0d350-7938-4345-8c29-348084184cdd tempest-ProjectReaderTests-1990163970 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f34ec296-4e47-494e-a9d8-d762b8fd6e60.ca226875-a984-4f9f-8019-a496cdbcd801 is being set with open permissions: ugo+rw Jul 10 10:27:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3cb0d350-7938-4345-8c29-348084184cdd tempest-ProjectReaderTests-1990163970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f34ec296-4e47-494e-a9d8-d762b8fd6e60.ca226875-a984-4f9f-8019-a496cdbcd801 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:48 devstack sudo[107113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f34ec296-4e47-494e-a9d8-d762b8fd6e60.ca226875-a984-4f9f-8019-a496cdbcd801 Jul 10 10:27:48 devstack sudo[107113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:49 devstack sudo[107109]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-60165046-a5ee-47d7-a33f-f8e1c34b70a9 tempest-SnapshotDependencyTests-1564145450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-264154ad-4da3-4ac0-b509-452b8009e34b" returned: 0 in 0.737s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-60165046-a5ee-47d7-a33f-f8e1c34b70a9 tempest-SnapshotDependencyTests-1564145450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-264154ad-4da3-4ac0-b509-452b8009e34b.f4e5b08c-8000-482a-bf42-49226a4446b2 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:49 devstack sudo[107119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-264154ad-4da3-4ac0-b509-452b8009e34b.f4e5b08c-8000-482a-bf42-49226a4446b2 Jul 10 10:27:49 devstack sudo[107119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:49 devstack sudo[107113]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3cb0d350-7938-4345-8c29-348084184cdd tempest-ProjectReaderTests-1990163970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f34ec296-4e47-494e-a9d8-d762b8fd6e60.ca226875-a984-4f9f-8019-a496cdbcd801" returned: 0 in 0.662s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3cb0d350-7938-4345-8c29-348084184cdd tempest-ProjectReaderTests-1990163970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f34ec296-4e47-494e-a9d8-d762b8fd6e60.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:49 devstack sudo[107121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f34ec296-4e47-494e-a9d8-d762b8fd6e60.info Jul 10 10:27:49 devstack sudo[107121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:50 devstack sudo[107119]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-60165046-a5ee-47d7-a33f-f8e1c34b70a9 tempest-SnapshotDependencyTests-1564145450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-264154ad-4da3-4ac0-b509-452b8009e34b.f4e5b08c-8000-482a-bf42-49226a4446b2" returned: 0 in 0.773s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-60165046-a5ee-47d7-a33f-f8e1c34b70a9 tempest-SnapshotDependencyTests-1564145450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-264154ad-4da3-4ac0-b509-452b8009e34b.f4e5b08c-8000-482a-bf42-49226a4446b2 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:50 devstack sudo[107121]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3cb0d350-7938-4345-8c29-348084184cdd tempest-ProjectReaderTests-1990163970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f34ec296-4e47-494e-a9d8-d762b8fd6e60.info" returned: 0 in 0.673s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:50 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-3cb0d350-7938-4345-8c29-348084184cdd tempest-ProjectReaderTests-1990163970 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f34ec296-4e47-494e-a9d8-d762b8fd6e60.info is being set with open permissions: ugo+rw Jul 10 10:27:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3cb0d350-7938-4345-8c29-348084184cdd tempest-ProjectReaderTests-1990163970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f34ec296-4e47-494e-a9d8-d762b8fd6e60.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:50 devstack sudo[107127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-264154ad-4da3-4ac0-b509-452b8009e34b.f4e5b08c-8000-482a-bf42-49226a4446b2 Jul 10 10:27:50 devstack sudo[107127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:50 devstack sudo[107128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f34ec296-4e47-494e-a9d8-d762b8fd6e60.info Jul 10 10:27:50 devstack sudo[107128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:50 devstack sudo[107127]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-60165046-a5ee-47d7-a33f-f8e1c34b70a9 tempest-SnapshotDependencyTests-1564145450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-264154ad-4da3-4ac0-b509-452b8009e34b.f4e5b08c-8000-482a-bf42-49226a4446b2" returned: 0 in 0.657s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:50 devstack sudo[107128]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-3cb0d350-7938-4345-8c29-348084184cdd tempest-ProjectReaderTests-1990163970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f34ec296-4e47-494e-a9d8-d762b8fd6e60.info" returned: 0 in 0.656s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-3cb0d350-7938-4345-8c29-348084184cdd tempest-ProjectReaderTests-1990163970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.292s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:27:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-00f3fa95-5446-4e14-ab8f-d6d1e924e211 tempest-ProjectMemberTests-915988921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.042s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:27:50 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-00f3fa95-5446-4e14-ab8f-d6d1e924e211 tempest-ProjectMemberTests-915988921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1743109965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e2643dd-e3c9-4b6f-9a1d-300534360d79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac4b039bd3aa49f393fe3462e2fed6d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:27:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:27:47Z,use_quota=True,user_id='cc3f433661ac4946825a66613f6d748c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:27:50 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-00f3fa95-5446-4e14-ab8f-d6d1e924e211 tempest-ProjectMemberTests-915988921 None] Creating volume 5e2643dd-e3c9-4b6f-9a1d-300534360d79 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:27:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-00f3fa95-5446-4e14-ab8f-d6d1e924e211 tempest-ProjectMemberTests-915988921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:27:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-00f3fa95-5446-4e14-ab8f-d6d1e924e211 tempest-ProjectMemberTests-915988921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:27:50 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-00f3fa95-5446-4e14-ab8f-d6d1e924e211 tempest-ProjectMemberTests-915988921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:27:50 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-00f3fa95-5446-4e14-ab8f-d6d1e924e211 tempest-ProjectMemberTests-915988921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:27:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-00f3fa95-5446-4e14-ab8f-d6d1e924e211 tempest-ProjectMemberTests-915988921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:27:50 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-00f3fa95-5446-4e14-ab8f-d6d1e924e211 tempest-ProjectMemberTests-915988921 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:27:50 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-00f3fa95-5446-4e14-ab8f-d6d1e924e211 tempest-ProjectMemberTests-915988921 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:27:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-00f3fa95-5446-4e14-ab8f-d6d1e924e211 tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5e2643dd-e3c9-4b6f-9a1d-300534360d79 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:50 devstack sudo[107133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5e2643dd-e3c9-4b6f-9a1d-300534360d79 1073741824 Jul 10 10:27:50 devstack sudo[107133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:50 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-60165046-a5ee-47d7-a33f-f8e1c34b70a9 tempest-SnapshotDependencyTests-1564145450 None] Lock "cinder-quobyte-f4e5b08c-8000-482a-bf42-49226a4446b2" released by "_delete_snapshot" :: held 3.107s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:27:50 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-60165046-a5ee-47d7-a33f-f8e1c34b70a9 tempest-SnapshotDependencyTests-1564145450 None] Lock "cinder-quobyte-264154ad-4da3-4ac0-b509-452b8009e34b" released by "delete_snapshot" :: held 3.136s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:27:50 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-3cb0d350-7938-4345-8c29-348084184cdd tempest-ProjectReaderTests-1990163970 None] Create snapshot completed successfully Jul 10 10:27:50 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-60165046-a5ee-47d7-a33f-f8e1c34b70a9 tempest-SnapshotDependencyTests-1564145450 None] Created reservations ['89d56271-289c-4b86-995d-ccdec5c84b4a', '2f9d83c6-c565-46da-881c-053a498f2fc5', 'ce4397f3-f542-411a-924f-273e001595ed', '12d262a8-1df5-4f76-a110-672dcc3bc9e7'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:27:51 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-60165046-a5ee-47d7-a33f-f8e1c34b70a9 tempest-SnapshotDependencyTests-1564145450 None] Delete snapshot completed successfully. Jul 10 10:27:51 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-60165046-a5ee-47d7-a33f-f8e1c34b70a9 tempest-SnapshotDependencyTests-1564145450 None] Lock "cinder-f4e5b08c-8000-482a-bf42-49226a4446b2-delete_snapshot" released by "delete_snapshot" :: held 3.270s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:27:51 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-66d29d1b-d530-41ef-a008-5cff9c665da8 tempest-ProjectReaderTests-1990163970 None] Acquiring lock "cinder-ca226875-a984-4f9f-8019-a496cdbcd801-delete_snapshot" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:27:51 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-66d29d1b-d530-41ef-a008-5cff9c665da8 tempest-ProjectReaderTests-1990163970 None] Lock "cinder-ca226875-a984-4f9f-8019-a496cdbcd801-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:27:51 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-66d29d1b-d530-41ef-a008-5cff9c665da8 tempest-ProjectReaderTests-1990163970 None] Acquiring lock "cinder-quobyte-f34ec296-4e47-494e-a9d8-d762b8fd6e60" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:27:51 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-66d29d1b-d530-41ef-a008-5cff9c665da8 tempest-ProjectReaderTests-1990163970 None] Lock "cinder-quobyte-f34ec296-4e47-494e-a9d8-d762b8fd6e60" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:27:51 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-66d29d1b-d530-41ef-a008-5cff9c665da8 tempest-ProjectReaderTests-1990163970 None] Acquiring lock "cinder-quobyte-ca226875-a984-4f9f-8019-a496cdbcd801" by "_delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:27:51 devstack sudo[107133]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-00f3fa95-5446-4e14-ab8f-d6d1e924e211 tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5e2643dd-e3c9-4b6f-9a1d-300534360d79 1073741824" returned: 0 in 0.835s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:51 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-66d29d1b-d530-41ef-a008-5cff9c665da8 tempest-ProjectReaderTests-1990163970 None] Lock "cinder-quobyte-ca226875-a984-4f9f-8019-a496cdbcd801" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:27:51 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-66d29d1b-d530-41ef-a008-5cff9c665da8 tempest-ProjectReaderTests-1990163970 None] Deleting offline snapshot ca226875-a984-4f9f-8019-a496cdbcd801 of volume f34ec296-4e47-494e-a9d8-d762b8fd6e60 {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 10:27:51 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-66d29d1b-d530-41ef-a008-5cff9c665da8 tempest-ProjectReaderTests-1990163970 None] snapshot_file for this snap is: volume-f34ec296-4e47-494e-a9d8-d762b8fd6e60.ca226875-a984-4f9f-8019-a496cdbcd801 {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 10:27:51 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac0f7f9-1419-4a00-9e56-b8cfad5e4454]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:27:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-66d29d1b-d530-41ef-a008-5cff9c665da8 tempest-ProjectReaderTests-1990163970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f34ec296-4e47-494e-a9d8-d762b8fd6e60.ca226875-a984-4f9f-8019-a496cdbcd801 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-00f3fa95-5446-4e14-ab8f-d6d1e924e211 tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5e2643dd-e3c9-4b6f-9a1d-300534360d79 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:51 devstack sudo[107140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5e2643dd-e3c9-4b6f-9a1d-300534360d79 Jul 10 10:27:51 devstack sudo[107140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:51 devstack sudo[107139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f34ec296-4e47-494e-a9d8-d762b8fd6e60.ca226875-a984-4f9f-8019-a496cdbcd801 Jul 10 10:27:51 devstack sudo[107139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:51 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f7da1928-33d2-4be8-a090-7749467ffbae tempest-SnapshotDependencyTests-1564145450 None] Acquiring lock "cinder-264154ad-4da3-4ac0-b509-452b8009e34b-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:27:52 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f7da1928-33d2-4be8-a090-7749467ffbae tempest-SnapshotDependencyTests-1564145450 None] Lock "cinder-264154ad-4da3-4ac0-b509-452b8009e34b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:27:52 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f7da1928-33d2-4be8-a090-7749467ffbae tempest-SnapshotDependencyTests-1564145450 None] Acquiring lock "cinder-quobyte-264154ad-4da3-4ac0-b509-452b8009e34b" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:27:52 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f7da1928-33d2-4be8-a090-7749467ffbae tempest-SnapshotDependencyTests-1564145450 None] Lock "cinder-quobyte-264154ad-4da3-4ac0-b509-452b8009e34b" acquired by "delete_volume" :: waited 0.017s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:27:52 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d42aa8-e865-4caf-ad5b-30e0abf8861a]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:27:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f7da1928-33d2-4be8-a090-7749467ffbae tempest-SnapshotDependencyTests-1564145450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-264154ad-4da3-4ac0-b509-452b8009e34b {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:52 devstack sudo[107143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-264154ad-4da3-4ac0-b509-452b8009e34b Jul 10 10:27:52 devstack sudo[107143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:52 devstack sudo[107140]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-00f3fa95-5446-4e14-ab8f-d6d1e924e211 tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5e2643dd-e3c9-4b6f-9a1d-300534360d79" returned: 0 in 0.718s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:52 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-00f3fa95-5446-4e14-ab8f-d6d1e924e211 tempest-ProjectMemberTests-915988921 None] <== create_volume: return (1629ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:27:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-00f3fa95-5446-4e14-ab8f-d6d1e924e211 tempest-ProjectMemberTests-915988921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.634s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:27:52 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-00f3fa95-5446-4e14-ab8f-d6d1e924e211 tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86511cb6-350b-4113-9a7f-a08109b8f450) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e2643dd-e3c9-4b6f-9a1d-300534360d79', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:27:52 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-00f3fa95-5446-4e14-ab8f-d6d1e924e211 tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af8100ee-cbe1-4182-ab9e-d03fa2f8b982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:27:52 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-00f3fa95-5446-4e14-ab8f-d6d1e924e211 tempest-ProjectMemberTests-915988921 None] Volume volume-5e2643dd-e3c9-4b6f-9a1d-300534360d79 (5e2643dd-e3c9-4b6f-9a1d-300534360d79): created successfully Jul 10 10:27:52 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-00f3fa95-5446-4e14-ab8f-d6d1e924e211 tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af8100ee-cbe1-4182-ab9e-d03fa2f8b982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:27:52 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-00f3fa95-5446-4e14-ab8f-d6d1e924e211 tempest-ProjectMemberTests-915988921 None] Flow 'volume_create_manager' (f881ae65-36be-4c8e-80a5-df720a0ad442) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:27:52 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-00f3fa95-5446-4e14-ab8f-d6d1e924e211 tempest-ProjectMemberTests-915988921 None] Created volume successfully. Jul 10 10:27:52 devstack sudo[107139]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-66d29d1b-d530-41ef-a008-5cff9c665da8 tempest-ProjectReaderTests-1990163970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f34ec296-4e47-494e-a9d8-d762b8fd6e60.ca226875-a984-4f9f-8019-a496cdbcd801" returned: 0 in 0.832s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:52 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-66d29d1b-d530-41ef-a008-5cff9c665da8 tempest-ProjectReaderTests-1990163970 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f34ec296-4e47-494e-a9d8-d762b8fd6e60(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 10:27:52 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea610d90-e5ca-4ced-9d29-5763381df2f0]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:27:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-66d29d1b-d530-41ef-a008-5cff9c665da8 tempest-ProjectReaderTests-1990163970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f34ec296-4e47-494e-a9d8-d762b8fd6e60 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:52 devstack sudo[107149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f34ec296-4e47-494e-a9d8-d762b8fd6e60 Jul 10 10:27:52 devstack sudo[107149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:52 devstack sudo[107143]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f7da1928-33d2-4be8-a090-7749467ffbae tempest-SnapshotDependencyTests-1564145450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-264154ad-4da3-4ac0-b509-452b8009e34b" returned: 0 in 0.791s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f7da1928-33d2-4be8-a090-7749467ffbae tempest-SnapshotDependencyTests-1564145450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-264154ad-4da3-4ac0-b509-452b8009e34b {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:52 devstack sudo[107154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-264154ad-4da3-4ac0-b509-452b8009e34b Jul 10 10:27:52 devstack sudo[107154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-48c868d3-0396-4f49-a980-c1c7fba67e96 tempest-ProjectMemberTests-915988921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:27:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-48c868d3-0396-4f49-a980-c1c7fba67e96 tempest-ProjectMemberTests-915988921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:27:53 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-48c868d3-0396-4f49-a980-c1c7fba67e96 tempest-ProjectMemberTests-915988921 None] Creating offline snapshot 1b4c96dd-4746-4279-a5f0-4ff78745f3b4 of volume 5e2643dd-e3c9-4b6f-9a1d-300534360d79 {{(pid=87234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 10:27:53 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f39fae8-a071-471a-aa0f-ffa55eff7f5d]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:27:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-48c868d3-0396-4f49-a980-c1c7fba67e96 tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5e2643dd-e3c9-4b6f-9a1d-300534360d79 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:53 devstack sudo[107156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5e2643dd-e3c9-4b6f-9a1d-300534360d79 Jul 10 10:27:53 devstack sudo[107156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:53 devstack sudo[107149]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-66d29d1b-d530-41ef-a008-5cff9c665da8 tempest-ProjectReaderTests-1990163970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f34ec296-4e47-494e-a9d8-d762b8fd6e60" returned: 0 in 0.830s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-66d29d1b-d530-41ef-a008-5cff9c665da8 tempest-ProjectReaderTests-1990163970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f34ec296-4e47-494e-a9d8-d762b8fd6e60.ca226875-a984-4f9f-8019-a496cdbcd801 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:53 devstack sudo[107161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f34ec296-4e47-494e-a9d8-d762b8fd6e60.ca226875-a984-4f9f-8019-a496cdbcd801 Jul 10 10:27:53 devstack sudo[107161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:53 devstack sudo[107154]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f7da1928-33d2-4be8-a090-7749467ffbae tempest-SnapshotDependencyTests-1564145450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-264154ad-4da3-4ac0-b509-452b8009e34b" returned: 0 in 0.704s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:53 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f7da1928-33d2-4be8-a090-7749467ffbae tempest-SnapshotDependencyTests-1564145450 None] Lock "cinder-quobyte-264154ad-4da3-4ac0-b509-452b8009e34b" released by "delete_volume" :: held 1.570s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:27:53 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-f7da1928-33d2-4be8-a090-7749467ffbae tempest-SnapshotDependencyTests-1564145450 None] Created reservations ['f0a26eef-3ce3-44ce-9d2b-ba2e8ac63947', '66b6fb37-5e53-49d8-b712-dfa76bd585e7', '0d74fcd1-f1b8-44cf-8592-c479d55f58f5', 'f189aef3-e17e-4331-aa96-2afc81f6b181'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:27:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f7da1928-33d2-4be8-a090-7749467ffbae tempest-SnapshotDependencyTests-1564145450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:27:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f7da1928-33d2-4be8-a090-7749467ffbae tempest-SnapshotDependencyTests-1564145450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:27:53 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f7da1928-33d2-4be8-a090-7749467ffbae tempest-SnapshotDependencyTests-1564145450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:27:53 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f7da1928-33d2-4be8-a090-7749467ffbae tempest-SnapshotDependencyTests-1564145450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:27:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f7da1928-33d2-4be8-a090-7749467ffbae tempest-SnapshotDependencyTests-1564145450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:27:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f7da1928-33d2-4be8-a090-7749467ffbae tempest-SnapshotDependencyTests-1564145450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:53 devstack sudo[107164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:27:53 devstack sudo[107164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:54 devstack sudo[107156]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:54 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-48c868d3-0396-4f49-a980-c1c7fba67e96 tempest-ProjectMemberTests-915988921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5e2643dd-e3c9-4b6f-9a1d-300534360d79" returned: 0 in 0.850s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:54 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-48c868d3-0396-4f49-a980-c1c7fba67e96 tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5e2643dd-e3c9-4b6f-9a1d-300534360d79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5e2643dd-e3c9-4b6f-9a1d-300534360d79.1b4c96dd-4746-4279-a5f0-4ff78745f3b4 1G {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:54 devstack sudo[107172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5e2643dd-e3c9-4b6f-9a1d-300534360d79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5e2643dd-e3c9-4b6f-9a1d-300534360d79.1b4c96dd-4746-4279-a5f0-4ff78745f3b4 1G Jul 10 10:27:54 devstack sudo[107172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:54 devstack sudo[107161]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:54 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-66d29d1b-d530-41ef-a008-5cff9c665da8 tempest-ProjectReaderTests-1990163970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f34ec296-4e47-494e-a9d8-d762b8fd6e60.ca226875-a984-4f9f-8019-a496cdbcd801" returned: 0 in 0.774s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:54 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-66d29d1b-d530-41ef-a008-5cff9c665da8 tempest-ProjectReaderTests-1990163970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f34ec296-4e47-494e-a9d8-d762b8fd6e60.ca226875-a984-4f9f-8019-a496cdbcd801 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:54 devstack sudo[107174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f34ec296-4e47-494e-a9d8-d762b8fd6e60.ca226875-a984-4f9f-8019-a496cdbcd801 Jul 10 10:27:54 devstack sudo[107174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:54 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-9fd24ebf-bab5-4e9b-8e4e-d1d0041f40db tempest-SnapshotDependencyTests-1564145450 None] Acquiring lock "cinder-d7779011-7322-471e-9140-2d418155dbfb-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:27:54 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-9fd24ebf-bab5-4e9b-8e4e-d1d0041f40db tempest-SnapshotDependencyTests-1564145450 None] Lock "cinder-d7779011-7322-471e-9140-2d418155dbfb-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:27:54 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-9fd24ebf-bab5-4e9b-8e4e-d1d0041f40db tempest-SnapshotDependencyTests-1564145450 None] Acquiring lock "cinder-quobyte-d7779011-7322-471e-9140-2d418155dbfb" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:27:54 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-9fd24ebf-bab5-4e9b-8e4e-d1d0041f40db tempest-SnapshotDependencyTests-1564145450 None] Lock "cinder-quobyte-d7779011-7322-471e-9140-2d418155dbfb" acquired by "delete_volume" :: waited 0.027s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:27:54 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[96baa3c4-d9ac-4db8-b0a2-77c611df66e6]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:27:54 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9fd24ebf-bab5-4e9b-8e4e-d1d0041f40db tempest-SnapshotDependencyTests-1564145450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d7779011-7322-471e-9140-2d418155dbfb {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:54 devstack sudo[107164]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:54 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f7da1928-33d2-4be8-a090-7749467ffbae tempest-SnapshotDependencyTests-1564145450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.709s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:54 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-f7da1928-33d2-4be8-a090-7749467ffbae tempest-SnapshotDependencyTests-1564145450 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:27:54 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-f7da1928-33d2-4be8-a090-7749467ffbae tempest-SnapshotDependencyTests-1564145450 None] Deleted volume successfully. Jul 10 10:27:54 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f7da1928-33d2-4be8-a090-7749467ffbae tempest-SnapshotDependencyTests-1564145450 None] Lock "cinder-264154ad-4da3-4ac0-b509-452b8009e34b-delete_volume" released by "delete_volume" :: held 2.543s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:27:54 devstack sudo[107177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d7779011-7322-471e-9140-2d418155dbfb Jul 10 10:27:54 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:55 devstack sudo[107172]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:55 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-48c868d3-0396-4f49-a980-c1c7fba67e96 tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5e2643dd-e3c9-4b6f-9a1d-300534360d79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5e2643dd-e3c9-4b6f-9a1d-300534360d79.1b4c96dd-4746-4279-a5f0-4ff78745f3b4 1G" returned: 0 in 0.900s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:55 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-48c868d3-0396-4f49-a980-c1c7fba67e96 tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e2643dd-e3c9-4b6f-9a1d-300534360d79 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5e2643dd-e3c9-4b6f-9a1d-300534360d79.1b4c96dd-4746-4279-a5f0-4ff78745f3b4 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:55 devstack sudo[107174]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:55 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-66d29d1b-d530-41ef-a008-5cff9c665da8 tempest-ProjectReaderTests-1990163970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f34ec296-4e47-494e-a9d8-d762b8fd6e60.ca226875-a984-4f9f-8019-a496cdbcd801" returned: 0 in 0.803s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:55 devstack sudo[107184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e2643dd-e3c9-4b6f-9a1d-300534360d79 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5e2643dd-e3c9-4b6f-9a1d-300534360d79.1b4c96dd-4746-4279-a5f0-4ff78745f3b4 Jul 10 10:27:55 devstack sudo[107184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:55 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-66d29d1b-d530-41ef-a008-5cff9c665da8 tempest-ProjectReaderTests-1990163970 None] Lock "cinder-quobyte-ca226875-a984-4f9f-8019-a496cdbcd801" released by "_delete_snapshot" :: held 3.345s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:27:55 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-66d29d1b-d530-41ef-a008-5cff9c665da8 tempest-ProjectReaderTests-1990163970 None] Lock "cinder-quobyte-f34ec296-4e47-494e-a9d8-d762b8fd6e60" released by "delete_snapshot" :: held 3.375s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:27:55 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-66d29d1b-d530-41ef-a008-5cff9c665da8 tempest-ProjectReaderTests-1990163970 None] Created reservations ['1bf53532-c1db-485d-abb1-88d868aa66ac', '35a9b505-17ca-4711-9abb-399c616f85ba', 'd8f8fb2f-15e4-48b8-93da-8e34c5d526ae', '279b8f14-d001-4831-afeb-28a775ca5cff'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:27:55 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-66d29d1b-d530-41ef-a008-5cff9c665da8 tempest-ProjectReaderTests-1990163970 None] Delete snapshot completed successfully. Jul 10 10:27:55 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-66d29d1b-d530-41ef-a008-5cff9c665da8 tempest-ProjectReaderTests-1990163970 None] Lock "cinder-ca226875-a984-4f9f-8019-a496cdbcd801-delete_snapshot" released by "delete_snapshot" :: held 3.531s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:27:55 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:55 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9fd24ebf-bab5-4e9b-8e4e-d1d0041f40db tempest-SnapshotDependencyTests-1564145450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d7779011-7322-471e-9140-2d418155dbfb" returned: 0 in 0.908s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:55 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9fd24ebf-bab5-4e9b-8e4e-d1d0041f40db tempest-SnapshotDependencyTests-1564145450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d7779011-7322-471e-9140-2d418155dbfb {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:55 devstack sudo[107189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d7779011-7322-471e-9140-2d418155dbfb Jul 10 10:27:55 devstack sudo[107189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:55 devstack sudo[107184]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:55 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-48c868d3-0396-4f49-a980-c1c7fba67e96 tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e2643dd-e3c9-4b6f-9a1d-300534360d79 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5e2643dd-e3c9-4b6f-9a1d-300534360d79.1b4c96dd-4746-4279-a5f0-4ff78745f3b4" returned: 0 in 0.722s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:55 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-48c868d3-0396-4f49-a980-c1c7fba67e96 tempest-ProjectMemberTests-915988921 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5e2643dd-e3c9-4b6f-9a1d-300534360d79.1b4c96dd-4746-4279-a5f0-4ff78745f3b4 is being set with open permissions: ugo+rw Jul 10 10:27:55 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-48c868d3-0396-4f49-a980-c1c7fba67e96 tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5e2643dd-e3c9-4b6f-9a1d-300534360d79.1b4c96dd-4746-4279-a5f0-4ff78745f3b4 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:55 devstack sudo[107194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5e2643dd-e3c9-4b6f-9a1d-300534360d79.1b4c96dd-4746-4279-a5f0-4ff78745f3b4 Jul 10 10:27:55 devstack sudo[107194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:55 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-284fdeae-d272-4a46-8eda-bfc4353b9002 tempest-ProjectReaderTests-1990163970 None] Acquiring lock "cinder-f34ec296-4e47-494e-a9d8-d762b8fd6e60-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:27:55 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-284fdeae-d272-4a46-8eda-bfc4353b9002 tempest-ProjectReaderTests-1990163970 None] Lock "cinder-f34ec296-4e47-494e-a9d8-d762b8fd6e60-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:27:56 devstack sudo[107189]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9fd24ebf-bab5-4e9b-8e4e-d1d0041f40db tempest-SnapshotDependencyTests-1564145450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-d7779011-7322-471e-9140-2d418155dbfb" returned: 0 in 0.670s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:56 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-284fdeae-d272-4a46-8eda-bfc4353b9002 tempest-ProjectReaderTests-1990163970 None] Acquiring lock "cinder-quobyte-f34ec296-4e47-494e-a9d8-d762b8fd6e60" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:27:56 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-9fd24ebf-bab5-4e9b-8e4e-d1d0041f40db tempest-SnapshotDependencyTests-1564145450 None] Lock "cinder-quobyte-d7779011-7322-471e-9140-2d418155dbfb" released by "delete_volume" :: held 1.636s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:27:56 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-284fdeae-d272-4a46-8eda-bfc4353b9002 tempest-ProjectReaderTests-1990163970 None] Lock "cinder-quobyte-f34ec296-4e47-494e-a9d8-d762b8fd6e60" acquired by "delete_volume" :: waited 0.021s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:27:56 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[2459c221-51ae-4613-a305-d31f124d8fe5]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:27:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-284fdeae-d272-4a46-8eda-bfc4353b9002 tempest-ProjectReaderTests-1990163970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f34ec296-4e47-494e-a9d8-d762b8fd6e60 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:56 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-9fd24ebf-bab5-4e9b-8e4e-d1d0041f40db tempest-SnapshotDependencyTests-1564145450 None] Created reservations ['92f99dfc-4765-4b6f-947c-97ea57d69a91', 'a53fc2ae-9108-4bbc-bb8b-539a66d7fdb4', 'dc41cfb1-e24f-4562-a746-0de93a1f011d', '51d04960-8efc-4ce5-8fbf-68661e1dc5fd'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:27:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-9fd24ebf-bab5-4e9b-8e4e-d1d0041f40db tempest-SnapshotDependencyTests-1564145450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:27:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-9fd24ebf-bab5-4e9b-8e4e-d1d0041f40db tempest-SnapshotDependencyTests-1564145450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:27:56 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-9fd24ebf-bab5-4e9b-8e4e-d1d0041f40db tempest-SnapshotDependencyTests-1564145450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:27:56 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-9fd24ebf-bab5-4e9b-8e4e-d1d0041f40db tempest-SnapshotDependencyTests-1564145450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:27:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-9fd24ebf-bab5-4e9b-8e4e-d1d0041f40db tempest-SnapshotDependencyTests-1564145450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:27:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9fd24ebf-bab5-4e9b-8e4e-d1d0041f40db tempest-SnapshotDependencyTests-1564145450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:56 devstack sudo[107197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f34ec296-4e47-494e-a9d8-d762b8fd6e60 Jul 10 10:27:56 devstack sudo[107197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:56 devstack sudo[107199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:27:56 devstack sudo[107199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:56 devstack sudo[107194]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-48c868d3-0396-4f49-a980-c1c7fba67e96 tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5e2643dd-e3c9-4b6f-9a1d-300534360d79.1b4c96dd-4746-4279-a5f0-4ff78745f3b4" returned: 0 in 0.714s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-48c868d3-0396-4f49-a980-c1c7fba67e96 tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5e2643dd-e3c9-4b6f-9a1d-300534360d79.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:56 devstack sudo[107202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5e2643dd-e3c9-4b6f-9a1d-300534360d79.info Jul 10 10:27:56 devstack sudo[107202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:56 devstack sudo[107199]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:56 devstack sudo[107197]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9fd24ebf-bab5-4e9b-8e4e-d1d0041f40db tempest-SnapshotDependencyTests-1564145450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.748s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:56 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-9fd24ebf-bab5-4e9b-8e4e-d1d0041f40db tempest-SnapshotDependencyTests-1564145450 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:27:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-284fdeae-d272-4a46-8eda-bfc4353b9002 tempest-ProjectReaderTests-1990163970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f34ec296-4e47-494e-a9d8-d762b8fd6e60" returned: 0 in 0.872s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-284fdeae-d272-4a46-8eda-bfc4353b9002 tempest-ProjectReaderTests-1990163970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f34ec296-4e47-494e-a9d8-d762b8fd6e60 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:57 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-9fd24ebf-bab5-4e9b-8e4e-d1d0041f40db tempest-SnapshotDependencyTests-1564145450 None] Deleted volume successfully. Jul 10 10:27:57 devstack sudo[107209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f34ec296-4e47-494e-a9d8-d762b8fd6e60 Jul 10 10:27:57 devstack sudo[107209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:57 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-9fd24ebf-bab5-4e9b-8e4e-d1d0041f40db tempest-SnapshotDependencyTests-1564145450 None] Lock "cinder-d7779011-7322-471e-9140-2d418155dbfb-delete_volume" released by "delete_volume" :: held 2.709s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:27:57 devstack sudo[107202]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:57 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-48c868d3-0396-4f49-a980-c1c7fba67e96 tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5e2643dd-e3c9-4b6f-9a1d-300534360d79.info" returned: 0 in 0.761s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:57 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-48c868d3-0396-4f49-a980-c1c7fba67e96 tempest-ProjectMemberTests-915988921 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5e2643dd-e3c9-4b6f-9a1d-300534360d79.info is being set with open permissions: ugo+rw Jul 10 10:27:57 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-48c868d3-0396-4f49-a980-c1c7fba67e96 tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5e2643dd-e3c9-4b6f-9a1d-300534360d79.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:57 devstack sudo[107212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5e2643dd-e3c9-4b6f-9a1d-300534360d79.info Jul 10 10:27:57 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:57 devstack sudo[107209]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:57 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-284fdeae-d272-4a46-8eda-bfc4353b9002 tempest-ProjectReaderTests-1990163970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f34ec296-4e47-494e-a9d8-d762b8fd6e60" returned: 0 in 0.672s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:57 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-284fdeae-d272-4a46-8eda-bfc4353b9002 tempest-ProjectReaderTests-1990163970 None] Lock "cinder-quobyte-f34ec296-4e47-494e-a9d8-d762b8fd6e60" released by "delete_volume" :: held 1.617s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:27:57 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-284fdeae-d272-4a46-8eda-bfc4353b9002 tempest-ProjectReaderTests-1990163970 None] Created reservations ['a30c9a8e-5b15-4ffc-8d93-acb42d6fe9c8', 'e21955af-ea56-498e-97f3-74233888e560', '17ec14f0-c3f9-4771-a37d-8ff3589fa1eb', '1326a9a3-8f91-4e96-93bd-3e6697700aa7'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:27:57 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-284fdeae-d272-4a46-8eda-bfc4353b9002 tempest-ProjectReaderTests-1990163970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:27:57 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-284fdeae-d272-4a46-8eda-bfc4353b9002 tempest-ProjectReaderTests-1990163970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:27:57 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-284fdeae-d272-4a46-8eda-bfc4353b9002 tempest-ProjectReaderTests-1990163970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:27:57 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-284fdeae-d272-4a46-8eda-bfc4353b9002 tempest-ProjectReaderTests-1990163970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:27:57 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-284fdeae-d272-4a46-8eda-bfc4353b9002 tempest-ProjectReaderTests-1990163970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:27:57 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-284fdeae-d272-4a46-8eda-bfc4353b9002 tempest-ProjectReaderTests-1990163970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:57 devstack sudo[107217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:27:57 devstack sudo[107217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:58 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-48c868d3-0396-4f49-a980-c1c7fba67e96 tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5e2643dd-e3c9-4b6f-9a1d-300534360d79.info" returned: 0 in 0.769s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-48c868d3-0396-4f49-a980-c1c7fba67e96 tempest-ProjectMemberTests-915988921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.809s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:27:58 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-48c868d3-0396-4f49-a980-c1c7fba67e96 tempest-ProjectMemberTests-915988921 None] Create snapshot completed successfully Jul 10 10:27:58 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-57dbdfc4-7ba4-434f-a9a3-00b3c6f1b3ec tempest-ProjectMemberTests-915988921 None] Acquiring lock "cinder-1b4c96dd-4746-4279-a5f0-4ff78745f3b4-delete_snapshot" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:27:58 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-57dbdfc4-7ba4-434f-a9a3-00b3c6f1b3ec tempest-ProjectMemberTests-915988921 None] Lock "cinder-1b4c96dd-4746-4279-a5f0-4ff78745f3b4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:27:58 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-57dbdfc4-7ba4-434f-a9a3-00b3c6f1b3ec tempest-ProjectMemberTests-915988921 None] Acquiring lock "cinder-quobyte-5e2643dd-e3c9-4b6f-9a1d-300534360d79" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:27:58 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-57dbdfc4-7ba4-434f-a9a3-00b3c6f1b3ec tempest-ProjectMemberTests-915988921 None] Lock "cinder-quobyte-5e2643dd-e3c9-4b6f-9a1d-300534360d79" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:27:58 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-57dbdfc4-7ba4-434f-a9a3-00b3c6f1b3ec tempest-ProjectMemberTests-915988921 None] Acquiring lock "cinder-quobyte-1b4c96dd-4746-4279-a5f0-4ff78745f3b4" by "_delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:27:58 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-57dbdfc4-7ba4-434f-a9a3-00b3c6f1b3ec tempest-ProjectMemberTests-915988921 None] Lock "cinder-quobyte-1b4c96dd-4746-4279-a5f0-4ff78745f3b4" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:27:58 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-57dbdfc4-7ba4-434f-a9a3-00b3c6f1b3ec tempest-ProjectMemberTests-915988921 None] Deleting offline snapshot 1b4c96dd-4746-4279-a5f0-4ff78745f3b4 of volume 5e2643dd-e3c9-4b6f-9a1d-300534360d79 {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 10:27:58 devstack sudo[107217]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:58 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-57dbdfc4-7ba4-434f-a9a3-00b3c6f1b3ec tempest-ProjectMemberTests-915988921 None] snapshot_file for this snap is: volume-5e2643dd-e3c9-4b6f-9a1d-300534360d79.1b4c96dd-4746-4279-a5f0-4ff78745f3b4 {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 10:27:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-284fdeae-d272-4a46-8eda-bfc4353b9002 tempest-ProjectReaderTests-1990163970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.805s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:58 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-284fdeae-d272-4a46-8eda-bfc4353b9002 tempest-ProjectReaderTests-1990163970 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:27:58 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-284fdeae-d272-4a46-8eda-bfc4353b9002 tempest-ProjectReaderTests-1990163970 None] Deleted volume successfully. Jul 10 10:27:58 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[316452ad-0459-44d0-b3c6-535d3810a424]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:27:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-57dbdfc4-7ba4-434f-a9a3-00b3c6f1b3ec tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5e2643dd-e3c9-4b6f-9a1d-300534360d79.1b4c96dd-4746-4279-a5f0-4ff78745f3b4 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:58 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-284fdeae-d272-4a46-8eda-bfc4353b9002 tempest-ProjectReaderTests-1990163970 None] Lock "cinder-f34ec296-4e47-494e-a9d8-d762b8fd6e60-delete_volume" released by "delete_volume" :: held 2.708s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:27:58 devstack sudo[107222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5e2643dd-e3c9-4b6f-9a1d-300534360d79.1b4c96dd-4746-4279-a5f0-4ff78745f3b4 Jul 10 10:27:58 devstack sudo[107222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:58 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-5153e433-94cc-415d-80e8-c076eb1b4d7b tempest-ProjectReaderTests-1990163970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:27:58 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5153e433-94cc-415d-80e8-c076eb1b4d7b tempest-ProjectReaderTests-1990163970 None] Flow 'volume_create_manager' (2f74a2e9-645c-403e-ab3a-4d08e097d52b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:27:58 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5153e433-94cc-415d-80e8-c076eb1b4d7b tempest-ProjectReaderTests-1990163970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f60ae2f-9350-4f33-80b5-38a1df76539a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:27:58 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5153e433-94cc-415d-80e8-c076eb1b4d7b tempest-ProjectReaderTests-1990163970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f60ae2f-9350-4f33-80b5-38a1df76539a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:27:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-604944967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=046e7d74-d81a-4aad-802c-3b131250e9a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9005996ee3c4fd79ff943ddef70d6a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:27:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:27:59Z,use_quota=True,user_id='af3da7e2db214368a3fb84a8cc08b50d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:27:58 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5153e433-94cc-415d-80e8-c076eb1b4d7b tempest-ProjectReaderTests-1990163970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ecec084-f77a-43af-bc55-2ff1bdddde3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:27:58 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5153e433-94cc-415d-80e8-c076eb1b4d7b tempest-ProjectReaderTests-1990163970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ecec084-f77a-43af-bc55-2ff1bdddde3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:27:58 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5153e433-94cc-415d-80e8-c076eb1b4d7b tempest-ProjectReaderTests-1990163970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd5b7190-90dc-4620-a0d1-42153f889b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:27:58 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5153e433-94cc-415d-80e8-c076eb1b4d7b tempest-ProjectReaderTests-1990163970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd5b7190-90dc-4620-a0d1-42153f889b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '046e7d74-d81a-4aad-802c-3b131250e9a3', 'volume_name': 'volume-046e7d74-d81a-4aad-802c-3b131250e9a3', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:27:58 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5153e433-94cc-415d-80e8-c076eb1b4d7b tempest-ProjectReaderTests-1990163970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4ab0fd9-f955-43bc-bb78-51298c26e1dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:27:58 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5153e433-94cc-415d-80e8-c076eb1b4d7b tempest-ProjectReaderTests-1990163970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4ab0fd9-f955-43bc-bb78-51298c26e1dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:27:58 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5153e433-94cc-415d-80e8-c076eb1b4d7b tempest-ProjectReaderTests-1990163970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dda9e7c5-b99e-4c70-a762-b56b77103d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:27:58 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-5153e433-94cc-415d-80e8-c076eb1b4d7b tempest-ProjectReaderTests-1990163970 None] Volume 046e7d74-d81a-4aad-802c-3b131250e9a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-046e7d74-d81a-4aad-802c-3b131250e9a3', 'volume_size': 1} Jul 10 10:27:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-5153e433-94cc-415d-80e8-c076eb1b4d7b tempest-ProjectReaderTests-1990163970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:27:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-5153e433-94cc-415d-80e8-c076eb1b4d7b tempest-ProjectReaderTests-1990163970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:27:58 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-5153e433-94cc-415d-80e8-c076eb1b4d7b tempest-ProjectReaderTests-1990163970 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:27:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-604944967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=046e7d74-d81a-4aad-802c-3b131250e9a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9005996ee3c4fd79ff943ddef70d6a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:27:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:27:59Z,use_quota=True,user_id='af3da7e2db214368a3fb84a8cc08b50d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:27:58 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-5153e433-94cc-415d-80e8-c076eb1b4d7b tempest-ProjectReaderTests-1990163970 None] Creating volume 046e7d74-d81a-4aad-802c-3b131250e9a3 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:27:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-5153e433-94cc-415d-80e8-c076eb1b4d7b tempest-ProjectReaderTests-1990163970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:27:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-5153e433-94cc-415d-80e8-c076eb1b4d7b tempest-ProjectReaderTests-1990163970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:27:58 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-5153e433-94cc-415d-80e8-c076eb1b4d7b tempest-ProjectReaderTests-1990163970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:27:58 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-5153e433-94cc-415d-80e8-c076eb1b4d7b tempest-ProjectReaderTests-1990163970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:27:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-5153e433-94cc-415d-80e8-c076eb1b4d7b tempest-ProjectReaderTests-1990163970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:27:58 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-5153e433-94cc-415d-80e8-c076eb1b4d7b tempest-ProjectReaderTests-1990163970 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:27:58 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-5153e433-94cc-415d-80e8-c076eb1b4d7b tempest-ProjectReaderTests-1990163970 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:27:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5153e433-94cc-415d-80e8-c076eb1b4d7b tempest-ProjectReaderTests-1990163970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-046e7d74-d81a-4aad-802c-3b131250e9a3 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:58 devstack sudo[107224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-046e7d74-d81a-4aad-802c-3b131250e9a3 1073741824 Jul 10 10:27:58 devstack sudo[107224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:27:59 devstack sudo[107222]: pam_unix(sudo:session): session closed for user root Jul 10 10:27:59 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-57dbdfc4-7ba4-434f-a9a3-00b3c6f1b3ec tempest-ProjectMemberTests-915988921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5e2643dd-e3c9-4b6f-9a1d-300534360d79.1b4c96dd-4746-4279-a5f0-4ff78745f3b4" returned: 0 in 0.829s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:27:59 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-57dbdfc4-7ba4-434f-a9a3-00b3c6f1b3ec tempest-ProjectMemberTests-915988921 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e2643dd-e3c9-4b6f-9a1d-300534360d79(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 10:27:59 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[1618c20a-1e3b-4d0d-a596-f8e095c8eec3]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:27:59 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-57dbdfc4-7ba4-434f-a9a3-00b3c6f1b3ec tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5e2643dd-e3c9-4b6f-9a1d-300534360d79 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:27:59 devstack sudo[107229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5e2643dd-e3c9-4b6f-9a1d-300534360d79 Jul 10 10:27:59 devstack sudo[107229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:00 devstack sudo[107224]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:00 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5153e433-94cc-415d-80e8-c076eb1b4d7b tempest-ProjectReaderTests-1990163970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-046e7d74-d81a-4aad-802c-3b131250e9a3 1073741824" returned: 0 in 1.057s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:00 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5153e433-94cc-415d-80e8-c076eb1b4d7b tempest-ProjectReaderTests-1990163970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-046e7d74-d81a-4aad-802c-3b131250e9a3 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:00 devstack sudo[107235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-046e7d74-d81a-4aad-802c-3b131250e9a3 Jul 10 10:28:00 devstack sudo[107235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:00 devstack sudo[107229]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:00 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-57dbdfc4-7ba4-434f-a9a3-00b3c6f1b3ec tempest-ProjectMemberTests-915988921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5e2643dd-e3c9-4b6f-9a1d-300534360d79" returned: 0 in 0.943s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:00 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-57dbdfc4-7ba4-434f-a9a3-00b3c6f1b3ec tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5e2643dd-e3c9-4b6f-9a1d-300534360d79.1b4c96dd-4746-4279-a5f0-4ff78745f3b4 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:00 devstack sudo[107241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5e2643dd-e3c9-4b6f-9a1d-300534360d79.1b4c96dd-4746-4279-a5f0-4ff78745f3b4 Jul 10 10:28:00 devstack sudo[107241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:00 devstack sudo[107235]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:00 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-5153e433-94cc-415d-80e8-c076eb1b4d7b tempest-ProjectReaderTests-1990163970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-046e7d74-d81a-4aad-802c-3b131250e9a3" returned: 0 in 0.758s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:00 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-5153e433-94cc-415d-80e8-c076eb1b4d7b tempest-ProjectReaderTests-1990163970 None] <== create_volume: return (1871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:28:00 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-5153e433-94cc-415d-80e8-c076eb1b4d7b tempest-ProjectReaderTests-1990163970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.874s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:28:00 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5153e433-94cc-415d-80e8-c076eb1b4d7b tempest-ProjectReaderTests-1990163970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dda9e7c5-b99e-4c70-a762-b56b77103d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-046e7d74-d81a-4aad-802c-3b131250e9a3', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:28:00 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5153e433-94cc-415d-80e8-c076eb1b4d7b tempest-ProjectReaderTests-1990163970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34b01293-9217-4527-992b-6c8b645ab0f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:28:00 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-5153e433-94cc-415d-80e8-c076eb1b4d7b tempest-ProjectReaderTests-1990163970 None] Volume volume-046e7d74-d81a-4aad-802c-3b131250e9a3 (046e7d74-d81a-4aad-802c-3b131250e9a3): created successfully Jul 10 10:28:00 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5153e433-94cc-415d-80e8-c076eb1b4d7b tempest-ProjectReaderTests-1990163970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34b01293-9217-4527-992b-6c8b645ab0f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:28:00 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-5153e433-94cc-415d-80e8-c076eb1b4d7b tempest-ProjectReaderTests-1990163970 None] Flow 'volume_create_manager' (2f74a2e9-645c-403e-ab3a-4d08e097d52b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:28:00 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-5153e433-94cc-415d-80e8-c076eb1b4d7b tempest-ProjectReaderTests-1990163970 None] Created volume successfully. Jul 10 10:28:01 devstack sudo[107241]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:01 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-57dbdfc4-7ba4-434f-a9a3-00b3c6f1b3ec tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5e2643dd-e3c9-4b6f-9a1d-300534360d79.1b4c96dd-4746-4279-a5f0-4ff78745f3b4" returned: 0 in 0.880s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:01 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-57dbdfc4-7ba4-434f-a9a3-00b3c6f1b3ec tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5e2643dd-e3c9-4b6f-9a1d-300534360d79.1b4c96dd-4746-4279-a5f0-4ff78745f3b4 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:01 devstack sudo[107247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5e2643dd-e3c9-4b6f-9a1d-300534360d79.1b4c96dd-4746-4279-a5f0-4ff78745f3b4 Jul 10 10:28:01 devstack sudo[107247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:02 devstack sudo[107247]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-57dbdfc4-7ba4-434f-a9a3-00b3c6f1b3ec tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5e2643dd-e3c9-4b6f-9a1d-300534360d79.1b4c96dd-4746-4279-a5f0-4ff78745f3b4" returned: 0 in 0.686s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:02 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-57dbdfc4-7ba4-434f-a9a3-00b3c6f1b3ec tempest-ProjectMemberTests-915988921 None] Lock "cinder-quobyte-1b4c96dd-4746-4279-a5f0-4ff78745f3b4" released by "_delete_snapshot" :: held 3.495s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:28:02 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-57dbdfc4-7ba4-434f-a9a3-00b3c6f1b3ec tempest-ProjectMemberTests-915988921 None] Lock "cinder-quobyte-5e2643dd-e3c9-4b6f-9a1d-300534360d79" released by "delete_snapshot" :: held 3.524s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:28:02 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-57dbdfc4-7ba4-434f-a9a3-00b3c6f1b3ec tempest-ProjectMemberTests-915988921 None] Created reservations ['1579edb3-c5ce-48d1-b94e-7bad69b92257', '763788ab-dd77-4300-9807-d06536ba6247', '3517b9f0-e0f5-459c-9067-0ea0bec72851', 'f6709a9a-7a42-452f-834e-57a962edeb47'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:28:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-fd537daa-4995-41f3-871a-c31c35f9c7cd tempest-ProjectReaderTests-1990163970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:28:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-fd537daa-4995-41f3-871a-c31c35f9c7cd tempest-ProjectReaderTests-1990163970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:28:02 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-57dbdfc4-7ba4-434f-a9a3-00b3c6f1b3ec tempest-ProjectMemberTests-915988921 None] Delete snapshot completed successfully. Jul 10 10:28:02 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-57dbdfc4-7ba4-434f-a9a3-00b3c6f1b3ec tempest-ProjectMemberTests-915988921 None] Lock "cinder-1b4c96dd-4746-4279-a5f0-4ff78745f3b4-delete_snapshot" released by "delete_snapshot" :: held 3.732s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:28:02 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-fd537daa-4995-41f3-871a-c31c35f9c7cd tempest-ProjectReaderTests-1990163970 None] Creating offline snapshot f6f953e3-87f7-408e-b4a8-fb5295de573a of volume 046e7d74-d81a-4aad-802c-3b131250e9a3 {{(pid=87234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 10:28:02 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce4408a5-dd01-4f05-a5f5-c2a039a3ae9c]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:28:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fd537daa-4995-41f3-871a-c31c35f9c7cd tempest-ProjectReaderTests-1990163970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-046e7d74-d81a-4aad-802c-3b131250e9a3 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:02 devstack sudo[107251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-046e7d74-d81a-4aad-802c-3b131250e9a3 Jul 10 10:28:02 devstack sudo[107251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:02 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-477e3b6d-6b49-4352-b089-b728fac359ef tempest-ProjectMemberTests-915988921 None] Acquiring lock "cinder-5e2643dd-e3c9-4b6f-9a1d-300534360d79-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:28:02 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-477e3b6d-6b49-4352-b089-b728fac359ef tempest-ProjectMemberTests-915988921 None] Lock "cinder-5e2643dd-e3c9-4b6f-9a1d-300534360d79-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:28:02 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-477e3b6d-6b49-4352-b089-b728fac359ef tempest-ProjectMemberTests-915988921 None] Acquiring lock "cinder-quobyte-5e2643dd-e3c9-4b6f-9a1d-300534360d79" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:28:02 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-477e3b6d-6b49-4352-b089-b728fac359ef tempest-ProjectMemberTests-915988921 None] Lock "cinder-quobyte-5e2643dd-e3c9-4b6f-9a1d-300534360d79" acquired by "delete_volume" :: waited 0.019s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:28:02 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb37f93-c0e5-4f89-98ed-66e9762da5db]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:28:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-477e3b6d-6b49-4352-b089-b728fac359ef tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5e2643dd-e3c9-4b6f-9a1d-300534360d79 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:03 devstack sudo[107253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5e2643dd-e3c9-4b6f-9a1d-300534360d79 Jul 10 10:28:03 devstack sudo[107253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:03 devstack sudo[107251]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fd537daa-4995-41f3-871a-c31c35f9c7cd tempest-ProjectReaderTests-1990163970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-046e7d74-d81a-4aad-802c-3b131250e9a3" returned: 0 in 0.842s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fd537daa-4995-41f3-871a-c31c35f9c7cd tempest-ProjectReaderTests-1990163970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-046e7d74-d81a-4aad-802c-3b131250e9a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-046e7d74-d81a-4aad-802c-3b131250e9a3.f6f953e3-87f7-408e-b4a8-fb5295de573a 1G {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:03 devstack sudo[107259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-046e7d74-d81a-4aad-802c-3b131250e9a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-046e7d74-d81a-4aad-802c-3b131250e9a3.f6f953e3-87f7-408e-b4a8-fb5295de573a 1G Jul 10 10:28:03 devstack sudo[107259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:03 devstack sudo[107253]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-477e3b6d-6b49-4352-b089-b728fac359ef tempest-ProjectMemberTests-915988921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5e2643dd-e3c9-4b6f-9a1d-300534360d79" returned: 0 in 0.908s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-477e3b6d-6b49-4352-b089-b728fac359ef tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5e2643dd-e3c9-4b6f-9a1d-300534360d79 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:03 devstack sudo[107268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5e2643dd-e3c9-4b6f-9a1d-300534360d79 Jul 10 10:28:03 devstack sudo[107268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:04 devstack sudo[107259]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fd537daa-4995-41f3-871a-c31c35f9c7cd tempest-ProjectReaderTests-1990163970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-046e7d74-d81a-4aad-802c-3b131250e9a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-046e7d74-d81a-4aad-802c-3b131250e9a3.f6f953e3-87f7-408e-b4a8-fb5295de573a 1G" returned: 0 in 0.967s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fd537daa-4995-41f3-871a-c31c35f9c7cd tempest-ProjectReaderTests-1990163970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-046e7d74-d81a-4aad-802c-3b131250e9a3 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-046e7d74-d81a-4aad-802c-3b131250e9a3.f6f953e3-87f7-408e-b4a8-fb5295de573a {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:04 devstack sudo[107270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-046e7d74-d81a-4aad-802c-3b131250e9a3 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-046e7d74-d81a-4aad-802c-3b131250e9a3.f6f953e3-87f7-408e-b4a8-fb5295de573a Jul 10 10:28:04 devstack sudo[107270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:04 devstack sudo[107268]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-477e3b6d-6b49-4352-b089-b728fac359ef tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-5e2643dd-e3c9-4b6f-9a1d-300534360d79" returned: 0 in 0.775s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:04 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-477e3b6d-6b49-4352-b089-b728fac359ef tempest-ProjectMemberTests-915988921 None] Lock "cinder-quobyte-5e2643dd-e3c9-4b6f-9a1d-300534360d79" released by "delete_volume" :: held 1.773s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:28:04 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-477e3b6d-6b49-4352-b089-b728fac359ef tempest-ProjectMemberTests-915988921 None] Created reservations ['d06dfe92-f919-40c2-8374-e8b2c0f81ed9', 'ea0820e4-6ba5-4c3a-96d5-a01cd80576fb', '4fbb8993-03ab-4575-8d04-ad70dd59e100', '1a2e3770-0efd-4890-8933-f533cd8ac88f'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:28:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-477e3b6d-6b49-4352-b089-b728fac359ef tempest-ProjectMemberTests-915988921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:28:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-477e3b6d-6b49-4352-b089-b728fac359ef tempest-ProjectMemberTests-915988921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:28:04 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-477e3b6d-6b49-4352-b089-b728fac359ef tempest-ProjectMemberTests-915988921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:28:04 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-477e3b6d-6b49-4352-b089-b728fac359ef tempest-ProjectMemberTests-915988921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:28:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-477e3b6d-6b49-4352-b089-b728fac359ef tempest-ProjectMemberTests-915988921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:28:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-477e3b6d-6b49-4352-b089-b728fac359ef tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:04 devstack sudo[107277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:28:04 devstack sudo[107277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:04 devstack sudo[107270]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fd537daa-4995-41f3-871a-c31c35f9c7cd tempest-ProjectReaderTests-1990163970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-046e7d74-d81a-4aad-802c-3b131250e9a3 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-046e7d74-d81a-4aad-802c-3b131250e9a3.f6f953e3-87f7-408e-b4a8-fb5295de573a" returned: 0 in 0.768s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:04 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-fd537daa-4995-41f3-871a-c31c35f9c7cd tempest-ProjectReaderTests-1990163970 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-046e7d74-d81a-4aad-802c-3b131250e9a3.f6f953e3-87f7-408e-b4a8-fb5295de573a is being set with open permissions: ugo+rw Jul 10 10:28:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fd537daa-4995-41f3-871a-c31c35f9c7cd tempest-ProjectReaderTests-1990163970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-046e7d74-d81a-4aad-802c-3b131250e9a3.f6f953e3-87f7-408e-b4a8-fb5295de573a {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:04 devstack sudo[107279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-046e7d74-d81a-4aad-802c-3b131250e9a3.f6f953e3-87f7-408e-b4a8-fb5295de573a Jul 10 10:28:04 devstack sudo[107279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:05 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-00f397f0-c8e1-4300-bf2a-872131bdc4e0 tempest-ProjectMemberTests-915988921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:28:05 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-00f397f0-c8e1-4300-bf2a-872131bdc4e0 tempest-ProjectMemberTests-915988921 None] Flow 'volume_create_manager' (02ec59ee-b9fc-452d-b4d5-fa89c9f1dedb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:28:05 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-00f397f0-c8e1-4300-bf2a-872131bdc4e0 tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18903e38-0e41-4382-9b7c-1214443349ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:28:05 devstack sudo[107279]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fd537daa-4995-41f3-871a-c31c35f9c7cd tempest-ProjectReaderTests-1990163970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-046e7d74-d81a-4aad-802c-3b131250e9a3.f6f953e3-87f7-408e-b4a8-fb5295de573a" returned: 0 in 0.772s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:05 devstack sudo[107277]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:05 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-00f397f0-c8e1-4300-bf2a-872131bdc4e0 tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18903e38-0e41-4382-9b7c-1214443349ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:28:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1324490932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f634b3b6-24d0-4ba8-a602-2173d8ac0398,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac4b039bd3aa49f393fe3462e2fed6d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:28:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:28:06Z,use_quota=True,user_id='cc3f433661ac4946825a66613f6d748c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:28:05 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-00f397f0-c8e1-4300-bf2a-872131bdc4e0 tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54b817d3-64e7-4e03-8699-2a2234053d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:28:05 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-00f397f0-c8e1-4300-bf2a-872131bdc4e0 tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54b817d3-64e7-4e03-8699-2a2234053d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:28:05 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-00f397f0-c8e1-4300-bf2a-872131bdc4e0 tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b902bc20-0b32-4750-9ae8-30f4ebe29875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:28:05 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-00f397f0-c8e1-4300-bf2a-872131bdc4e0 tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b902bc20-0b32-4750-9ae8-30f4ebe29875) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f634b3b6-24d0-4ba8-a602-2173d8ac0398', 'volume_name': 'volume-f634b3b6-24d0-4ba8-a602-2173d8ac0398', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:28:05 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-00f397f0-c8e1-4300-bf2a-872131bdc4e0 tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cebd04a4-d3fb-48fb-846e-4d094f95e478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:28:05 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-00f397f0-c8e1-4300-bf2a-872131bdc4e0 tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cebd04a4-d3fb-48fb-846e-4d094f95e478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:28:05 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-00f397f0-c8e1-4300-bf2a-872131bdc4e0 tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94ded54d-f069-4e86-b067-10aae5330544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:28:05 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-00f397f0-c8e1-4300-bf2a-872131bdc4e0 tempest-ProjectMemberTests-915988921 None] Volume f634b3b6-24d0-4ba8-a602-2173d8ac0398: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f634b3b6-24d0-4ba8-a602-2173d8ac0398', 'volume_size': 1} Jul 10 10:28:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-00f397f0-c8e1-4300-bf2a-872131bdc4e0 tempest-ProjectMemberTests-915988921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:28:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-477e3b6d-6b49-4352-b089-b728fac359ef tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.909s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:05 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-477e3b6d-6b49-4352-b089-b728fac359ef tempest-ProjectMemberTests-915988921 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:28:05 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-477e3b6d-6b49-4352-b089-b728fac359ef tempest-ProjectMemberTests-915988921 None] Deleted volume successfully. Jul 10 10:28:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fd537daa-4995-41f3-871a-c31c35f9c7cd tempest-ProjectReaderTests-1990163970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-046e7d74-d81a-4aad-802c-3b131250e9a3.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:05 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-477e3b6d-6b49-4352-b089-b728fac359ef tempest-ProjectMemberTests-915988921 None] Lock "cinder-5e2643dd-e3c9-4b6f-9a1d-300534360d79-delete_volume" released by "delete_volume" :: held 2.980s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:28:05 devstack sudo[107283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-046e7d74-d81a-4aad-802c-3b131250e9a3.info Jul 10 10:28:05 devstack sudo[107283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:06 devstack sudo[107283]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fd537daa-4995-41f3-871a-c31c35f9c7cd tempest-ProjectReaderTests-1990163970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-046e7d74-d81a-4aad-802c-3b131250e9a3.info" returned: 0 in 0.705s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:06 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-fd537daa-4995-41f3-871a-c31c35f9c7cd tempest-ProjectReaderTests-1990163970 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-046e7d74-d81a-4aad-802c-3b131250e9a3.info is being set with open permissions: ugo+rw Jul 10 10:28:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fd537daa-4995-41f3-871a-c31c35f9c7cd tempest-ProjectReaderTests-1990163970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-046e7d74-d81a-4aad-802c-3b131250e9a3.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:06 devstack sudo[107286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-046e7d74-d81a-4aad-802c-3b131250e9a3.info Jul 10 10:28:06 devstack sudo[107286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:07 devstack sudo[107286]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-fd537daa-4995-41f3-871a-c31c35f9c7cd tempest-ProjectReaderTests-1990163970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-046e7d74-d81a-4aad-802c-3b131250e9a3.info" returned: 0 in 0.679s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-fd537daa-4995-41f3-871a-c31c35f9c7cd tempest-ProjectReaderTests-1990163970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.880s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:28:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-00f397f0-c8e1-4300-bf2a-872131bdc4e0 tempest-ProjectMemberTests-915988921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.434s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:28:07 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-00f397f0-c8e1-4300-bf2a-872131bdc4e0 tempest-ProjectMemberTests-915988921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:28:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1324490932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f634b3b6-24d0-4ba8-a602-2173d8ac0398,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac4b039bd3aa49f393fe3462e2fed6d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:28:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:28:06Z,use_quota=True,user_id='cc3f433661ac4946825a66613f6d748c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:28:07 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-00f397f0-c8e1-4300-bf2a-872131bdc4e0 tempest-ProjectMemberTests-915988921 None] Creating volume f634b3b6-24d0-4ba8-a602-2173d8ac0398 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:28:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-00f397f0-c8e1-4300-bf2a-872131bdc4e0 tempest-ProjectMemberTests-915988921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:28:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-00f397f0-c8e1-4300-bf2a-872131bdc4e0 tempest-ProjectMemberTests-915988921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:28:07 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-00f397f0-c8e1-4300-bf2a-872131bdc4e0 tempest-ProjectMemberTests-915988921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:28:07 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-00f397f0-c8e1-4300-bf2a-872131bdc4e0 tempest-ProjectMemberTests-915988921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:28:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-00f397f0-c8e1-4300-bf2a-872131bdc4e0 tempest-ProjectMemberTests-915988921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:28:07 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-00f397f0-c8e1-4300-bf2a-872131bdc4e0 tempest-ProjectMemberTests-915988921 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:28:07 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-00f397f0-c8e1-4300-bf2a-872131bdc4e0 tempest-ProjectMemberTests-915988921 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:28:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-00f397f0-c8e1-4300-bf2a-872131bdc4e0 tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f634b3b6-24d0-4ba8-a602-2173d8ac0398 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:07 devstack sudo[107290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f634b3b6-24d0-4ba8-a602-2173d8ac0398 1073741824 Jul 10 10:28:07 devstack sudo[107290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:07 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-fd537daa-4995-41f3-871a-c31c35f9c7cd tempest-ProjectReaderTests-1990163970 None] Create snapshot completed successfully Jul 10 10:28:07 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-30b63aea-98f0-4314-85b6-7fbf49cfcf63 tempest-ProjectReaderTests-1990163970 None] Acquiring lock "cinder-f6f953e3-87f7-408e-b4a8-fb5295de573a-delete_snapshot" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:28:07 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-30b63aea-98f0-4314-85b6-7fbf49cfcf63 tempest-ProjectReaderTests-1990163970 None] Lock "cinder-f6f953e3-87f7-408e-b4a8-fb5295de573a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:28:07 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-30b63aea-98f0-4314-85b6-7fbf49cfcf63 tempest-ProjectReaderTests-1990163970 None] Acquiring lock "cinder-quobyte-046e7d74-d81a-4aad-802c-3b131250e9a3" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:28:07 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-30b63aea-98f0-4314-85b6-7fbf49cfcf63 tempest-ProjectReaderTests-1990163970 None] Lock "cinder-quobyte-046e7d74-d81a-4aad-802c-3b131250e9a3" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:28:07 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-30b63aea-98f0-4314-85b6-7fbf49cfcf63 tempest-ProjectReaderTests-1990163970 None] Acquiring lock "cinder-quobyte-f6f953e3-87f7-408e-b4a8-fb5295de573a" by "_delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:28:07 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-30b63aea-98f0-4314-85b6-7fbf49cfcf63 tempest-ProjectReaderTests-1990163970 None] Lock "cinder-quobyte-f6f953e3-87f7-408e-b4a8-fb5295de573a" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:28:07 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-30b63aea-98f0-4314-85b6-7fbf49cfcf63 tempest-ProjectReaderTests-1990163970 None] Deleting offline snapshot f6f953e3-87f7-408e-b4a8-fb5295de573a of volume 046e7d74-d81a-4aad-802c-3b131250e9a3 {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 10:28:07 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-30b63aea-98f0-4314-85b6-7fbf49cfcf63 tempest-ProjectReaderTests-1990163970 None] snapshot_file for this snap is: volume-046e7d74-d81a-4aad-802c-3b131250e9a3.f6f953e3-87f7-408e-b4a8-fb5295de573a {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 10:28:07 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[881cd061-4b0d-495b-8332-639340a3360a]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:28:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-30b63aea-98f0-4314-85b6-7fbf49cfcf63 tempest-ProjectReaderTests-1990163970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-046e7d74-d81a-4aad-802c-3b131250e9a3.f6f953e3-87f7-408e-b4a8-fb5295de573a {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:07 devstack sudo[107293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-046e7d74-d81a-4aad-802c-3b131250e9a3.f6f953e3-87f7-408e-b4a8-fb5295de573a Jul 10 10:28:07 devstack sudo[107293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:08 devstack sudo[107290]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:08 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-00f397f0-c8e1-4300-bf2a-872131bdc4e0 tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f634b3b6-24d0-4ba8-a602-2173d8ac0398 1073741824" returned: 0 in 0.914s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:08 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-00f397f0-c8e1-4300-bf2a-872131bdc4e0 tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f634b3b6-24d0-4ba8-a602-2173d8ac0398 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:08 devstack sudo[107299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f634b3b6-24d0-4ba8-a602-2173d8ac0398 Jul 10 10:28:08 devstack sudo[107299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:08 devstack sudo[107293]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:08 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-30b63aea-98f0-4314-85b6-7fbf49cfcf63 tempest-ProjectReaderTests-1990163970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-046e7d74-d81a-4aad-802c-3b131250e9a3.f6f953e3-87f7-408e-b4a8-fb5295de573a" returned: 0 in 0.774s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:08 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-30b63aea-98f0-4314-85b6-7fbf49cfcf63 tempest-ProjectReaderTests-1990163970 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-046e7d74-d81a-4aad-802c-3b131250e9a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 10:28:08 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e1fa26-7200-47a0-8115-107c497c5a82]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:28:08 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-30b63aea-98f0-4314-85b6-7fbf49cfcf63 tempest-ProjectReaderTests-1990163970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-046e7d74-d81a-4aad-802c-3b131250e9a3 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:08 devstack sudo[107304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-046e7d74-d81a-4aad-802c-3b131250e9a3 Jul 10 10:28:08 devstack sudo[107304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:08 devstack sudo[107299]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:08 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-00f397f0-c8e1-4300-bf2a-872131bdc4e0 tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f634b3b6-24d0-4ba8-a602-2173d8ac0398" returned: 0 in 0.681s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:08 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-00f397f0-c8e1-4300-bf2a-872131bdc4e0 tempest-ProjectMemberTests-915988921 None] <== create_volume: return (1636ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:28:08 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-00f397f0-c8e1-4300-bf2a-872131bdc4e0 tempest-ProjectMemberTests-915988921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.639s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:28:08 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-00f397f0-c8e1-4300-bf2a-872131bdc4e0 tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94ded54d-f069-4e86-b067-10aae5330544) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f634b3b6-24d0-4ba8-a602-2173d8ac0398', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:28:08 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-00f397f0-c8e1-4300-bf2a-872131bdc4e0 tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1d65d55-272a-41c8-9572-df0f32051ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:28:08 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-00f397f0-c8e1-4300-bf2a-872131bdc4e0 tempest-ProjectMemberTests-915988921 None] Volume volume-f634b3b6-24d0-4ba8-a602-2173d8ac0398 (f634b3b6-24d0-4ba8-a602-2173d8ac0398): created successfully Jul 10 10:28:08 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-00f397f0-c8e1-4300-bf2a-872131bdc4e0 tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1d65d55-272a-41c8-9572-df0f32051ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:28:08 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-00f397f0-c8e1-4300-bf2a-872131bdc4e0 tempest-ProjectMemberTests-915988921 None] Flow 'volume_create_manager' (02ec59ee-b9fc-452d-b4d5-fa89c9f1dedb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:28:08 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-00f397f0-c8e1-4300-bf2a-872131bdc4e0 tempest-ProjectMemberTests-915988921 None] Created volume successfully. Jul 10 10:28:09 devstack sudo[107304]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:09 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-30b63aea-98f0-4314-85b6-7fbf49cfcf63 tempest-ProjectReaderTests-1990163970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-046e7d74-d81a-4aad-802c-3b131250e9a3" returned: 0 in 0.779s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:09 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-30b63aea-98f0-4314-85b6-7fbf49cfcf63 tempest-ProjectReaderTests-1990163970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-046e7d74-d81a-4aad-802c-3b131250e9a3.f6f953e3-87f7-408e-b4a8-fb5295de573a {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:09 devstack sudo[107310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-046e7d74-d81a-4aad-802c-3b131250e9a3.f6f953e3-87f7-408e-b4a8-fb5295de573a Jul 10 10:28:09 devstack sudo[107310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:09 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-98fadcdd-ba9c-459b-8b68-0b293c95fab7 tempest-ProjectMemberTests-915988921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:28:09 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-98fadcdd-ba9c-459b-8b68-0b293c95fab7 tempest-ProjectMemberTests-915988921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:28:09 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-98fadcdd-ba9c-459b-8b68-0b293c95fab7 tempest-ProjectMemberTests-915988921 None] Creating offline snapshot 0bef2228-f053-4931-a9ed-83085b8a4d4c of volume f634b3b6-24d0-4ba8-a602-2173d8ac0398 {{(pid=87234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 10:28:09 devstack sudo[107310]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:09 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-30b63aea-98f0-4314-85b6-7fbf49cfcf63 tempest-ProjectReaderTests-1990163970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-046e7d74-d81a-4aad-802c-3b131250e9a3.f6f953e3-87f7-408e-b4a8-fb5295de573a" returned: 0 in 0.767s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:09 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-30b63aea-98f0-4314-85b6-7fbf49cfcf63 tempest-ProjectReaderTests-1990163970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-046e7d74-d81a-4aad-802c-3b131250e9a3.f6f953e3-87f7-408e-b4a8-fb5295de573a {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:10 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b611f0d-d7db-47fc-9379-8cd54a8cfb55]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:28:10 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-98fadcdd-ba9c-459b-8b68-0b293c95fab7 tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f634b3b6-24d0-4ba8-a602-2173d8ac0398 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:10 devstack sudo[107316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-046e7d74-d81a-4aad-802c-3b131250e9a3.f6f953e3-87f7-408e-b4a8-fb5295de573a Jul 10 10:28:10 devstack sudo[107316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:10 devstack sudo[107317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f634b3b6-24d0-4ba8-a602-2173d8ac0398 Jul 10 10:28:10 devstack sudo[107317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:10 devstack sudo[107316]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:10 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-30b63aea-98f0-4314-85b6-7fbf49cfcf63 tempest-ProjectReaderTests-1990163970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-046e7d74-d81a-4aad-802c-3b131250e9a3.f6f953e3-87f7-408e-b4a8-fb5295de573a" returned: 0 in 0.668s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:10 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-30b63aea-98f0-4314-85b6-7fbf49cfcf63 tempest-ProjectReaderTests-1990163970 None] Lock "cinder-quobyte-f6f953e3-87f7-408e-b4a8-fb5295de573a" released by "_delete_snapshot" :: held 3.110s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:28:10 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-30b63aea-98f0-4314-85b6-7fbf49cfcf63 tempest-ProjectReaderTests-1990163970 None] Lock "cinder-quobyte-046e7d74-d81a-4aad-802c-3b131250e9a3" released by "delete_snapshot" :: held 3.137s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:28:10 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-30b63aea-98f0-4314-85b6-7fbf49cfcf63 tempest-ProjectReaderTests-1990163970 None] Created reservations ['71b5cc14-bc5e-4533-a415-fe224145d62d', 'fdaad6aa-6f3d-4373-9060-7d731cd51006', 'b24e5480-4cc7-40de-b845-e341b54b3a15', 'a3ed988c-2d29-4206-8198-173b018db663'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:28:10 devstack sudo[107317]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:10 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-98fadcdd-ba9c-459b-8b68-0b293c95fab7 tempest-ProjectMemberTests-915988921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f634b3b6-24d0-4ba8-a602-2173d8ac0398" returned: 0 in 0.776s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:10 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-98fadcdd-ba9c-459b-8b68-0b293c95fab7 tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f634b3b6-24d0-4ba8-a602-2173d8ac0398,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f634b3b6-24d0-4ba8-a602-2173d8ac0398.0bef2228-f053-4931-a9ed-83085b8a4d4c 1G {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:10 devstack sudo[107324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f634b3b6-24d0-4ba8-a602-2173d8ac0398,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f634b3b6-24d0-4ba8-a602-2173d8ac0398.0bef2228-f053-4931-a9ed-83085b8a4d4c 1G Jul 10 10:28:10 devstack sudo[107324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:10 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-30b63aea-98f0-4314-85b6-7fbf49cfcf63 tempest-ProjectReaderTests-1990163970 None] Delete snapshot completed successfully. Jul 10 10:28:10 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-30b63aea-98f0-4314-85b6-7fbf49cfcf63 tempest-ProjectReaderTests-1990163970 None] Lock "cinder-f6f953e3-87f7-408e-b4a8-fb5295de573a-delete_snapshot" released by "delete_snapshot" :: held 3.298s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:28:11 devstack sudo[107324]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:11 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-98fadcdd-ba9c-459b-8b68-0b293c95fab7 tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f634b3b6-24d0-4ba8-a602-2173d8ac0398,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f634b3b6-24d0-4ba8-a602-2173d8ac0398.0bef2228-f053-4931-a9ed-83085b8a4d4c 1G" returned: 0 in 0.778s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:11 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-98fadcdd-ba9c-459b-8b68-0b293c95fab7 tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f634b3b6-24d0-4ba8-a602-2173d8ac0398 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f634b3b6-24d0-4ba8-a602-2173d8ac0398.0bef2228-f053-4931-a9ed-83085b8a4d4c {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:11 devstack sudo[107330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f634b3b6-24d0-4ba8-a602-2173d8ac0398 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f634b3b6-24d0-4ba8-a602-2173d8ac0398.0bef2228-f053-4931-a9ed-83085b8a4d4c Jul 10 10:28:11 devstack sudo[107330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:11 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-9517a1b4-487b-4681-9c3b-1617458bb0e1 tempest-ProjectReaderTests-1990163970 None] Acquiring lock "cinder-046e7d74-d81a-4aad-802c-3b131250e9a3-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:28:11 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-9517a1b4-487b-4681-9c3b-1617458bb0e1 tempest-ProjectReaderTests-1990163970 None] Lock "cinder-046e7d74-d81a-4aad-802c-3b131250e9a3-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:28:11 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-9517a1b4-487b-4681-9c3b-1617458bb0e1 tempest-ProjectReaderTests-1990163970 None] Acquiring lock "cinder-quobyte-046e7d74-d81a-4aad-802c-3b131250e9a3" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:28:11 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-9517a1b4-487b-4681-9c3b-1617458bb0e1 tempest-ProjectReaderTests-1990163970 None] Lock "cinder-quobyte-046e7d74-d81a-4aad-802c-3b131250e9a3" acquired by "delete_volume" :: waited 0.014s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:28:11 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[c83a1bc4-7488-4b3c-b54d-0b09d71f6b2e]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:28:11 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9517a1b4-487b-4681-9c3b-1617458bb0e1 tempest-ProjectReaderTests-1990163970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-046e7d74-d81a-4aad-802c-3b131250e9a3 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:12 devstack sudo[107332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-046e7d74-d81a-4aad-802c-3b131250e9a3 Jul 10 10:28:12 devstack sudo[107332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:12 devstack sudo[107330]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-98fadcdd-ba9c-459b-8b68-0b293c95fab7 tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f634b3b6-24d0-4ba8-a602-2173d8ac0398 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f634b3b6-24d0-4ba8-a602-2173d8ac0398.0bef2228-f053-4931-a9ed-83085b8a4d4c" returned: 0 in 0.722s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:12 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-98fadcdd-ba9c-459b-8b68-0b293c95fab7 tempest-ProjectMemberTests-915988921 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f634b3b6-24d0-4ba8-a602-2173d8ac0398.0bef2228-f053-4931-a9ed-83085b8a4d4c is being set with open permissions: ugo+rw Jul 10 10:28:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-98fadcdd-ba9c-459b-8b68-0b293c95fab7 tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f634b3b6-24d0-4ba8-a602-2173d8ac0398.0bef2228-f053-4931-a9ed-83085b8a4d4c {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:12 devstack sudo[107337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f634b3b6-24d0-4ba8-a602-2173d8ac0398.0bef2228-f053-4931-a9ed-83085b8a4d4c Jul 10 10:28:12 devstack sudo[107337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:12 devstack sudo[107332]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9517a1b4-487b-4681-9c3b-1617458bb0e1 tempest-ProjectReaderTests-1990163970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-046e7d74-d81a-4aad-802c-3b131250e9a3" returned: 0 in 0.763s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9517a1b4-487b-4681-9c3b-1617458bb0e1 tempest-ProjectReaderTests-1990163970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-046e7d74-d81a-4aad-802c-3b131250e9a3 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:12 devstack sudo[107342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-046e7d74-d81a-4aad-802c-3b131250e9a3 Jul 10 10:28:12 devstack sudo[107342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:12 devstack sudo[107337]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-98fadcdd-ba9c-459b-8b68-0b293c95fab7 tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f634b3b6-24d0-4ba8-a602-2173d8ac0398.0bef2228-f053-4931-a9ed-83085b8a4d4c" returned: 0 in 0.660s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-98fadcdd-ba9c-459b-8b68-0b293c95fab7 tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f634b3b6-24d0-4ba8-a602-2173d8ac0398.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:13 devstack sudo[107345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f634b3b6-24d0-4ba8-a602-2173d8ac0398.info Jul 10 10:28:13 devstack sudo[107345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:13 devstack sudo[107342]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:13 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9517a1b4-487b-4681-9c3b-1617458bb0e1 tempest-ProjectReaderTests-1990163970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-046e7d74-d81a-4aad-802c-3b131250e9a3" returned: 0 in 0.651s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:13 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-9517a1b4-487b-4681-9c3b-1617458bb0e1 tempest-ProjectReaderTests-1990163970 None] Lock "cinder-quobyte-046e7d74-d81a-4aad-802c-3b131250e9a3" released by "delete_volume" :: held 1.477s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:28:13 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-9517a1b4-487b-4681-9c3b-1617458bb0e1 tempest-ProjectReaderTests-1990163970 None] Created reservations ['a461b449-ec8b-4abf-ab25-c52c5a16d642', '46473bb0-b9ad-4c3a-824b-815abe57acd5', 'd62250db-7489-4f5c-a64a-34138a00cbfb', 'eb9b6940-304d-4589-b077-1cca30dc24dd'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:28:13 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-9517a1b4-487b-4681-9c3b-1617458bb0e1 tempest-ProjectReaderTests-1990163970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:28:13 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-9517a1b4-487b-4681-9c3b-1617458bb0e1 tempest-ProjectReaderTests-1990163970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:28:13 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-9517a1b4-487b-4681-9c3b-1617458bb0e1 tempest-ProjectReaderTests-1990163970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:28:13 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-9517a1b4-487b-4681-9c3b-1617458bb0e1 tempest-ProjectReaderTests-1990163970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:28:13 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-9517a1b4-487b-4681-9c3b-1617458bb0e1 tempest-ProjectReaderTests-1990163970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:28:13 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9517a1b4-487b-4681-9c3b-1617458bb0e1 tempest-ProjectReaderTests-1990163970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:13 devstack sudo[107348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:28:13 devstack sudo[107348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:13 devstack sudo[107345]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:13 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-98fadcdd-ba9c-459b-8b68-0b293c95fab7 tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f634b3b6-24d0-4ba8-a602-2173d8ac0398.info" returned: 0 in 0.669s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:13 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-98fadcdd-ba9c-459b-8b68-0b293c95fab7 tempest-ProjectMemberTests-915988921 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f634b3b6-24d0-4ba8-a602-2173d8ac0398.info is being set with open permissions: ugo+rw Jul 10 10:28:13 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-98fadcdd-ba9c-459b-8b68-0b293c95fab7 tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f634b3b6-24d0-4ba8-a602-2173d8ac0398.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:13 devstack sudo[107352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f634b3b6-24d0-4ba8-a602-2173d8ac0398.info Jul 10 10:28:13 devstack sudo[107352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:14 devstack sudo[107348]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:14 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9517a1b4-487b-4681-9c3b-1617458bb0e1 tempest-ProjectReaderTests-1990163970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.672s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:14 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-9517a1b4-487b-4681-9c3b-1617458bb0e1 tempest-ProjectReaderTests-1990163970 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:28:14 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-9517a1b4-487b-4681-9c3b-1617458bb0e1 tempest-ProjectReaderTests-1990163970 None] Deleted volume successfully. Jul 10 10:28:14 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-9517a1b4-487b-4681-9c3b-1617458bb0e1 tempest-ProjectReaderTests-1990163970 None] Lock "cinder-046e7d74-d81a-4aad-802c-3b131250e9a3-delete_volume" released by "delete_volume" :: held 2.364s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:28:14 devstack sudo[107352]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:14 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-98fadcdd-ba9c-459b-8b68-0b293c95fab7 tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f634b3b6-24d0-4ba8-a602-2173d8ac0398.info" returned: 0 in 0.688s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:14 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-98fadcdd-ba9c-459b-8b68-0b293c95fab7 tempest-ProjectMemberTests-915988921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.389s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:28:14 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-98fadcdd-ba9c-459b-8b68-0b293c95fab7 tempest-ProjectMemberTests-915988921 None] Create snapshot completed successfully Jul 10 10:28:15 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-d91f24bb-9cde-4689-b0ad-4f0323aa5f52 tempest-ProjectMemberTests-915988921 None] Acquiring lock "cinder-0bef2228-f053-4931-a9ed-83085b8a4d4c-delete_snapshot" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:28:15 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-d91f24bb-9cde-4689-b0ad-4f0323aa5f52 tempest-ProjectMemberTests-915988921 None] Lock "cinder-0bef2228-f053-4931-a9ed-83085b8a4d4c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:28:15 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-d91f24bb-9cde-4689-b0ad-4f0323aa5f52 tempest-ProjectMemberTests-915988921 None] Acquiring lock "cinder-quobyte-f634b3b6-24d0-4ba8-a602-2173d8ac0398" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:28:15 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-d91f24bb-9cde-4689-b0ad-4f0323aa5f52 tempest-ProjectMemberTests-915988921 None] Lock "cinder-quobyte-f634b3b6-24d0-4ba8-a602-2173d8ac0398" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:28:15 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-d91f24bb-9cde-4689-b0ad-4f0323aa5f52 tempest-ProjectMemberTests-915988921 None] Acquiring lock "cinder-quobyte-0bef2228-f053-4931-a9ed-83085b8a4d4c" by "_delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:28:15 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-d91f24bb-9cde-4689-b0ad-4f0323aa5f52 tempest-ProjectMemberTests-915988921 None] Lock "cinder-quobyte-0bef2228-f053-4931-a9ed-83085b8a4d4c" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:28:15 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-d91f24bb-9cde-4689-b0ad-4f0323aa5f52 tempest-ProjectMemberTests-915988921 None] Deleting offline snapshot 0bef2228-f053-4931-a9ed-83085b8a4d4c of volume f634b3b6-24d0-4ba8-a602-2173d8ac0398 {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 10:28:15 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-d91f24bb-9cde-4689-b0ad-4f0323aa5f52 tempest-ProjectMemberTests-915988921 None] snapshot_file for this snap is: volume-f634b3b6-24d0-4ba8-a602-2173d8ac0398.0bef2228-f053-4931-a9ed-83085b8a4d4c {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 10:28:15 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c9df0d-2162-4732-9be6-82e2f87cfcd4]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:28:15 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-d91f24bb-9cde-4689-b0ad-4f0323aa5f52 tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f634b3b6-24d0-4ba8-a602-2173d8ac0398.0bef2228-f053-4931-a9ed-83085b8a4d4c {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:15 devstack sudo[107356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f634b3b6-24d0-4ba8-a602-2173d8ac0398.0bef2228-f053-4931-a9ed-83085b8a4d4c Jul 10 10:28:15 devstack sudo[107356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:16 devstack sudo[107356]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-d91f24bb-9cde-4689-b0ad-4f0323aa5f52 tempest-ProjectMemberTests-915988921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f634b3b6-24d0-4ba8-a602-2173d8ac0398.0bef2228-f053-4931-a9ed-83085b8a4d4c" returned: 0 in 0.786s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:16 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-d91f24bb-9cde-4689-b0ad-4f0323aa5f52 tempest-ProjectMemberTests-915988921 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f634b3b6-24d0-4ba8-a602-2173d8ac0398(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 10:28:16 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d8ecf5-cee2-46c7-a4ef-a2d98ef4b0a4]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:28:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-d91f24bb-9cde-4689-b0ad-4f0323aa5f52 tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f634b3b6-24d0-4ba8-a602-2173d8ac0398 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:16 devstack sudo[107361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f634b3b6-24d0-4ba8-a602-2173d8ac0398 Jul 10 10:28:16 devstack sudo[107361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:16 devstack sudo[107361]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-d91f24bb-9cde-4689-b0ad-4f0323aa5f52 tempest-ProjectMemberTests-915988921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f634b3b6-24d0-4ba8-a602-2173d8ac0398" returned: 0 in 0.766s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-d91f24bb-9cde-4689-b0ad-4f0323aa5f52 tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f634b3b6-24d0-4ba8-a602-2173d8ac0398.0bef2228-f053-4931-a9ed-83085b8a4d4c {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:16 devstack sudo[107366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f634b3b6-24d0-4ba8-a602-2173d8ac0398.0bef2228-f053-4931-a9ed-83085b8a4d4c Jul 10 10:28:16 devstack sudo[107366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:17 devstack sudo[107366]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-d91f24bb-9cde-4689-b0ad-4f0323aa5f52 tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f634b3b6-24d0-4ba8-a602-2173d8ac0398.0bef2228-f053-4931-a9ed-83085b8a4d4c" returned: 0 in 0.785s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-d91f24bb-9cde-4689-b0ad-4f0323aa5f52 tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f634b3b6-24d0-4ba8-a602-2173d8ac0398.0bef2228-f053-4931-a9ed-83085b8a4d4c {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:17 devstack sudo[107372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f634b3b6-24d0-4ba8-a602-2173d8ac0398.0bef2228-f053-4931-a9ed-83085b8a4d4c Jul 10 10:28:17 devstack sudo[107372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:18 devstack sudo[107372]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:18 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-d91f24bb-9cde-4689-b0ad-4f0323aa5f52 tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f634b3b6-24d0-4ba8-a602-2173d8ac0398.0bef2228-f053-4931-a9ed-83085b8a4d4c" returned: 0 in 0.655s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:18 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-d91f24bb-9cde-4689-b0ad-4f0323aa5f52 tempest-ProjectMemberTests-915988921 None] Lock "cinder-quobyte-0bef2228-f053-4931-a9ed-83085b8a4d4c" released by "_delete_snapshot" :: held 3.113s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:28:18 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-d91f24bb-9cde-4689-b0ad-4f0323aa5f52 tempest-ProjectMemberTests-915988921 None] Lock "cinder-quobyte-f634b3b6-24d0-4ba8-a602-2173d8ac0398" released by "delete_snapshot" :: held 3.137s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:28:18 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-d91f24bb-9cde-4689-b0ad-4f0323aa5f52 tempest-ProjectMemberTests-915988921 None] Created reservations ['f5cfde96-8cce-42f4-8a07-90748fc2af69', '3967a3ba-3296-4b65-b75d-9aeec2762bf9', 'd2bd900d-07fd-46fb-b928-1cec70f2912e', '56048e18-b733-4c1f-8e70-0a42522145c3'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:28:18 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-d91f24bb-9cde-4689-b0ad-4f0323aa5f52 tempest-ProjectMemberTests-915988921 None] Delete snapshot completed successfully. Jul 10 10:28:18 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-d91f24bb-9cde-4689-b0ad-4f0323aa5f52 tempest-ProjectMemberTests-915988921 None] Lock "cinder-0bef2228-f053-4931-a9ed-83085b8a4d4c-delete_snapshot" released by "delete_snapshot" :: held 3.265s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:28:19 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-a0a4173b-b2f6-4915-b589-d2d3fb8bc714 tempest-ProjectMemberTests-915988921 None] Acquiring lock "cinder-f634b3b6-24d0-4ba8-a602-2173d8ac0398-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:28:19 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-a0a4173b-b2f6-4915-b589-d2d3fb8bc714 tempest-ProjectMemberTests-915988921 None] Lock "cinder-f634b3b6-24d0-4ba8-a602-2173d8ac0398-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:28:19 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-a0a4173b-b2f6-4915-b589-d2d3fb8bc714 tempest-ProjectMemberTests-915988921 None] Acquiring lock "cinder-quobyte-f634b3b6-24d0-4ba8-a602-2173d8ac0398" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:28:19 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-a0a4173b-b2f6-4915-b589-d2d3fb8bc714 tempest-ProjectMemberTests-915988921 None] Lock "cinder-quobyte-f634b3b6-24d0-4ba8-a602-2173d8ac0398" acquired by "delete_volume" :: waited 0.019s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:28:19 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[574bebe0-1629-4c78-8f03-686c39292b33]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:28:19 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a0a4173b-b2f6-4915-b589-d2d3fb8bc714 tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f634b3b6-24d0-4ba8-a602-2173d8ac0398 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:19 devstack sudo[107376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f634b3b6-24d0-4ba8-a602-2173d8ac0398 Jul 10 10:28:19 devstack sudo[107376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:20 devstack sudo[107376]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:20 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a0a4173b-b2f6-4915-b589-d2d3fb8bc714 tempest-ProjectMemberTests-915988921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f634b3b6-24d0-4ba8-a602-2173d8ac0398" returned: 0 in 0.763s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:20 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a0a4173b-b2f6-4915-b589-d2d3fb8bc714 tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f634b3b6-24d0-4ba8-a602-2173d8ac0398 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:20 devstack sudo[107382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f634b3b6-24d0-4ba8-a602-2173d8ac0398 Jul 10 10:28:20 devstack sudo[107382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:21 devstack sudo[107382]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:21 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a0a4173b-b2f6-4915-b589-d2d3fb8bc714 tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-f634b3b6-24d0-4ba8-a602-2173d8ac0398" returned: 0 in 0.711s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:21 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-a0a4173b-b2f6-4915-b589-d2d3fb8bc714 tempest-ProjectMemberTests-915988921 None] Lock "cinder-quobyte-f634b3b6-24d0-4ba8-a602-2173d8ac0398" released by "delete_volume" :: held 1.547s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:28:21 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-a0a4173b-b2f6-4915-b589-d2d3fb8bc714 tempest-ProjectMemberTests-915988921 None] Created reservations ['f02ef302-bfc0-44d4-9ccf-97b6777dae3f', '61d74c32-4a00-4ea9-b4ff-108cc2b30395', '67c85ef6-3a49-4b73-9b65-ab7f7a5ae4d7', 'f5ab93bf-4958-4d09-81e6-6cae23851185'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:28:21 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-a0a4173b-b2f6-4915-b589-d2d3fb8bc714 tempest-ProjectMemberTests-915988921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:28:21 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-a0a4173b-b2f6-4915-b589-d2d3fb8bc714 tempest-ProjectMemberTests-915988921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:28:21 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-a0a4173b-b2f6-4915-b589-d2d3fb8bc714 tempest-ProjectMemberTests-915988921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:28:21 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-a0a4173b-b2f6-4915-b589-d2d3fb8bc714 tempest-ProjectMemberTests-915988921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:28:21 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-a0a4173b-b2f6-4915-b589-d2d3fb8bc714 tempest-ProjectMemberTests-915988921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:28:21 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a0a4173b-b2f6-4915-b589-d2d3fb8bc714 tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:21 devstack sudo[107385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:28:21 devstack sudo[107385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:21 devstack sudo[107385]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:21 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a0a4173b-b2f6-4915-b589-d2d3fb8bc714 tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.682s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:21 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-a0a4173b-b2f6-4915-b589-d2d3fb8bc714 tempest-ProjectMemberTests-915988921 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:28:21 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-a0a4173b-b2f6-4915-b589-d2d3fb8bc714 tempest-ProjectMemberTests-915988921 None] Deleted volume successfully. Jul 10 10:28:21 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-a0a4173b-b2f6-4915-b589-d2d3fb8bc714 tempest-ProjectMemberTests-915988921 None] Lock "cinder-f634b3b6-24d0-4ba8-a602-2173d8ac0398-delete_volume" released by "delete_volume" :: held 2.490s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:28:22 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-81f32767-3cae-4799-9062-df354a4298db tempest-ProjectMemberTests-915988921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:28:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-81f32767-3cae-4799-9062-df354a4298db tempest-ProjectMemberTests-915988921 None] Flow 'volume_create_manager' (c9704951-3b9d-4047-92cc-458d772fef2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:28:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-81f32767-3cae-4799-9062-df354a4298db tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9c46272-1865-4b67-850e-73d0e72c7d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:28:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-81f32767-3cae-4799-9062-df354a4298db tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9c46272-1865-4b67-850e-73d0e72c7d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:28:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1719642618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a885f72c-14eb-4224-a2e5-583c8a5eeef9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac4b039bd3aa49f393fe3462e2fed6d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:28:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:28:22Z,use_quota=True,user_id='cc3f433661ac4946825a66613f6d748c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:28:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-81f32767-3cae-4799-9062-df354a4298db tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a3779f3-b059-4912-8d4a-5ae1060a7e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:28:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-81f32767-3cae-4799-9062-df354a4298db tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a3779f3-b059-4912-8d4a-5ae1060a7e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:28:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-81f32767-3cae-4799-9062-df354a4298db tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c8db1bb-ed21-41ef-af69-3effa2ecf5af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:28:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-81f32767-3cae-4799-9062-df354a4298db tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c8db1bb-ed21-41ef-af69-3effa2ecf5af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a885f72c-14eb-4224-a2e5-583c8a5eeef9', 'volume_name': 'volume-a885f72c-14eb-4224-a2e5-583c8a5eeef9', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:28:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-81f32767-3cae-4799-9062-df354a4298db tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d366c6da-6da4-440f-8988-9e2520437cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:28:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-81f32767-3cae-4799-9062-df354a4298db tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d366c6da-6da4-440f-8988-9e2520437cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:28:22 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-81f32767-3cae-4799-9062-df354a4298db tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2837c3d-da6d-48b2-9ab1-8e94836788cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:28:22 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-81f32767-3cae-4799-9062-df354a4298db tempest-ProjectMemberTests-915988921 None] Volume a885f72c-14eb-4224-a2e5-583c8a5eeef9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a885f72c-14eb-4224-a2e5-583c8a5eeef9', 'volume_size': 1} Jul 10 10:28:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-81f32767-3cae-4799-9062-df354a4298db tempest-ProjectMemberTests-915988921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:28:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-81f32767-3cae-4799-9062-df354a4298db tempest-ProjectMemberTests-915988921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:28:22 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-81f32767-3cae-4799-9062-df354a4298db tempest-ProjectMemberTests-915988921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:28:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1719642618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a885f72c-14eb-4224-a2e5-583c8a5eeef9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac4b039bd3aa49f393fe3462e2fed6d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:28:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:28:22Z,use_quota=True,user_id='cc3f433661ac4946825a66613f6d748c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:28:22 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-81f32767-3cae-4799-9062-df354a4298db tempest-ProjectMemberTests-915988921 None] Creating volume a885f72c-14eb-4224-a2e5-583c8a5eeef9 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:28:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-81f32767-3cae-4799-9062-df354a4298db tempest-ProjectMemberTests-915988921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:28:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-81f32767-3cae-4799-9062-df354a4298db tempest-ProjectMemberTests-915988921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:28:22 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-81f32767-3cae-4799-9062-df354a4298db tempest-ProjectMemberTests-915988921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:28:22 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-81f32767-3cae-4799-9062-df354a4298db tempest-ProjectMemberTests-915988921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:28:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-81f32767-3cae-4799-9062-df354a4298db tempest-ProjectMemberTests-915988921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:28:22 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-81f32767-3cae-4799-9062-df354a4298db tempest-ProjectMemberTests-915988921 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:28:22 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-81f32767-3cae-4799-9062-df354a4298db tempest-ProjectMemberTests-915988921 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:28:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-81f32767-3cae-4799-9062-df354a4298db tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a885f72c-14eb-4224-a2e5-583c8a5eeef9 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:22 devstack sudo[107424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a885f72c-14eb-4224-a2e5-583c8a5eeef9 1073741824 Jul 10 10:28:22 devstack sudo[107424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:23 devstack sudo[107424]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:23 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-81f32767-3cae-4799-9062-df354a4298db tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a885f72c-14eb-4224-a2e5-583c8a5eeef9 1073741824" returned: 0 in 0.842s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:23 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-81f32767-3cae-4799-9062-df354a4298db tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a885f72c-14eb-4224-a2e5-583c8a5eeef9 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:23 devstack sudo[107432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a885f72c-14eb-4224-a2e5-583c8a5eeef9 Jul 10 10:28:23 devstack sudo[107432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:23 devstack sudo[107432]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:23 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-81f32767-3cae-4799-9062-df354a4298db tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a885f72c-14eb-4224-a2e5-583c8a5eeef9" returned: 0 in 0.691s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:23 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-81f32767-3cae-4799-9062-df354a4298db tempest-ProjectMemberTests-915988921 None] <== create_volume: return (1583ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:28:23 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-81f32767-3cae-4799-9062-df354a4298db tempest-ProjectMemberTests-915988921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.586s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:28:23 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-81f32767-3cae-4799-9062-df354a4298db tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2837c3d-da6d-48b2-9ab1-8e94836788cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a885f72c-14eb-4224-a2e5-583c8a5eeef9', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:28:23 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-81f32767-3cae-4799-9062-df354a4298db tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1b534ef-22f9-4add-afad-e61beb409529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:28:23 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-81f32767-3cae-4799-9062-df354a4298db tempest-ProjectMemberTests-915988921 None] Volume volume-a885f72c-14eb-4224-a2e5-583c8a5eeef9 (a885f72c-14eb-4224-a2e5-583c8a5eeef9): created successfully Jul 10 10:28:23 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-81f32767-3cae-4799-9062-df354a4298db tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1b534ef-22f9-4add-afad-e61beb409529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:28:23 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-81f32767-3cae-4799-9062-df354a4298db tempest-ProjectMemberTests-915988921 None] Flow 'volume_create_manager' (c9704951-3b9d-4047-92cc-458d772fef2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:28:23 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-81f32767-3cae-4799-9062-df354a4298db tempest-ProjectMemberTests-915988921 None] Created volume successfully. Jul 10 10:28:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-2f3e6305-e151-4428-bf4d-7a342e35dcda tempest-ProjectMemberTests-915988921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:28:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-2f3e6305-e151-4428-bf4d-7a342e35dcda tempest-ProjectMemberTests-915988921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:28:24 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-2f3e6305-e151-4428-bf4d-7a342e35dcda tempest-ProjectMemberTests-915988921 None] Creating offline snapshot 873e5069-e3f8-439d-bd35-476475d24c00 of volume a885f72c-14eb-4224-a2e5-583c8a5eeef9 {{(pid=87234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 10:28:24 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b9f7778-48a6-4888-a943-89ffae07ffa1]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:28:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-2f3e6305-e151-4428-bf4d-7a342e35dcda tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a885f72c-14eb-4224-a2e5-583c8a5eeef9 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:24 devstack sudo[107435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a885f72c-14eb-4224-a2e5-583c8a5eeef9 Jul 10 10:28:24 devstack sudo[107435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:25 devstack sudo[107435]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:25 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-2f3e6305-e151-4428-bf4d-7a342e35dcda tempest-ProjectMemberTests-915988921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a885f72c-14eb-4224-a2e5-583c8a5eeef9" returned: 0 in 0.771s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:25 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-2f3e6305-e151-4428-bf4d-7a342e35dcda tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a885f72c-14eb-4224-a2e5-583c8a5eeef9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a885f72c-14eb-4224-a2e5-583c8a5eeef9.873e5069-e3f8-439d-bd35-476475d24c00 1G {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:25 devstack sudo[107440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a885f72c-14eb-4224-a2e5-583c8a5eeef9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a885f72c-14eb-4224-a2e5-583c8a5eeef9.873e5069-e3f8-439d-bd35-476475d24c00 1G Jul 10 10:28:25 devstack sudo[107440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:26 devstack sudo[107440]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-2f3e6305-e151-4428-bf4d-7a342e35dcda tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a885f72c-14eb-4224-a2e5-583c8a5eeef9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a885f72c-14eb-4224-a2e5-583c8a5eeef9.873e5069-e3f8-439d-bd35-476475d24c00 1G" returned: 0 in 0.891s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-2f3e6305-e151-4428-bf4d-7a342e35dcda tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a885f72c-14eb-4224-a2e5-583c8a5eeef9 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a885f72c-14eb-4224-a2e5-583c8a5eeef9.873e5069-e3f8-439d-bd35-476475d24c00 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:26 devstack sudo[107446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a885f72c-14eb-4224-a2e5-583c8a5eeef9 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a885f72c-14eb-4224-a2e5-583c8a5eeef9.873e5069-e3f8-439d-bd35-476475d24c00 Jul 10 10:28:26 devstack sudo[107446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:26 devstack sudo[107446]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-2f3e6305-e151-4428-bf4d-7a342e35dcda tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a885f72c-14eb-4224-a2e5-583c8a5eeef9 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a885f72c-14eb-4224-a2e5-583c8a5eeef9.873e5069-e3f8-439d-bd35-476475d24c00" returned: 0 in 0.711s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:26 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-2f3e6305-e151-4428-bf4d-7a342e35dcda tempest-ProjectMemberTests-915988921 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a885f72c-14eb-4224-a2e5-583c8a5eeef9.873e5069-e3f8-439d-bd35-476475d24c00 is being set with open permissions: ugo+rw Jul 10 10:28:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-2f3e6305-e151-4428-bf4d-7a342e35dcda tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a885f72c-14eb-4224-a2e5-583c8a5eeef9.873e5069-e3f8-439d-bd35-476475d24c00 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:26 devstack sudo[107452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a885f72c-14eb-4224-a2e5-583c8a5eeef9.873e5069-e3f8-439d-bd35-476475d24c00 Jul 10 10:28:26 devstack sudo[107452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:27 devstack sudo[107452]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-2f3e6305-e151-4428-bf4d-7a342e35dcda tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a885f72c-14eb-4224-a2e5-583c8a5eeef9.873e5069-e3f8-439d-bd35-476475d24c00" returned: 0 in 0.633s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-2f3e6305-e151-4428-bf4d-7a342e35dcda tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a885f72c-14eb-4224-a2e5-583c8a5eeef9.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:27 devstack sudo[107456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a885f72c-14eb-4224-a2e5-583c8a5eeef9.info Jul 10 10:28:27 devstack sudo[107456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:28 devstack sudo[107456]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-2f3e6305-e151-4428-bf4d-7a342e35dcda tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a885f72c-14eb-4224-a2e5-583c8a5eeef9.info" returned: 0 in 0.669s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:28 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-2f3e6305-e151-4428-bf4d-7a342e35dcda tempest-ProjectMemberTests-915988921 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a885f72c-14eb-4224-a2e5-583c8a5eeef9.info is being set with open permissions: ugo+rw Jul 10 10:28:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-2f3e6305-e151-4428-bf4d-7a342e35dcda tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a885f72c-14eb-4224-a2e5-583c8a5eeef9.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:28 devstack sudo[107459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a885f72c-14eb-4224-a2e5-583c8a5eeef9.info Jul 10 10:28:28 devstack sudo[107459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:28 devstack sudo[107459]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-2f3e6305-e151-4428-bf4d-7a342e35dcda tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a885f72c-14eb-4224-a2e5-583c8a5eeef9.info" returned: 0 in 0.687s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-2f3e6305-e151-4428-bf4d-7a342e35dcda tempest-ProjectMemberTests-915988921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.491s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:28:28 devstack cinder-volume[87234]: DEBUG dbcounter [-] [87234] Writing DB stats cinder:SELECT=102,cinder:INSERT=38,cinder:UPDATE=125,cinder:DELETE=11 {{(pid=87234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 10:28:28 devstack cinder-volume[87234]: DEBUG dbcounter [-] [87234] Writing DB stats cinder:SELECT=104,cinder:INSERT=34,cinder:UPDATE=135,cinder:DELETE=9 {{(pid=87234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 10:28:28 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-2f3e6305-e151-4428-bf4d-7a342e35dcda tempest-ProjectMemberTests-915988921 None] Create snapshot completed successfully Jul 10 10:28:29 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-56a03d7d-c709-4065-a398-ca082fa0a57b tempest-ProjectMemberTests-915988921 None] Acquiring lock "cinder-873e5069-e3f8-439d-bd35-476475d24c00-delete_snapshot" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:28:29 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-56a03d7d-c709-4065-a398-ca082fa0a57b tempest-ProjectMemberTests-915988921 None] Lock "cinder-873e5069-e3f8-439d-bd35-476475d24c00-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:28:29 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-56a03d7d-c709-4065-a398-ca082fa0a57b tempest-ProjectMemberTests-915988921 None] Acquiring lock "cinder-quobyte-a885f72c-14eb-4224-a2e5-583c8a5eeef9" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:28:29 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-56a03d7d-c709-4065-a398-ca082fa0a57b tempest-ProjectMemberTests-915988921 None] Lock "cinder-quobyte-a885f72c-14eb-4224-a2e5-583c8a5eeef9" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:28:29 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-56a03d7d-c709-4065-a398-ca082fa0a57b tempest-ProjectMemberTests-915988921 None] Acquiring lock "cinder-quobyte-873e5069-e3f8-439d-bd35-476475d24c00" by "_delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:28:29 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-56a03d7d-c709-4065-a398-ca082fa0a57b tempest-ProjectMemberTests-915988921 None] Lock "cinder-quobyte-873e5069-e3f8-439d-bd35-476475d24c00" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:28:29 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-56a03d7d-c709-4065-a398-ca082fa0a57b tempest-ProjectMemberTests-915988921 None] Deleting offline snapshot 873e5069-e3f8-439d-bd35-476475d24c00 of volume a885f72c-14eb-4224-a2e5-583c8a5eeef9 {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 10:28:29 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-56a03d7d-c709-4065-a398-ca082fa0a57b tempest-ProjectMemberTests-915988921 None] snapshot_file for this snap is: volume-a885f72c-14eb-4224-a2e5-583c8a5eeef9.873e5069-e3f8-439d-bd35-476475d24c00 {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 10:28:29 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[148a43e1-f91f-4c6d-824a-4c31336812ac]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:28:29 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-56a03d7d-c709-4065-a398-ca082fa0a57b tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a885f72c-14eb-4224-a2e5-583c8a5eeef9.873e5069-e3f8-439d-bd35-476475d24c00 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:29 devstack sudo[107462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a885f72c-14eb-4224-a2e5-583c8a5eeef9.873e5069-e3f8-439d-bd35-476475d24c00 Jul 10 10:28:29 devstack sudo[107462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:30 devstack sudo[107462]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-56a03d7d-c709-4065-a398-ca082fa0a57b tempest-ProjectMemberTests-915988921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a885f72c-14eb-4224-a2e5-583c8a5eeef9.873e5069-e3f8-439d-bd35-476475d24c00" returned: 0 in 0.795s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:30 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-56a03d7d-c709-4065-a398-ca082fa0a57b tempest-ProjectMemberTests-915988921 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a885f72c-14eb-4224-a2e5-583c8a5eeef9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 10:28:30 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[01520ded-b49b-4bf6-b97c-deee2cf8ca80]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:28:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-56a03d7d-c709-4065-a398-ca082fa0a57b tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a885f72c-14eb-4224-a2e5-583c8a5eeef9 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:30 devstack sudo[107467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a885f72c-14eb-4224-a2e5-583c8a5eeef9 Jul 10 10:28:30 devstack sudo[107467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:31 devstack sudo[107467]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-56a03d7d-c709-4065-a398-ca082fa0a57b tempest-ProjectMemberTests-915988921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a885f72c-14eb-4224-a2e5-583c8a5eeef9" returned: 0 in 0.838s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-56a03d7d-c709-4065-a398-ca082fa0a57b tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a885f72c-14eb-4224-a2e5-583c8a5eeef9.873e5069-e3f8-439d-bd35-476475d24c00 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:31 devstack sudo[107478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a885f72c-14eb-4224-a2e5-583c8a5eeef9.873e5069-e3f8-439d-bd35-476475d24c00 Jul 10 10:28:31 devstack sudo[107478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:32 devstack sudo[107478]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:32 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-56a03d7d-c709-4065-a398-ca082fa0a57b tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a885f72c-14eb-4224-a2e5-583c8a5eeef9.873e5069-e3f8-439d-bd35-476475d24c00" returned: 0 in 0.826s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:32 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-56a03d7d-c709-4065-a398-ca082fa0a57b tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a885f72c-14eb-4224-a2e5-583c8a5eeef9.873e5069-e3f8-439d-bd35-476475d24c00 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:32 devstack sudo[107483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a885f72c-14eb-4224-a2e5-583c8a5eeef9.873e5069-e3f8-439d-bd35-476475d24c00 Jul 10 10:28:32 devstack sudo[107483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:33 devstack sudo[107483]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:33 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-56a03d7d-c709-4065-a398-ca082fa0a57b tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a885f72c-14eb-4224-a2e5-583c8a5eeef9.873e5069-e3f8-439d-bd35-476475d24c00" returned: 0 in 0.695s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:33 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-56a03d7d-c709-4065-a398-ca082fa0a57b tempest-ProjectMemberTests-915988921 None] Lock "cinder-quobyte-873e5069-e3f8-439d-bd35-476475d24c00" released by "_delete_snapshot" :: held 3.276s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:28:33 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-56a03d7d-c709-4065-a398-ca082fa0a57b tempest-ProjectMemberTests-915988921 None] Lock "cinder-quobyte-a885f72c-14eb-4224-a2e5-583c8a5eeef9" released by "delete_snapshot" :: held 3.302s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:28:33 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-56a03d7d-c709-4065-a398-ca082fa0a57b tempest-ProjectMemberTests-915988921 None] Created reservations ['377ab7f4-dd36-43de-9e59-0ca5d0e6fb40', '4aae0a14-ff91-4b3f-bd57-09df41342458', 'd5252d07-fe15-4837-9418-55fa955dc734', '8065d9bf-5a6f-452d-94e2-8cc191ecca0f'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:28:33 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-56a03d7d-c709-4065-a398-ca082fa0a57b tempest-ProjectMemberTests-915988921 None] Delete snapshot completed successfully. Jul 10 10:28:33 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-56a03d7d-c709-4065-a398-ca082fa0a57b tempest-ProjectMemberTests-915988921 None] Lock "cinder-873e5069-e3f8-439d-bd35-476475d24c00-delete_snapshot" released by "delete_snapshot" :: held 3.454s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:28:33 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-e494b027-0ef9-4bad-9753-2b1980ed13ca tempest-ProjectMemberTests-915988921 None] Acquiring lock "cinder-a885f72c-14eb-4224-a2e5-583c8a5eeef9-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:28:33 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-e494b027-0ef9-4bad-9753-2b1980ed13ca tempest-ProjectMemberTests-915988921 None] Lock "cinder-a885f72c-14eb-4224-a2e5-583c8a5eeef9-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:28:34 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-e494b027-0ef9-4bad-9753-2b1980ed13ca tempest-ProjectMemberTests-915988921 None] Acquiring lock "cinder-quobyte-a885f72c-14eb-4224-a2e5-583c8a5eeef9" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:28:34 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-e494b027-0ef9-4bad-9753-2b1980ed13ca tempest-ProjectMemberTests-915988921 None] Lock "cinder-quobyte-a885f72c-14eb-4224-a2e5-583c8a5eeef9" acquired by "delete_volume" :: waited 0.017s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:28:34 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[c606ed3a-b927-4678-a354-ddd8b32890a0]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:28:34 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e494b027-0ef9-4bad-9753-2b1980ed13ca tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a885f72c-14eb-4224-a2e5-583c8a5eeef9 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:34 devstack sudo[107486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a885f72c-14eb-4224-a2e5-583c8a5eeef9 Jul 10 10:28:34 devstack sudo[107486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:34 devstack sudo[107486]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:34 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e494b027-0ef9-4bad-9753-2b1980ed13ca tempest-ProjectMemberTests-915988921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a885f72c-14eb-4224-a2e5-583c8a5eeef9" returned: 0 in 0.853s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:34 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e494b027-0ef9-4bad-9753-2b1980ed13ca tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a885f72c-14eb-4224-a2e5-583c8a5eeef9 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:34 devstack sudo[107491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a885f72c-14eb-4224-a2e5-583c8a5eeef9 Jul 10 10:28:34 devstack sudo[107491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:35 devstack sudo[107491]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:35 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e494b027-0ef9-4bad-9753-2b1980ed13ca tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a885f72c-14eb-4224-a2e5-583c8a5eeef9" returned: 0 in 0.687s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:35 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-e494b027-0ef9-4bad-9753-2b1980ed13ca tempest-ProjectMemberTests-915988921 None] Lock "cinder-quobyte-a885f72c-14eb-4224-a2e5-583c8a5eeef9" released by "delete_volume" :: held 1.612s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:28:35 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-e494b027-0ef9-4bad-9753-2b1980ed13ca tempest-ProjectMemberTests-915988921 None] Created reservations ['c8b6aac4-f0ad-4e37-9d3e-1e8f60b681c4', '44fe4672-f85d-4392-aa11-31925b3f3657', '38fb95d5-f70d-4ab4-8e1d-488949475cf5', '0cd7cbbf-7c56-49aa-af4d-4cac9410b40e'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:28:35 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-e494b027-0ef9-4bad-9753-2b1980ed13ca tempest-ProjectMemberTests-915988921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:28:35 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-e494b027-0ef9-4bad-9753-2b1980ed13ca tempest-ProjectMemberTests-915988921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:28:35 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-e494b027-0ef9-4bad-9753-2b1980ed13ca tempest-ProjectMemberTests-915988921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:28:35 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-e494b027-0ef9-4bad-9753-2b1980ed13ca tempest-ProjectMemberTests-915988921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:28:35 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-e494b027-0ef9-4bad-9753-2b1980ed13ca tempest-ProjectMemberTests-915988921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:28:35 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e494b027-0ef9-4bad-9753-2b1980ed13ca tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:35 devstack sudo[107494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:28:35 devstack sudo[107494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:36 devstack sudo[107494]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:36 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-e494b027-0ef9-4bad-9753-2b1980ed13ca tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.726s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:36 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-e494b027-0ef9-4bad-9753-2b1980ed13ca tempest-ProjectMemberTests-915988921 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:28:36 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-e494b027-0ef9-4bad-9753-2b1980ed13ca tempest-ProjectMemberTests-915988921 None] Deleted volume successfully. Jul 10 10:28:36 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-e494b027-0ef9-4bad-9753-2b1980ed13ca tempest-ProjectMemberTests-915988921 None] Lock "cinder-a885f72c-14eb-4224-a2e5-583c8a5eeef9-delete_volume" released by "delete_volume" :: held 2.570s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:28:36 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf1566e1-3b44-4177-9c48-fb541662db85 tempest-ProjectMemberTests-915988921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:28:36 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-cf1566e1-3b44-4177-9c48-fb541662db85 tempest-ProjectMemberTests-915988921 None] Flow 'volume_create_manager' (d1ceadfa-4e1c-4ea3-99bf-3149edba362b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:28:36 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-cf1566e1-3b44-4177-9c48-fb541662db85 tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4c339d6-2e94-475c-b1a6-a399ed07a0e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:28:36 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-cf1566e1-3b44-4177-9c48-fb541662db85 tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4c339d6-2e94-475c-b1a6-a399ed07a0e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:28:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-493115684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8da0de4-82ea-4754-902f-6d06b8fd78d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac4b039bd3aa49f393fe3462e2fed6d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:28:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:28:37Z,use_quota=True,user_id='cc3f433661ac4946825a66613f6d748c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:28:36 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-cf1566e1-3b44-4177-9c48-fb541662db85 tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5848af0-e86b-44c9-b29d-da7ef5b1f63c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:28:36 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-cf1566e1-3b44-4177-9c48-fb541662db85 tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5848af0-e86b-44c9-b29d-da7ef5b1f63c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:28:36 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-cf1566e1-3b44-4177-9c48-fb541662db85 tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb4771ac-0798-4aa1-be5b-c0ee4ee14b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:28:36 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-cf1566e1-3b44-4177-9c48-fb541662db85 tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb4771ac-0798-4aa1-be5b-c0ee4ee14b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8da0de4-82ea-4754-902f-6d06b8fd78d8', 'volume_name': 'volume-b8da0de4-82ea-4754-902f-6d06b8fd78d8', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:28:36 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-cf1566e1-3b44-4177-9c48-fb541662db85 tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d321da73-3f6b-4f9a-b6b6-27663bc5694c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:28:36 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-cf1566e1-3b44-4177-9c48-fb541662db85 tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d321da73-3f6b-4f9a-b6b6-27663bc5694c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:28:36 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-cf1566e1-3b44-4177-9c48-fb541662db85 tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd5388a5-7cde-4f74-8ac3-5c67c63abb76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:28:36 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-cf1566e1-3b44-4177-9c48-fb541662db85 tempest-ProjectMemberTests-915988921 None] Volume b8da0de4-82ea-4754-902f-6d06b8fd78d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8da0de4-82ea-4754-902f-6d06b8fd78d8', 'volume_size': 1} Jul 10 10:28:36 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-cf1566e1-3b44-4177-9c48-fb541662db85 tempest-ProjectMemberTests-915988921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:28:36 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-cf1566e1-3b44-4177-9c48-fb541662db85 tempest-ProjectMemberTests-915988921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:28:36 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-cf1566e1-3b44-4177-9c48-fb541662db85 tempest-ProjectMemberTests-915988921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:28:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-493115684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8da0de4-82ea-4754-902f-6d06b8fd78d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac4b039bd3aa49f393fe3462e2fed6d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:28:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:28:37Z,use_quota=True,user_id='cc3f433661ac4946825a66613f6d748c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:28:36 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-cf1566e1-3b44-4177-9c48-fb541662db85 tempest-ProjectMemberTests-915988921 None] Creating volume b8da0de4-82ea-4754-902f-6d06b8fd78d8 {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:28:36 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-cf1566e1-3b44-4177-9c48-fb541662db85 tempest-ProjectMemberTests-915988921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:28:36 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-cf1566e1-3b44-4177-9c48-fb541662db85 tempest-ProjectMemberTests-915988921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:28:36 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-cf1566e1-3b44-4177-9c48-fb541662db85 tempest-ProjectMemberTests-915988921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:28:36 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-cf1566e1-3b44-4177-9c48-fb541662db85 tempest-ProjectMemberTests-915988921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:28:36 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-cf1566e1-3b44-4177-9c48-fb541662db85 tempest-ProjectMemberTests-915988921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:28:36 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-cf1566e1-3b44-4177-9c48-fb541662db85 tempest-ProjectMemberTests-915988921 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:28:36 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-cf1566e1-3b44-4177-9c48-fb541662db85 tempest-ProjectMemberTests-915988921 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:28:36 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-cf1566e1-3b44-4177-9c48-fb541662db85 tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b8da0de4-82ea-4754-902f-6d06b8fd78d8 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:36 devstack sudo[107497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b8da0de4-82ea-4754-902f-6d06b8fd78d8 1073741824 Jul 10 10:28:36 devstack sudo[107497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:37 devstack sudo[107497]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:37 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-cf1566e1-3b44-4177-9c48-fb541662db85 tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b8da0de4-82ea-4754-902f-6d06b8fd78d8 1073741824" returned: 0 in 0.854s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:37 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-cf1566e1-3b44-4177-9c48-fb541662db85 tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b8da0de4-82ea-4754-902f-6d06b8fd78d8 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:37 devstack sudo[107503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b8da0de4-82ea-4754-902f-6d06b8fd78d8 Jul 10 10:28:37 devstack sudo[107503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:38 devstack sudo[107503]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-cf1566e1-3b44-4177-9c48-fb541662db85 tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b8da0de4-82ea-4754-902f-6d06b8fd78d8" returned: 0 in 0.655s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:38 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-cf1566e1-3b44-4177-9c48-fb541662db85 tempest-ProjectMemberTests-915988921 None] <== create_volume: return (1555ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:28:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-cf1566e1-3b44-4177-9c48-fb541662db85 tempest-ProjectMemberTests-915988921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.558s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:28:38 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-cf1566e1-3b44-4177-9c48-fb541662db85 tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd5388a5-7cde-4f74-8ac3-5c67c63abb76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8da0de4-82ea-4754-902f-6d06b8fd78d8', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:28:38 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-cf1566e1-3b44-4177-9c48-fb541662db85 tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06d759a3-f888-49d9-9f55-5748ea9168c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:28:38 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-cf1566e1-3b44-4177-9c48-fb541662db85 tempest-ProjectMemberTests-915988921 None] Volume volume-b8da0de4-82ea-4754-902f-6d06b8fd78d8 (b8da0de4-82ea-4754-902f-6d06b8fd78d8): created successfully Jul 10 10:28:38 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-cf1566e1-3b44-4177-9c48-fb541662db85 tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06d759a3-f888-49d9-9f55-5748ea9168c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:28:38 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-cf1566e1-3b44-4177-9c48-fb541662db85 tempest-ProjectMemberTests-915988921 None] Flow 'volume_create_manager' (d1ceadfa-4e1c-4ea3-99bf-3149edba362b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:28:38 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-cf1566e1-3b44-4177-9c48-fb541662db85 tempest-ProjectMemberTests-915988921 None] Created volume successfully. Jul 10 10:28:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-24200d96-971f-44b8-a070-cd1dbef70e6d tempest-ProjectMemberTests-915988921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:28:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-24200d96-971f-44b8-a070-cd1dbef70e6d tempest-ProjectMemberTests-915988921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:28:38 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-24200d96-971f-44b8-a070-cd1dbef70e6d tempest-ProjectMemberTests-915988921 None] Creating offline snapshot 6bd3f4e2-7cda-4d50-81a9-6ca79c4b888e of volume b8da0de4-82ea-4754-902f-6d06b8fd78d8 {{(pid=87234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 10:28:38 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a7fe5ca-fb72-47bf-a755-bcfa019d4d63]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:28:38 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-24200d96-971f-44b8-a070-cd1dbef70e6d tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b8da0de4-82ea-4754-902f-6d06b8fd78d8 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:39 devstack sudo[107506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b8da0de4-82ea-4754-902f-6d06b8fd78d8 Jul 10 10:28:39 devstack sudo[107506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:39 devstack sudo[107506]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:39 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-24200d96-971f-44b8-a070-cd1dbef70e6d tempest-ProjectMemberTests-915988921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b8da0de4-82ea-4754-902f-6d06b8fd78d8" returned: 0 in 0.768s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:39 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-24200d96-971f-44b8-a070-cd1dbef70e6d tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b8da0de4-82ea-4754-902f-6d06b8fd78d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b8da0de4-82ea-4754-902f-6d06b8fd78d8.6bd3f4e2-7cda-4d50-81a9-6ca79c4b888e 1G {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:39 devstack sudo[107511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b8da0de4-82ea-4754-902f-6d06b8fd78d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b8da0de4-82ea-4754-902f-6d06b8fd78d8.6bd3f4e2-7cda-4d50-81a9-6ca79c4b888e 1G Jul 10 10:28:39 devstack sudo[107511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:40 devstack sudo[107511]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-24200d96-971f-44b8-a070-cd1dbef70e6d tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b8da0de4-82ea-4754-902f-6d06b8fd78d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b8da0de4-82ea-4754-902f-6d06b8fd78d8.6bd3f4e2-7cda-4d50-81a9-6ca79c4b888e 1G" returned: 0 in 0.831s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:40 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-24200d96-971f-44b8-a070-cd1dbef70e6d tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8da0de4-82ea-4754-902f-6d06b8fd78d8 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b8da0de4-82ea-4754-902f-6d06b8fd78d8.6bd3f4e2-7cda-4d50-81a9-6ca79c4b888e {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:40 devstack sudo[107516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8da0de4-82ea-4754-902f-6d06b8fd78d8 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b8da0de4-82ea-4754-902f-6d06b8fd78d8.6bd3f4e2-7cda-4d50-81a9-6ca79c4b888e Jul 10 10:28:40 devstack sudo[107516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:41 devstack sudo[107516]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-24200d96-971f-44b8-a070-cd1dbef70e6d tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8da0de4-82ea-4754-902f-6d06b8fd78d8 -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b8da0de4-82ea-4754-902f-6d06b8fd78d8.6bd3f4e2-7cda-4d50-81a9-6ca79c4b888e" returned: 0 in 0.687s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:41 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-24200d96-971f-44b8-a070-cd1dbef70e6d tempest-ProjectMemberTests-915988921 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b8da0de4-82ea-4754-902f-6d06b8fd78d8.6bd3f4e2-7cda-4d50-81a9-6ca79c4b888e is being set with open permissions: ugo+rw Jul 10 10:28:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-24200d96-971f-44b8-a070-cd1dbef70e6d tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b8da0de4-82ea-4754-902f-6d06b8fd78d8.6bd3f4e2-7cda-4d50-81a9-6ca79c4b888e {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:41 devstack sudo[107521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b8da0de4-82ea-4754-902f-6d06b8fd78d8.6bd3f4e2-7cda-4d50-81a9-6ca79c4b888e Jul 10 10:28:41 devstack sudo[107521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:41 devstack sudo[107521]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-24200d96-971f-44b8-a070-cd1dbef70e6d tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b8da0de4-82ea-4754-902f-6d06b8fd78d8.6bd3f4e2-7cda-4d50-81a9-6ca79c4b888e" returned: 0 in 0.666s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:41 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-24200d96-971f-44b8-a070-cd1dbef70e6d tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b8da0de4-82ea-4754-902f-6d06b8fd78d8.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:41 devstack sudo[107524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b8da0de4-82ea-4754-902f-6d06b8fd78d8.info Jul 10 10:28:41 devstack sudo[107524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:42 devstack cinder-volume[87234]: DEBUG oslo_service.periodic_task [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 10:28:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:28:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:28:42 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:28:42 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:28:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:28:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:42 devstack sudo[107526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:28:42 devstack sudo[107526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:42 devstack sudo[107524]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-24200d96-971f-44b8-a070-cd1dbef70e6d tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b8da0de4-82ea-4754-902f-6d06b8fd78d8.info" returned: 0 in 0.672s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:42 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-24200d96-971f-44b8-a070-cd1dbef70e6d tempest-ProjectMemberTests-915988921 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b8da0de4-82ea-4754-902f-6d06b8fd78d8.info is being set with open permissions: ugo+rw Jul 10 10:28:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-24200d96-971f-44b8-a070-cd1dbef70e6d tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b8da0de4-82ea-4754-902f-6d06b8fd78d8.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:42 devstack sudo[107529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b8da0de4-82ea-4754-902f-6d06b8fd78d8.info Jul 10 10:28:42 devstack sudo[107529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:42 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-59b6f901-ea5d-4039-bc34-9e9547f9ad39 tempest-ProjectReaderTests-915870083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:28:42 devstack sudo[107526]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:42 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-59b6f901-ea5d-4039-bc34-9e9547f9ad39 tempest-ProjectReaderTests-915870083 None] Flow 'volume_create_manager' (37434c74-ce90-47ac-bb18-e03688769d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:28:42 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-59b6f901-ea5d-4039-bc34-9e9547f9ad39 tempest-ProjectReaderTests-915870083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2547fff-c300-4e56-b96a-b81cd29dc3cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:28:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.775s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:42 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:28:42 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-59b6f901-ea5d-4039-bc34-9e9547f9ad39 tempest-ProjectReaderTests-915870083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2547fff-c300-4e56-b96a-b81cd29dc3cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:28:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1805469645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab60b2e8-410e-442a-a40e-d332d3e3c7ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0576d19b5bc74984a5bd77b78e049c0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:28:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:28:43Z,use_quota=True,user_id='5b3ef76bd18c49be9f286b80c45a67db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:28:42 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-59b6f901-ea5d-4039-bc34-9e9547f9ad39 tempest-ProjectReaderTests-915870083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72b7961e-213f-4967-b2e5-060d85b287f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:28:42 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-59b6f901-ea5d-4039-bc34-9e9547f9ad39 tempest-ProjectReaderTests-915870083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72b7961e-213f-4967-b2e5-060d85b287f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:28:42 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-59b6f901-ea5d-4039-bc34-9e9547f9ad39 tempest-ProjectReaderTests-915870083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17fb20c2-8513-40d4-835c-01ed04adef71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:28:42 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-59b6f901-ea5d-4039-bc34-9e9547f9ad39 tempest-ProjectReaderTests-915870083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17fb20c2-8513-40d4-835c-01ed04adef71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab60b2e8-410e-442a-a40e-d332d3e3c7ec', 'volume_name': 'volume-ab60b2e8-410e-442a-a40e-d332d3e3c7ec', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:28:42 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-59b6f901-ea5d-4039-bc34-9e9547f9ad39 tempest-ProjectReaderTests-915870083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecec3fb3-7dee-438d-854c-7bce61b28ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:28:42 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-59b6f901-ea5d-4039-bc34-9e9547f9ad39 tempest-ProjectReaderTests-915870083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecec3fb3-7dee-438d-854c-7bce61b28ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:28:42 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-59b6f901-ea5d-4039-bc34-9e9547f9ad39 tempest-ProjectReaderTests-915870083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50d207ac-4306-49e8-891b-02f97d02b374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:28:42 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-59b6f901-ea5d-4039-bc34-9e9547f9ad39 tempest-ProjectReaderTests-915870083 None] Volume ab60b2e8-410e-442a-a40e-d332d3e3c7ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab60b2e8-410e-442a-a40e-d332d3e3c7ec', 'volume_size': 1} Jul 10 10:28:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-59b6f901-ea5d-4039-bc34-9e9547f9ad39 tempest-ProjectReaderTests-915870083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:28:42 devstack cinder-volume[87234]: DEBUG oslo_service.periodic_task [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Running periodic task VolumeManager._thread_info {{(pid=87234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 10:28:42 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] thread count: 28 {{(pid=87234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 10:28:42 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] thread info: [<_MainThread(MainThread, started 131600773742720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 10:28:43 devstack sudo[107529]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-24200d96-971f-44b8-a070-cd1dbef70e6d tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b8da0de4-82ea-4754-902f-6d06b8fd78d8.info" returned: 0 in 0.654s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-24200d96-971f-44b8-a070-cd1dbef70e6d tempest-ProjectMemberTests-915988921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.364s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:28:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-59b6f901-ea5d-4039-bc34-9e9547f9ad39 tempest-ProjectReaderTests-915870083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.344s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:28:43 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-59b6f901-ea5d-4039-bc34-9e9547f9ad39 tempest-ProjectReaderTests-915870083 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:28:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1805469645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab60b2e8-410e-442a-a40e-d332d3e3c7ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0576d19b5bc74984a5bd77b78e049c0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:28:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:28:43Z,use_quota=True,user_id='5b3ef76bd18c49be9f286b80c45a67db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:28:43 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-59b6f901-ea5d-4039-bc34-9e9547f9ad39 tempest-ProjectReaderTests-915870083 None] Creating volume ab60b2e8-410e-442a-a40e-d332d3e3c7ec {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:28:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-59b6f901-ea5d-4039-bc34-9e9547f9ad39 tempest-ProjectReaderTests-915870083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:28:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-59b6f901-ea5d-4039-bc34-9e9547f9ad39 tempest-ProjectReaderTests-915870083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:28:43 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-59b6f901-ea5d-4039-bc34-9e9547f9ad39 tempest-ProjectReaderTests-915870083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:28:43 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-59b6f901-ea5d-4039-bc34-9e9547f9ad39 tempest-ProjectReaderTests-915870083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:28:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-59b6f901-ea5d-4039-bc34-9e9547f9ad39 tempest-ProjectReaderTests-915870083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:28:43 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-59b6f901-ea5d-4039-bc34-9e9547f9ad39 tempest-ProjectReaderTests-915870083 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:28:43 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-59b6f901-ea5d-4039-bc34-9e9547f9ad39 tempest-ProjectReaderTests-915870083 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:28:43 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-59b6f901-ea5d-4039-bc34-9e9547f9ad39 tempest-ProjectReaderTests-915870083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ab60b2e8-410e-442a-a40e-d332d3e3c7ec 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:43 devstack sudo[107533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ab60b2e8-410e-442a-a40e-d332d3e3c7ec 1073741824 Jul 10 10:28:43 devstack sudo[107533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:43 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-24200d96-971f-44b8-a070-cd1dbef70e6d tempest-ProjectMemberTests-915988921 None] Create snapshot completed successfully Jul 10 10:28:44 devstack sudo[107533]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-59b6f901-ea5d-4039-bc34-9e9547f9ad39 tempest-ProjectReaderTests-915870083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ab60b2e8-410e-442a-a40e-d332d3e3c7ec 1073741824" returned: 0 in 0.797s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-59b6f901-ea5d-4039-bc34-9e9547f9ad39 tempest-ProjectReaderTests-915870083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ab60b2e8-410e-442a-a40e-d332d3e3c7ec {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:44 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-68652218-325f-4f47-9641-33e59ed9387d tempest-ProjectMemberTests-915988921 None] Acquiring lock "cinder-6bd3f4e2-7cda-4d50-81a9-6ca79c4b888e-delete_snapshot" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:28:44 devstack sudo[107538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ab60b2e8-410e-442a-a40e-d332d3e3c7ec Jul 10 10:28:44 devstack sudo[107538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:44 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-68652218-325f-4f47-9641-33e59ed9387d tempest-ProjectMemberTests-915988921 None] Lock "cinder-6bd3f4e2-7cda-4d50-81a9-6ca79c4b888e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:28:44 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-68652218-325f-4f47-9641-33e59ed9387d tempest-ProjectMemberTests-915988921 None] Acquiring lock "cinder-quobyte-b8da0de4-82ea-4754-902f-6d06b8fd78d8" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:28:44 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-68652218-325f-4f47-9641-33e59ed9387d tempest-ProjectMemberTests-915988921 None] Lock "cinder-quobyte-b8da0de4-82ea-4754-902f-6d06b8fd78d8" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:28:44 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-68652218-325f-4f47-9641-33e59ed9387d tempest-ProjectMemberTests-915988921 None] Acquiring lock "cinder-quobyte-6bd3f4e2-7cda-4d50-81a9-6ca79c4b888e" by "_delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:28:44 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-68652218-325f-4f47-9641-33e59ed9387d tempest-ProjectMemberTests-915988921 None] Lock "cinder-quobyte-6bd3f4e2-7cda-4d50-81a9-6ca79c4b888e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:28:44 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-68652218-325f-4f47-9641-33e59ed9387d tempest-ProjectMemberTests-915988921 None] Deleting offline snapshot 6bd3f4e2-7cda-4d50-81a9-6ca79c4b888e of volume b8da0de4-82ea-4754-902f-6d06b8fd78d8 {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 10:28:44 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-68652218-325f-4f47-9641-33e59ed9387d tempest-ProjectMemberTests-915988921 None] snapshot_file for this snap is: volume-b8da0de4-82ea-4754-902f-6d06b8fd78d8.6bd3f4e2-7cda-4d50-81a9-6ca79c4b888e {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 10:28:44 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[99fbd6e2-cf24-41a6-aab5-ef86b6e363aa]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:28:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-68652218-325f-4f47-9641-33e59ed9387d tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b8da0de4-82ea-4754-902f-6d06b8fd78d8.6bd3f4e2-7cda-4d50-81a9-6ca79c4b888e {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:44 devstack sudo[107540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b8da0de4-82ea-4754-902f-6d06b8fd78d8.6bd3f4e2-7cda-4d50-81a9-6ca79c4b888e Jul 10 10:28:44 devstack sudo[107540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:44 devstack sudo[107538]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-59b6f901-ea5d-4039-bc34-9e9547f9ad39 tempest-ProjectReaderTests-915870083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ab60b2e8-410e-442a-a40e-d332d3e3c7ec" returned: 0 in 0.691s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:44 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-59b6f901-ea5d-4039-bc34-9e9547f9ad39 tempest-ProjectReaderTests-915870083 None] <== create_volume: return (1527ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:28:44 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-59b6f901-ea5d-4039-bc34-9e9547f9ad39 tempest-ProjectReaderTests-915870083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.533s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:28:44 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-59b6f901-ea5d-4039-bc34-9e9547f9ad39 tempest-ProjectReaderTests-915870083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50d207ac-4306-49e8-891b-02f97d02b374) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab60b2e8-410e-442a-a40e-d332d3e3c7ec', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:28:44 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-59b6f901-ea5d-4039-bc34-9e9547f9ad39 tempest-ProjectReaderTests-915870083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (675051bd-b8c9-4ef1-a456-db66e0e1b3e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:28:44 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-59b6f901-ea5d-4039-bc34-9e9547f9ad39 tempest-ProjectReaderTests-915870083 None] Volume volume-ab60b2e8-410e-442a-a40e-d332d3e3c7ec (ab60b2e8-410e-442a-a40e-d332d3e3c7ec): created successfully Jul 10 10:28:44 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-59b6f901-ea5d-4039-bc34-9e9547f9ad39 tempest-ProjectReaderTests-915870083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (675051bd-b8c9-4ef1-a456-db66e0e1b3e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:28:44 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-59b6f901-ea5d-4039-bc34-9e9547f9ad39 tempest-ProjectReaderTests-915870083 None] Flow 'volume_create_manager' (37434c74-ce90-47ac-bb18-e03688769d33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:28:44 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-59b6f901-ea5d-4039-bc34-9e9547f9ad39 tempest-ProjectReaderTests-915870083 None] Created volume successfully. Jul 10 10:28:45 devstack sudo[107540]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-68652218-325f-4f47-9641-33e59ed9387d tempest-ProjectMemberTests-915988921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b8da0de4-82ea-4754-902f-6d06b8fd78d8.6bd3f4e2-7cda-4d50-81a9-6ca79c4b888e" returned: 0 in 0.750s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:45 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-68652218-325f-4f47-9641-33e59ed9387d tempest-ProjectMemberTests-915988921 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b8da0de4-82ea-4754-902f-6d06b8fd78d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 10:28:45 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb60f43b-f452-44a9-b99b-a4bb0ce4cf09]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:28:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-68652218-325f-4f47-9641-33e59ed9387d tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b8da0de4-82ea-4754-902f-6d06b8fd78d8 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:45 devstack sudo[107546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b8da0de4-82ea-4754-902f-6d06b8fd78d8 Jul 10 10:28:45 devstack sudo[107546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:45 devstack sudo[107546]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-68652218-325f-4f47-9641-33e59ed9387d tempest-ProjectMemberTests-915988921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b8da0de4-82ea-4754-902f-6d06b8fd78d8" returned: 0 in 0.736s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:45 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-68652218-325f-4f47-9641-33e59ed9387d tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b8da0de4-82ea-4754-902f-6d06b8fd78d8.6bd3f4e2-7cda-4d50-81a9-6ca79c4b888e {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:45 devstack sudo[107551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b8da0de4-82ea-4754-902f-6d06b8fd78d8.6bd3f4e2-7cda-4d50-81a9-6ca79c4b888e Jul 10 10:28:45 devstack sudo[107551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:46 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f1bd7a46-5bb9-42da-9aed-8e5b0ded2768 tempest-ProjectReaderTests-915870083 None] Acquiring lock "cinder-ab60b2e8-410e-442a-a40e-d332d3e3c7ec-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:28:46 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f1bd7a46-5bb9-42da-9aed-8e5b0ded2768 tempest-ProjectReaderTests-915870083 None] Lock "cinder-ab60b2e8-410e-442a-a40e-d332d3e3c7ec-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:28:46 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f1bd7a46-5bb9-42da-9aed-8e5b0ded2768 tempest-ProjectReaderTests-915870083 None] Acquiring lock "cinder-quobyte-ab60b2e8-410e-442a-a40e-d332d3e3c7ec" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:28:46 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f1bd7a46-5bb9-42da-9aed-8e5b0ded2768 tempest-ProjectReaderTests-915870083 None] Lock "cinder-quobyte-ab60b2e8-410e-442a-a40e-d332d3e3c7ec" acquired by "delete_volume" :: waited 0.015s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:28:46 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f449b9-2d75-4c1a-a800-7d1392722cdd]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:28:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f1bd7a46-5bb9-42da-9aed-8e5b0ded2768 tempest-ProjectReaderTests-915870083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ab60b2e8-410e-442a-a40e-d332d3e3c7ec {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:46 devstack sudo[107553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ab60b2e8-410e-442a-a40e-d332d3e3c7ec Jul 10 10:28:46 devstack sudo[107553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:46 devstack sudo[107551]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-68652218-325f-4f47-9641-33e59ed9387d tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b8da0de4-82ea-4754-902f-6d06b8fd78d8.6bd3f4e2-7cda-4d50-81a9-6ca79c4b888e" returned: 0 in 0.769s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:46 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-68652218-325f-4f47-9641-33e59ed9387d tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b8da0de4-82ea-4754-902f-6d06b8fd78d8.6bd3f4e2-7cda-4d50-81a9-6ca79c4b888e {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:46 devstack sudo[107558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b8da0de4-82ea-4754-902f-6d06b8fd78d8.6bd3f4e2-7cda-4d50-81a9-6ca79c4b888e Jul 10 10:28:46 devstack sudo[107558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:47 devstack sudo[107553]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f1bd7a46-5bb9-42da-9aed-8e5b0ded2768 tempest-ProjectReaderTests-915870083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ab60b2e8-410e-442a-a40e-d332d3e3c7ec" returned: 0 in 0.810s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f1bd7a46-5bb9-42da-9aed-8e5b0ded2768 tempest-ProjectReaderTests-915870083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ab60b2e8-410e-442a-a40e-d332d3e3c7ec {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:47 devstack sudo[107564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ab60b2e8-410e-442a-a40e-d332d3e3c7ec Jul 10 10:28:47 devstack sudo[107564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:47 devstack sudo[107558]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-68652218-325f-4f47-9641-33e59ed9387d tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b8da0de4-82ea-4754-902f-6d06b8fd78d8.6bd3f4e2-7cda-4d50-81a9-6ca79c4b888e" returned: 0 in 0.637s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:47 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-68652218-325f-4f47-9641-33e59ed9387d tempest-ProjectMemberTests-915988921 None] Lock "cinder-quobyte-6bd3f4e2-7cda-4d50-81a9-6ca79c4b888e" released by "_delete_snapshot" :: held 2.985s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:28:47 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-68652218-325f-4f47-9641-33e59ed9387d tempest-ProjectMemberTests-915988921 None] Lock "cinder-quobyte-b8da0de4-82ea-4754-902f-6d06b8fd78d8" released by "delete_snapshot" :: held 3.009s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:28:47 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-68652218-325f-4f47-9641-33e59ed9387d tempest-ProjectMemberTests-915988921 None] Created reservations ['4717b6f1-f4b6-4ebe-a6b5-1b821feb630b', 'a628400b-41f0-4a2d-836f-cf4cab467e41', 'f95185b1-7dd2-42ef-99e3-748566ea9583', 'f0e976f2-c5b5-4143-ba5d-0e7f7d8e6523'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:28:47 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-68652218-325f-4f47-9641-33e59ed9387d tempest-ProjectMemberTests-915988921 None] Delete snapshot completed successfully. Jul 10 10:28:47 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-68652218-325f-4f47-9641-33e59ed9387d tempest-ProjectMemberTests-915988921 None] Lock "cinder-6bd3f4e2-7cda-4d50-81a9-6ca79c4b888e-delete_snapshot" released by "delete_snapshot" :: held 3.165s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:28:47 devstack sudo[107564]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f1bd7a46-5bb9-42da-9aed-8e5b0ded2768 tempest-ProjectReaderTests-915870083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-ab60b2e8-410e-442a-a40e-d332d3e3c7ec" returned: 0 in 0.653s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:47 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f1bd7a46-5bb9-42da-9aed-8e5b0ded2768 tempest-ProjectReaderTests-915870083 None] Lock "cinder-quobyte-ab60b2e8-410e-442a-a40e-d332d3e3c7ec" released by "delete_volume" :: held 1.499s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:28:47 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-f1bd7a46-5bb9-42da-9aed-8e5b0ded2768 tempest-ProjectReaderTests-915870083 None] Created reservations ['e202a1c1-c047-4e8b-bd9e-deb5048fba88', 'e500d0cf-9468-4d07-b2cc-e4fe5e991c9b', '0fdcda3e-6587-4451-826d-2952ec27856b', 'f45bdf1d-a307-4fd6-836f-d66165b73194'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:28:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f1bd7a46-5bb9-42da-9aed-8e5b0ded2768 tempest-ProjectReaderTests-915870083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:28:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f1bd7a46-5bb9-42da-9aed-8e5b0ded2768 tempest-ProjectReaderTests-915870083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:28:47 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f1bd7a46-5bb9-42da-9aed-8e5b0ded2768 tempest-ProjectReaderTests-915870083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:28:47 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-f1bd7a46-5bb9-42da-9aed-8e5b0ded2768 tempest-ProjectReaderTests-915870083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:28:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-f1bd7a46-5bb9-42da-9aed-8e5b0ded2768 tempest-ProjectReaderTests-915870083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:28:47 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f1bd7a46-5bb9-42da-9aed-8e5b0ded2768 tempest-ProjectReaderTests-915870083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:47 devstack sudo[107568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:28:47 devstack sudo[107568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:48 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-2c17d4d8-19dc-455b-9daa-b32106015113 tempest-ProjectMemberTests-915988921 None] Acquiring lock "cinder-b8da0de4-82ea-4754-902f-6d06b8fd78d8-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:28:48 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-2c17d4d8-19dc-455b-9daa-b32106015113 tempest-ProjectMemberTests-915988921 None] Lock "cinder-b8da0de4-82ea-4754-902f-6d06b8fd78d8-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:28:48 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-2c17d4d8-19dc-455b-9daa-b32106015113 tempest-ProjectMemberTests-915988921 None] Acquiring lock "cinder-quobyte-b8da0de4-82ea-4754-902f-6d06b8fd78d8" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:28:48 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-2c17d4d8-19dc-455b-9daa-b32106015113 tempest-ProjectMemberTests-915988921 None] Lock "cinder-quobyte-b8da0de4-82ea-4754-902f-6d06b8fd78d8" acquired by "delete_volume" :: waited 0.017s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:28:48 devstack sudo[107568]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-f1bd7a46-5bb9-42da-9aed-8e5b0ded2768 tempest-ProjectReaderTests-915870083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.660s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:48 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-f1bd7a46-5bb9-42da-9aed-8e5b0ded2768 tempest-ProjectReaderTests-915870083 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:28:48 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-f1bd7a46-5bb9-42da-9aed-8e5b0ded2768 tempest-ProjectReaderTests-915870083 None] Deleted volume successfully. Jul 10 10:28:48 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[3730e2ea-bbe4-40c3-be1f-2c33184bd64c]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:28:48 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-2c17d4d8-19dc-455b-9daa-b32106015113 tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b8da0de4-82ea-4754-902f-6d06b8fd78d8 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:48 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-f1bd7a46-5bb9-42da-9aed-8e5b0ded2768 tempest-ProjectReaderTests-915870083 None] Lock "cinder-ab60b2e8-410e-442a-a40e-d332d3e3c7ec-delete_volume" released by "delete_volume" :: held 2.365s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:28:48 devstack sudo[107571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b8da0de4-82ea-4754-902f-6d06b8fd78d8 Jul 10 10:28:48 devstack sudo[107571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:48 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-8736e0bc-a2fe-4296-a12c-e5bf022e9df6 tempest-ProjectReaderTests-915870083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:28:48 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8736e0bc-a2fe-4296-a12c-e5bf022e9df6 tempest-ProjectReaderTests-915870083 None] Flow 'volume_create_manager' (1613935b-78f0-4c7a-ada0-e56ed7c711b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:28:48 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8736e0bc-a2fe-4296-a12c-e5bf022e9df6 tempest-ProjectReaderTests-915870083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9755496-4a6e-4235-a8a9-ce0c1c60088e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:28:48 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8736e0bc-a2fe-4296-a12c-e5bf022e9df6 tempest-ProjectReaderTests-915870083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9755496-4a6e-4235-a8a9-ce0c1c60088e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:28:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-330712383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64aec19e-f7e5-4a49-8031-c63a0f5aa74e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0576d19b5bc74984a5bd77b78e049c0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:28:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:28:49Z,use_quota=True,user_id='5b3ef76bd18c49be9f286b80c45a67db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:28:49 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8736e0bc-a2fe-4296-a12c-e5bf022e9df6 tempest-ProjectReaderTests-915870083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff736796-c751-4aff-8385-d038b1e27d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:28:49 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8736e0bc-a2fe-4296-a12c-e5bf022e9df6 tempest-ProjectReaderTests-915870083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff736796-c751-4aff-8385-d038b1e27d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:28:49 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8736e0bc-a2fe-4296-a12c-e5bf022e9df6 tempest-ProjectReaderTests-915870083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45dd608f-a6bc-4aa3-8cdd-3c8ef03a0328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:28:49 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8736e0bc-a2fe-4296-a12c-e5bf022e9df6 tempest-ProjectReaderTests-915870083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45dd608f-a6bc-4aa3-8cdd-3c8ef03a0328) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64aec19e-f7e5-4a49-8031-c63a0f5aa74e', 'volume_name': 'volume-64aec19e-f7e5-4a49-8031-c63a0f5aa74e', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:28:49 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8736e0bc-a2fe-4296-a12c-e5bf022e9df6 tempest-ProjectReaderTests-915870083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abbd87d8-438b-4c1f-bdc8-9a885c3eaf14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:28:49 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8736e0bc-a2fe-4296-a12c-e5bf022e9df6 tempest-ProjectReaderTests-915870083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abbd87d8-438b-4c1f-bdc8-9a885c3eaf14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:28:49 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8736e0bc-a2fe-4296-a12c-e5bf022e9df6 tempest-ProjectReaderTests-915870083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e97f4ea-5e96-4de2-a59d-fbf9375112ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:28:49 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-8736e0bc-a2fe-4296-a12c-e5bf022e9df6 tempest-ProjectReaderTests-915870083 None] Volume 64aec19e-f7e5-4a49-8031-c63a0f5aa74e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64aec19e-f7e5-4a49-8031-c63a0f5aa74e', 'volume_size': 1} Jul 10 10:28:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-8736e0bc-a2fe-4296-a12c-e5bf022e9df6 tempest-ProjectReaderTests-915870083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:28:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-8736e0bc-a2fe-4296-a12c-e5bf022e9df6 tempest-ProjectReaderTests-915870083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:28:49 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-8736e0bc-a2fe-4296-a12c-e5bf022e9df6 tempest-ProjectReaderTests-915870083 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:28:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-330712383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64aec19e-f7e5-4a49-8031-c63a0f5aa74e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0576d19b5bc74984a5bd77b78e049c0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:28:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:28:49Z,use_quota=True,user_id='5b3ef76bd18c49be9f286b80c45a67db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:28:49 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-8736e0bc-a2fe-4296-a12c-e5bf022e9df6 tempest-ProjectReaderTests-915870083 None] Creating volume 64aec19e-f7e5-4a49-8031-c63a0f5aa74e {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:28:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-8736e0bc-a2fe-4296-a12c-e5bf022e9df6 tempest-ProjectReaderTests-915870083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:28:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-8736e0bc-a2fe-4296-a12c-e5bf022e9df6 tempest-ProjectReaderTests-915870083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:28:49 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-8736e0bc-a2fe-4296-a12c-e5bf022e9df6 tempest-ProjectReaderTests-915870083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:28:49 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-8736e0bc-a2fe-4296-a12c-e5bf022e9df6 tempest-ProjectReaderTests-915870083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:28:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-8736e0bc-a2fe-4296-a12c-e5bf022e9df6 tempest-ProjectReaderTests-915870083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:28:49 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-8736e0bc-a2fe-4296-a12c-e5bf022e9df6 tempest-ProjectReaderTests-915870083 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:28:49 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-8736e0bc-a2fe-4296-a12c-e5bf022e9df6 tempest-ProjectReaderTests-915870083 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:28:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-8736e0bc-a2fe-4296-a12c-e5bf022e9df6 tempest-ProjectReaderTests-915870083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-64aec19e-f7e5-4a49-8031-c63a0f5aa74e 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:49 devstack sudo[107573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-64aec19e-f7e5-4a49-8031-c63a0f5aa74e 1073741824 Jul 10 10:28:49 devstack sudo[107573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:49 devstack sudo[107571]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-2c17d4d8-19dc-455b-9daa-b32106015113 tempest-ProjectMemberTests-915988921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b8da0de4-82ea-4754-902f-6d06b8fd78d8" returned: 0 in 0.761s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-2c17d4d8-19dc-455b-9daa-b32106015113 tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b8da0de4-82ea-4754-902f-6d06b8fd78d8 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:49 devstack sudo[107578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b8da0de4-82ea-4754-902f-6d06b8fd78d8 Jul 10 10:28:49 devstack sudo[107578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:49 devstack sudo[107573]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-8736e0bc-a2fe-4296-a12c-e5bf022e9df6 tempest-ProjectReaderTests-915870083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-64aec19e-f7e5-4a49-8031-c63a0f5aa74e 1073741824" returned: 0 in 0.857s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:49 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-8736e0bc-a2fe-4296-a12c-e5bf022e9df6 tempest-ProjectReaderTests-915870083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-64aec19e-f7e5-4a49-8031-c63a0f5aa74e {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:49 devstack sudo[107585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-64aec19e-f7e5-4a49-8031-c63a0f5aa74e Jul 10 10:28:49 devstack sudo[107585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:50 devstack sudo[107578]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-2c17d4d8-19dc-455b-9daa-b32106015113 tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-b8da0de4-82ea-4754-902f-6d06b8fd78d8" returned: 0 in 0.665s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:50 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-2c17d4d8-19dc-455b-9daa-b32106015113 tempest-ProjectMemberTests-915988921 None] Lock "cinder-quobyte-b8da0de4-82ea-4754-902f-6d06b8fd78d8" released by "delete_volume" :: held 1.504s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:28:50 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-2c17d4d8-19dc-455b-9daa-b32106015113 tempest-ProjectMemberTests-915988921 None] Created reservations ['3f1429bf-c393-406d-bbb6-f34c489c5760', '4d3de251-ed29-468e-a81b-701270101671', '3e77feff-6004-4ec4-88eb-4f4c3d632c97', 'd694b6f7-2344-4d34-9c62-5ecde9039cea'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:28:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-2c17d4d8-19dc-455b-9daa-b32106015113 tempest-ProjectMemberTests-915988921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:28:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-2c17d4d8-19dc-455b-9daa-b32106015113 tempest-ProjectMemberTests-915988921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:28:50 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-2c17d4d8-19dc-455b-9daa-b32106015113 tempest-ProjectMemberTests-915988921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:28:50 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-2c17d4d8-19dc-455b-9daa-b32106015113 tempest-ProjectMemberTests-915988921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:28:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-2c17d4d8-19dc-455b-9daa-b32106015113 tempest-ProjectMemberTests-915988921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:28:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-2c17d4d8-19dc-455b-9daa-b32106015113 tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:50 devstack sudo[107587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:28:50 devstack sudo[107587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:50 devstack sudo[107585]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-8736e0bc-a2fe-4296-a12c-e5bf022e9df6 tempest-ProjectReaderTests-915870083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-64aec19e-f7e5-4a49-8031-c63a0f5aa74e" returned: 0 in 0.708s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:50 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-8736e0bc-a2fe-4296-a12c-e5bf022e9df6 tempest-ProjectReaderTests-915870083 None] <== create_volume: return (1620ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:28:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-8736e0bc-a2fe-4296-a12c-e5bf022e9df6 tempest-ProjectReaderTests-915870083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.624s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:28:50 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8736e0bc-a2fe-4296-a12c-e5bf022e9df6 tempest-ProjectReaderTests-915870083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e97f4ea-5e96-4de2-a59d-fbf9375112ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64aec19e-f7e5-4a49-8031-c63a0f5aa74e', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:28:50 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8736e0bc-a2fe-4296-a12c-e5bf022e9df6 tempest-ProjectReaderTests-915870083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faa1b081-be26-446d-9196-3e76d6ad7cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:28:50 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-8736e0bc-a2fe-4296-a12c-e5bf022e9df6 tempest-ProjectReaderTests-915870083 None] Volume volume-64aec19e-f7e5-4a49-8031-c63a0f5aa74e (64aec19e-f7e5-4a49-8031-c63a0f5aa74e): created successfully Jul 10 10:28:50 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8736e0bc-a2fe-4296-a12c-e5bf022e9df6 tempest-ProjectReaderTests-915870083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faa1b081-be26-446d-9196-3e76d6ad7cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:28:50 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8736e0bc-a2fe-4296-a12c-e5bf022e9df6 tempest-ProjectReaderTests-915870083 None] Flow 'volume_create_manager' (1613935b-78f0-4c7a-ada0-e56ed7c711b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:28:50 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-8736e0bc-a2fe-4296-a12c-e5bf022e9df6 tempest-ProjectReaderTests-915870083 None] Created volume successfully. Jul 10 10:28:50 devstack sudo[107587]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:50 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-2c17d4d8-19dc-455b-9daa-b32106015113 tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.692s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:50 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-2c17d4d8-19dc-455b-9daa-b32106015113 tempest-ProjectMemberTests-915988921 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:28:50 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-2c17d4d8-19dc-455b-9daa-b32106015113 tempest-ProjectMemberTests-915988921 None] Deleted volume successfully. Jul 10 10:28:50 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-2c17d4d8-19dc-455b-9daa-b32106015113 tempest-ProjectMemberTests-915988921 None] Lock "cinder-b8da0de4-82ea-4754-902f-6d06b8fd78d8-delete_volume" released by "delete_volume" :: held 2.421s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:28:51 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-4dd931bd-5d34-42f1-9eaf-0d4d7105aaf7 tempest-ProjectReaderTests-915870083 None] Acquiring lock "cinder-64aec19e-f7e5-4a49-8031-c63a0f5aa74e-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:28:51 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-4dd931bd-5d34-42f1-9eaf-0d4d7105aaf7 tempest-ProjectReaderTests-915870083 None] Lock "cinder-64aec19e-f7e5-4a49-8031-c63a0f5aa74e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:28:51 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-55ba2c60-824f-4112-9f26-7b5259e4be04 tempest-ProjectMemberTests-915988921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:28:51 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-55ba2c60-824f-4112-9f26-7b5259e4be04 tempest-ProjectMemberTests-915988921 None] Flow 'volume_create_manager' (d99991cd-ff9c-4bb4-96c2-299ccc7d6f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:28:51 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-55ba2c60-824f-4112-9f26-7b5259e4be04 tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a076e0b-b6e7-4b2a-8f28-b98d9e7324c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:28:51 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-4dd931bd-5d34-42f1-9eaf-0d4d7105aaf7 tempest-ProjectReaderTests-915870083 None] Acquiring lock "cinder-quobyte-64aec19e-f7e5-4a49-8031-c63a0f5aa74e" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:28:51 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-55ba2c60-824f-4112-9f26-7b5259e4be04 tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a076e0b-b6e7-4b2a-8f28-b98d9e7324c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:28:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1223212257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a46313ff-bd56-4195-a58d-7c02d9284e3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac4b039bd3aa49f393fe3462e2fed6d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:28:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:28:51Z,use_quota=True,user_id='cc3f433661ac4946825a66613f6d748c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:28:51 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-55ba2c60-824f-4112-9f26-7b5259e4be04 tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e81daa3d-4ee9-43ca-9984-63765d5b41c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:28:51 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-55ba2c60-824f-4112-9f26-7b5259e4be04 tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e81daa3d-4ee9-43ca-9984-63765d5b41c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:28:51 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-55ba2c60-824f-4112-9f26-7b5259e4be04 tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (325053f5-3df1-4349-9518-d419fcbffdb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:28:51 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-55ba2c60-824f-4112-9f26-7b5259e4be04 tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (325053f5-3df1-4349-9518-d419fcbffdb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a46313ff-bd56-4195-a58d-7c02d9284e3f', 'volume_name': 'volume-a46313ff-bd56-4195-a58d-7c02d9284e3f', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:28:51 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-55ba2c60-824f-4112-9f26-7b5259e4be04 tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (032e71f4-3e4a-4d41-8775-eef9783944a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:28:51 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-55ba2c60-824f-4112-9f26-7b5259e4be04 tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (032e71f4-3e4a-4d41-8775-eef9783944a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:28:51 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-55ba2c60-824f-4112-9f26-7b5259e4be04 tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20781015-2e12-4dd8-b850-80f21719a13d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:28:51 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-55ba2c60-824f-4112-9f26-7b5259e4be04 tempest-ProjectMemberTests-915988921 None] Volume a46313ff-bd56-4195-a58d-7c02d9284e3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a46313ff-bd56-4195-a58d-7c02d9284e3f', 'volume_size': 1} Jul 10 10:28:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-55ba2c60-824f-4112-9f26-7b5259e4be04 tempest-ProjectMemberTests-915988921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:28:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-55ba2c60-824f-4112-9f26-7b5259e4be04 tempest-ProjectMemberTests-915988921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:28:51 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-55ba2c60-824f-4112-9f26-7b5259e4be04 tempest-ProjectMemberTests-915988921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:28:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1223212257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a46313ff-bd56-4195-a58d-7c02d9284e3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac4b039bd3aa49f393fe3462e2fed6d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:28:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:28:51Z,use_quota=True,user_id='cc3f433661ac4946825a66613f6d748c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:28:51 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-55ba2c60-824f-4112-9f26-7b5259e4be04 tempest-ProjectMemberTests-915988921 None] Creating volume a46313ff-bd56-4195-a58d-7c02d9284e3f {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:28:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-55ba2c60-824f-4112-9f26-7b5259e4be04 tempest-ProjectMemberTests-915988921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:28:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-55ba2c60-824f-4112-9f26-7b5259e4be04 tempest-ProjectMemberTests-915988921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:28:51 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-55ba2c60-824f-4112-9f26-7b5259e4be04 tempest-ProjectMemberTests-915988921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:28:51 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-55ba2c60-824f-4112-9f26-7b5259e4be04 tempest-ProjectMemberTests-915988921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:28:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-55ba2c60-824f-4112-9f26-7b5259e4be04 tempest-ProjectMemberTests-915988921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:28:51 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-55ba2c60-824f-4112-9f26-7b5259e4be04 tempest-ProjectMemberTests-915988921 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:28:51 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-55ba2c60-824f-4112-9f26-7b5259e4be04 tempest-ProjectMemberTests-915988921 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:28:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-55ba2c60-824f-4112-9f26-7b5259e4be04 tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a46313ff-bd56-4195-a58d-7c02d9284e3f 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:51 devstack sudo[107591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a46313ff-bd56-4195-a58d-7c02d9284e3f 1073741824 Jul 10 10:28:51 devstack sudo[107591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:51 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-4dd931bd-5d34-42f1-9eaf-0d4d7105aaf7 tempest-ProjectReaderTests-915870083 None] Lock "cinder-quobyte-64aec19e-f7e5-4a49-8031-c63a0f5aa74e" acquired by "delete_volume" :: waited 0.077s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:28:51 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[c193153d-cf20-47f1-9a62-aaf6e2fac0f1]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:28:51 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4dd931bd-5d34-42f1-9eaf-0d4d7105aaf7 tempest-ProjectReaderTests-915870083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-64aec19e-f7e5-4a49-8031-c63a0f5aa74e {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:51 devstack sudo[107593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-64aec19e-f7e5-4a49-8031-c63a0f5aa74e Jul 10 10:28:51 devstack sudo[107593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:52 devstack sudo[107593]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4dd931bd-5d34-42f1-9eaf-0d4d7105aaf7 tempest-ProjectReaderTests-915870083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-64aec19e-f7e5-4a49-8031-c63a0f5aa74e" returned: 0 in 0.767s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4dd931bd-5d34-42f1-9eaf-0d4d7105aaf7 tempest-ProjectReaderTests-915870083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-64aec19e-f7e5-4a49-8031-c63a0f5aa74e {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:52 devstack sudo[107601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-64aec19e-f7e5-4a49-8031-c63a0f5aa74e Jul 10 10:28:52 devstack sudo[107601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:52 devstack sudo[107591]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-55ba2c60-824f-4112-9f26-7b5259e4be04 tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a46313ff-bd56-4195-a58d-7c02d9284e3f 1073741824" returned: 0 in 0.857s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-55ba2c60-824f-4112-9f26-7b5259e4be04 tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a46313ff-bd56-4195-a58d-7c02d9284e3f {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:52 devstack sudo[107603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a46313ff-bd56-4195-a58d-7c02d9284e3f Jul 10 10:28:52 devstack sudo[107603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:52 devstack sudo[107601]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4dd931bd-5d34-42f1-9eaf-0d4d7105aaf7 tempest-ProjectReaderTests-915870083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-64aec19e-f7e5-4a49-8031-c63a0f5aa74e" returned: 0 in 0.648s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:52 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-4dd931bd-5d34-42f1-9eaf-0d4d7105aaf7 tempest-ProjectReaderTests-915870083 None] Lock "cinder-quobyte-64aec19e-f7e5-4a49-8031-c63a0f5aa74e" released by "delete_volume" :: held 1.458s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:28:52 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-4dd931bd-5d34-42f1-9eaf-0d4d7105aaf7 tempest-ProjectReaderTests-915870083 None] Created reservations ['65c37bd6-b16a-4de7-b3bb-d67e4fc607ce', '50ce5b30-1d8b-435a-8894-529806acb8d6', '5f6a15a5-492a-4dff-9764-37fdd3346ae4', 'aadcf9cd-5e5d-433f-bbb0-cba2366701a3'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:28:52 devstack sudo[107603]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-55ba2c60-824f-4112-9f26-7b5259e4be04 tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a46313ff-bd56-4195-a58d-7c02d9284e3f" returned: 0 in 0.660s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:52 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-55ba2c60-824f-4112-9f26-7b5259e4be04 tempest-ProjectMemberTests-915988921 None] <== create_volume: return (1558ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:28:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-55ba2c60-824f-4112-9f26-7b5259e4be04 tempest-ProjectMemberTests-915988921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.561s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:28:52 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-55ba2c60-824f-4112-9f26-7b5259e4be04 tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20781015-2e12-4dd8-b850-80f21719a13d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a46313ff-bd56-4195-a58d-7c02d9284e3f', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:28:52 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-55ba2c60-824f-4112-9f26-7b5259e4be04 tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fc0d228-16d3-4fa3-a1cb-a4c2c4ecab51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:28:52 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-55ba2c60-824f-4112-9f26-7b5259e4be04 tempest-ProjectMemberTests-915988921 None] Volume volume-a46313ff-bd56-4195-a58d-7c02d9284e3f (a46313ff-bd56-4195-a58d-7c02d9284e3f): created successfully Jul 10 10:28:52 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-55ba2c60-824f-4112-9f26-7b5259e4be04 tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fc0d228-16d3-4fa3-a1cb-a4c2c4ecab51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:28:52 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-55ba2c60-824f-4112-9f26-7b5259e4be04 tempest-ProjectMemberTests-915988921 None] Flow 'volume_create_manager' (d99991cd-ff9c-4bb4-96c2-299ccc7d6f87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:28:52 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-55ba2c60-824f-4112-9f26-7b5259e4be04 tempest-ProjectMemberTests-915988921 None] Created volume successfully. Jul 10 10:28:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-4dd931bd-5d34-42f1-9eaf-0d4d7105aaf7 tempest-ProjectReaderTests-915870083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:28:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-4dd931bd-5d34-42f1-9eaf-0d4d7105aaf7 tempest-ProjectReaderTests-915870083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:28:52 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-4dd931bd-5d34-42f1-9eaf-0d4d7105aaf7 tempest-ProjectReaderTests-915870083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:28:52 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-4dd931bd-5d34-42f1-9eaf-0d4d7105aaf7 tempest-ProjectReaderTests-915870083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:28:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-4dd931bd-5d34-42f1-9eaf-0d4d7105aaf7 tempest-ProjectReaderTests-915870083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:28:52 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4dd931bd-5d34-42f1-9eaf-0d4d7105aaf7 tempest-ProjectReaderTests-915870083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:52 devstack sudo[107607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:28:52 devstack sudo[107607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-051f7f6b-9d19-41a6-8afc-79f1a2ae001f tempest-ProjectMemberTests-915988921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:28:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-051f7f6b-9d19-41a6-8afc-79f1a2ae001f tempest-ProjectMemberTests-915988921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:28:53 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-051f7f6b-9d19-41a6-8afc-79f1a2ae001f tempest-ProjectMemberTests-915988921 None] Creating offline snapshot ca5dd3e6-6f8b-4c29-993e-673fb0f0b20c of volume a46313ff-bd56-4195-a58d-7c02d9284e3f {{(pid=87234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 10:28:53 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c432d08-77f0-444a-ad34-00fb48752a9f]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:28:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-051f7f6b-9d19-41a6-8afc-79f1a2ae001f tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a46313ff-bd56-4195-a58d-7c02d9284e3f {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:53 devstack sudo[107609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a46313ff-bd56-4195-a58d-7c02d9284e3f Jul 10 10:28:53 devstack sudo[107609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:53 devstack sudo[107607]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4dd931bd-5d34-42f1-9eaf-0d4d7105aaf7 tempest-ProjectReaderTests-915870083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.693s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:53 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-4dd931bd-5d34-42f1-9eaf-0d4d7105aaf7 tempest-ProjectReaderTests-915870083 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:28:53 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-4dd931bd-5d34-42f1-9eaf-0d4d7105aaf7 tempest-ProjectReaderTests-915870083 None] Deleted volume successfully. Jul 10 10:28:53 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-4dd931bd-5d34-42f1-9eaf-0d4d7105aaf7 tempest-ProjectReaderTests-915870083 None] Lock "cinder-64aec19e-f7e5-4a49-8031-c63a0f5aa74e-delete_volume" released by "delete_volume" :: held 2.510s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:28:53 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ee2a3a7-767e-4dd3-8799-e5f4a86606c5 tempest-ProjectReaderTests-915870083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:28:53 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4ee2a3a7-767e-4dd3-8799-e5f4a86606c5 tempest-ProjectReaderTests-915870083 None] Flow 'volume_create_manager' (d0dcc173-b749-4a4d-b936-d81fa0c33837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:28:53 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4ee2a3a7-767e-4dd3-8799-e5f4a86606c5 tempest-ProjectReaderTests-915870083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90a410e6-373d-4cea-9c4e-dd39ed0b96a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:28:53 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4ee2a3a7-767e-4dd3-8799-e5f4a86606c5 tempest-ProjectReaderTests-915870083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90a410e6-373d-4cea-9c4e-dd39ed0b96a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:28:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-574838873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=102b3f51-26f2-4792-843a-41723495a02c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0576d19b5bc74984a5bd77b78e049c0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:28:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:28:54Z,use_quota=True,user_id='5b3ef76bd18c49be9f286b80c45a67db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:28:53 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4ee2a3a7-767e-4dd3-8799-e5f4a86606c5 tempest-ProjectReaderTests-915870083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1c2baa9-2ac2-4577-ac97-56c88a3ecb79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:28:53 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4ee2a3a7-767e-4dd3-8799-e5f4a86606c5 tempest-ProjectReaderTests-915870083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1c2baa9-2ac2-4577-ac97-56c88a3ecb79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:28:53 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4ee2a3a7-767e-4dd3-8799-e5f4a86606c5 tempest-ProjectReaderTests-915870083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f46a94c6-0c7f-49c8-ab27-a022d728b363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:28:53 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4ee2a3a7-767e-4dd3-8799-e5f4a86606c5 tempest-ProjectReaderTests-915870083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f46a94c6-0c7f-49c8-ab27-a022d728b363) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '102b3f51-26f2-4792-843a-41723495a02c', 'volume_name': 'volume-102b3f51-26f2-4792-843a-41723495a02c', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:28:53 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4ee2a3a7-767e-4dd3-8799-e5f4a86606c5 tempest-ProjectReaderTests-915870083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1197e975-3914-44cd-b515-c7d366a3b46c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:28:53 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4ee2a3a7-767e-4dd3-8799-e5f4a86606c5 tempest-ProjectReaderTests-915870083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1197e975-3914-44cd-b515-c7d366a3b46c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:28:53 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4ee2a3a7-767e-4dd3-8799-e5f4a86606c5 tempest-ProjectReaderTests-915870083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (437f61f7-85bb-4e27-b357-09728ca78b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:28:53 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-4ee2a3a7-767e-4dd3-8799-e5f4a86606c5 tempest-ProjectReaderTests-915870083 None] Volume 102b3f51-26f2-4792-843a-41723495a02c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-102b3f51-26f2-4792-843a-41723495a02c', 'volume_size': 1} Jul 10 10:28:53 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-4ee2a3a7-767e-4dd3-8799-e5f4a86606c5 tempest-ProjectReaderTests-915870083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:28:54 devstack sudo[107609]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:54 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-051f7f6b-9d19-41a6-8afc-79f1a2ae001f tempest-ProjectMemberTests-915988921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a46313ff-bd56-4195-a58d-7c02d9284e3f" returned: 0 in 0.803s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:54 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-051f7f6b-9d19-41a6-8afc-79f1a2ae001f tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a46313ff-bd56-4195-a58d-7c02d9284e3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a46313ff-bd56-4195-a58d-7c02d9284e3f.ca5dd3e6-6f8b-4c29-993e-673fb0f0b20c 1G {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:54 devstack sudo[107615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a46313ff-bd56-4195-a58d-7c02d9284e3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a46313ff-bd56-4195-a58d-7c02d9284e3f.ca5dd3e6-6f8b-4c29-993e-673fb0f0b20c 1G Jul 10 10:28:54 devstack sudo[107615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:55 devstack sudo[107615]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:55 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-051f7f6b-9d19-41a6-8afc-79f1a2ae001f tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a46313ff-bd56-4195-a58d-7c02d9284e3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a46313ff-bd56-4195-a58d-7c02d9284e3f.ca5dd3e6-6f8b-4c29-993e-673fb0f0b20c 1G" returned: 0 in 0.773s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:55 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-051f7f6b-9d19-41a6-8afc-79f1a2ae001f tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a46313ff-bd56-4195-a58d-7c02d9284e3f -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a46313ff-bd56-4195-a58d-7c02d9284e3f.ca5dd3e6-6f8b-4c29-993e-673fb0f0b20c {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:55 devstack sudo[107620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a46313ff-bd56-4195-a58d-7c02d9284e3f -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a46313ff-bd56-4195-a58d-7c02d9284e3f.ca5dd3e6-6f8b-4c29-993e-673fb0f0b20c Jul 10 10:28:55 devstack sudo[107620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:55 devstack sudo[107620]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:55 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-051f7f6b-9d19-41a6-8afc-79f1a2ae001f tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a46313ff-bd56-4195-a58d-7c02d9284e3f -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a46313ff-bd56-4195-a58d-7c02d9284e3f.ca5dd3e6-6f8b-4c29-993e-673fb0f0b20c" returned: 0 in 0.693s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:55 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-051f7f6b-9d19-41a6-8afc-79f1a2ae001f tempest-ProjectMemberTests-915988921 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a46313ff-bd56-4195-a58d-7c02d9284e3f.ca5dd3e6-6f8b-4c29-993e-673fb0f0b20c is being set with open permissions: ugo+rw Jul 10 10:28:55 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-051f7f6b-9d19-41a6-8afc-79f1a2ae001f tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a46313ff-bd56-4195-a58d-7c02d9284e3f.ca5dd3e6-6f8b-4c29-993e-673fb0f0b20c {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:55 devstack sudo[107625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a46313ff-bd56-4195-a58d-7c02d9284e3f.ca5dd3e6-6f8b-4c29-993e-673fb0f0b20c Jul 10 10:28:55 devstack sudo[107625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:56 devstack sudo[107625]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-051f7f6b-9d19-41a6-8afc-79f1a2ae001f tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a46313ff-bd56-4195-a58d-7c02d9284e3f.ca5dd3e6-6f8b-4c29-993e-673fb0f0b20c" returned: 0 in 0.621s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-051f7f6b-9d19-41a6-8afc-79f1a2ae001f tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a46313ff-bd56-4195-a58d-7c02d9284e3f.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:56 devstack sudo[107628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a46313ff-bd56-4195-a58d-7c02d9284e3f.info Jul 10 10:28:56 devstack sudo[107628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:56 devstack sudo[107628]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-051f7f6b-9d19-41a6-8afc-79f1a2ae001f tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a46313ff-bd56-4195-a58d-7c02d9284e3f.info" returned: 0 in 0.622s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:56 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-051f7f6b-9d19-41a6-8afc-79f1a2ae001f tempest-ProjectMemberTests-915988921 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a46313ff-bd56-4195-a58d-7c02d9284e3f.info is being set with open permissions: ugo+rw Jul 10 10:28:56 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-051f7f6b-9d19-41a6-8afc-79f1a2ae001f tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a46313ff-bd56-4195-a58d-7c02d9284e3f.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:56 devstack sudo[107631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a46313ff-bd56-4195-a58d-7c02d9284e3f.info Jul 10 10:28:56 devstack sudo[107631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:57 devstack sudo[107631]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:57 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-051f7f6b-9d19-41a6-8afc-79f1a2ae001f tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a46313ff-bd56-4195-a58d-7c02d9284e3f.info" returned: 0 in 0.626s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:57 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-051f7f6b-9d19-41a6-8afc-79f1a2ae001f tempest-ProjectMemberTests-915988921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.225s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:28:57 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-4ee2a3a7-767e-4dd3-8799-e5f4a86606c5 tempest-ProjectReaderTests-915870083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.711s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:28:57 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-4ee2a3a7-767e-4dd3-8799-e5f4a86606c5 tempest-ProjectReaderTests-915870083 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:28:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-574838873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=102b3f51-26f2-4792-843a-41723495a02c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0576d19b5bc74984a5bd77b78e049c0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:28:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:28:54Z,use_quota=True,user_id='5b3ef76bd18c49be9f286b80c45a67db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:28:57 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-4ee2a3a7-767e-4dd3-8799-e5f4a86606c5 tempest-ProjectReaderTests-915870083 None] Creating volume 102b3f51-26f2-4792-843a-41723495a02c {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:28:57 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-4ee2a3a7-767e-4dd3-8799-e5f4a86606c5 tempest-ProjectReaderTests-915870083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:28:57 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-4ee2a3a7-767e-4dd3-8799-e5f4a86606c5 tempest-ProjectReaderTests-915870083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:28:57 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-4ee2a3a7-767e-4dd3-8799-e5f4a86606c5 tempest-ProjectReaderTests-915870083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:28:57 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-4ee2a3a7-767e-4dd3-8799-e5f4a86606c5 tempest-ProjectReaderTests-915870083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:28:57 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-4ee2a3a7-767e-4dd3-8799-e5f4a86606c5 tempest-ProjectReaderTests-915870083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:28:57 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-4ee2a3a7-767e-4dd3-8799-e5f4a86606c5 tempest-ProjectReaderTests-915870083 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:28:57 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-4ee2a3a7-767e-4dd3-8799-e5f4a86606c5 tempest-ProjectReaderTests-915870083 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:28:57 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4ee2a3a7-767e-4dd3-8799-e5f4a86606c5 tempest-ProjectReaderTests-915870083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-102b3f51-26f2-4792-843a-41723495a02c 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:57 devstack sudo[107635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-102b3f51-26f2-4792-843a-41723495a02c 1073741824 Jul 10 10:28:57 devstack sudo[107635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:57 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-051f7f6b-9d19-41a6-8afc-79f1a2ae001f tempest-ProjectMemberTests-915988921 None] Create snapshot completed successfully Jul 10 10:28:58 devstack sudo[107635]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4ee2a3a7-767e-4dd3-8799-e5f4a86606c5 tempest-ProjectReaderTests-915870083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-102b3f51-26f2-4792-843a-41723495a02c 1073741824" returned: 0 in 0.785s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4ee2a3a7-767e-4dd3-8799-e5f4a86606c5 tempest-ProjectReaderTests-915870083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-102b3f51-26f2-4792-843a-41723495a02c {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:58 devstack sudo[107640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-102b3f51-26f2-4792-843a-41723495a02c Jul 10 10:28:58 devstack sudo[107640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:58 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-73dc3482-6091-4e45-ba37-4508100cad30 tempest-ProjectMemberTests-915988921 None] Acquiring lock "cinder-ca5dd3e6-6f8b-4c29-993e-673fb0f0b20c-delete_snapshot" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:28:58 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-73dc3482-6091-4e45-ba37-4508100cad30 tempest-ProjectMemberTests-915988921 None] Lock "cinder-ca5dd3e6-6f8b-4c29-993e-673fb0f0b20c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:28:58 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-73dc3482-6091-4e45-ba37-4508100cad30 tempest-ProjectMemberTests-915988921 None] Acquiring lock "cinder-quobyte-a46313ff-bd56-4195-a58d-7c02d9284e3f" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:28:58 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-73dc3482-6091-4e45-ba37-4508100cad30 tempest-ProjectMemberTests-915988921 None] Lock "cinder-quobyte-a46313ff-bd56-4195-a58d-7c02d9284e3f" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:28:58 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-73dc3482-6091-4e45-ba37-4508100cad30 tempest-ProjectMemberTests-915988921 None] Acquiring lock "cinder-quobyte-ca5dd3e6-6f8b-4c29-993e-673fb0f0b20c" by "_delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:28:58 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-73dc3482-6091-4e45-ba37-4508100cad30 tempest-ProjectMemberTests-915988921 None] Lock "cinder-quobyte-ca5dd3e6-6f8b-4c29-993e-673fb0f0b20c" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:28:58 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-73dc3482-6091-4e45-ba37-4508100cad30 tempest-ProjectMemberTests-915988921 None] Deleting offline snapshot ca5dd3e6-6f8b-4c29-993e-673fb0f0b20c of volume a46313ff-bd56-4195-a58d-7c02d9284e3f {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 10:28:58 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-73dc3482-6091-4e45-ba37-4508100cad30 tempest-ProjectMemberTests-915988921 None] snapshot_file for this snap is: volume-a46313ff-bd56-4195-a58d-7c02d9284e3f.ca5dd3e6-6f8b-4c29-993e-673fb0f0b20c {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 10:28:58 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[b658299e-6807-4328-9291-47285acc14e8]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:28:58 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-73dc3482-6091-4e45-ba37-4508100cad30 tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a46313ff-bd56-4195-a58d-7c02d9284e3f.ca5dd3e6-6f8b-4c29-993e-673fb0f0b20c {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:58 devstack sudo[107642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a46313ff-bd56-4195-a58d-7c02d9284e3f.ca5dd3e6-6f8b-4c29-993e-673fb0f0b20c Jul 10 10:28:58 devstack sudo[107642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:28:59 devstack sudo[107640]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:59 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-4ee2a3a7-767e-4dd3-8799-e5f4a86606c5 tempest-ProjectReaderTests-915870083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-102b3f51-26f2-4792-843a-41723495a02c" returned: 0 in 0.638s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:59 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-4ee2a3a7-767e-4dd3-8799-e5f4a86606c5 tempest-ProjectReaderTests-915870083 None] <== create_volume: return (1457ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:28:59 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-4ee2a3a7-767e-4dd3-8799-e5f4a86606c5 tempest-ProjectReaderTests-915870083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.460s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:28:59 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4ee2a3a7-767e-4dd3-8799-e5f4a86606c5 tempest-ProjectReaderTests-915870083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (437f61f7-85bb-4e27-b357-09728ca78b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-102b3f51-26f2-4792-843a-41723495a02c', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:28:59 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4ee2a3a7-767e-4dd3-8799-e5f4a86606c5 tempest-ProjectReaderTests-915870083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e63cc36-9acc-45e9-86b4-6b016ce764cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:28:59 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-4ee2a3a7-767e-4dd3-8799-e5f4a86606c5 tempest-ProjectReaderTests-915870083 None] Volume volume-102b3f51-26f2-4792-843a-41723495a02c (102b3f51-26f2-4792-843a-41723495a02c): created successfully Jul 10 10:28:59 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4ee2a3a7-767e-4dd3-8799-e5f4a86606c5 tempest-ProjectReaderTests-915870083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e63cc36-9acc-45e9-86b4-6b016ce764cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:28:59 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-4ee2a3a7-767e-4dd3-8799-e5f4a86606c5 tempest-ProjectReaderTests-915870083 None] Flow 'volume_create_manager' (d0dcc173-b749-4a4d-b936-d81fa0c33837) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:28:59 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-4ee2a3a7-767e-4dd3-8799-e5f4a86606c5 tempest-ProjectReaderTests-915870083 None] Created volume successfully. Jul 10 10:28:59 devstack sudo[107642]: pam_unix(sudo:session): session closed for user root Jul 10 10:28:59 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-73dc3482-6091-4e45-ba37-4508100cad30 tempest-ProjectMemberTests-915988921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a46313ff-bd56-4195-a58d-7c02d9284e3f.ca5dd3e6-6f8b-4c29-993e-673fb0f0b20c" returned: 0 in 0.771s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:28:59 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-73dc3482-6091-4e45-ba37-4508100cad30 tempest-ProjectMemberTests-915988921 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a46313ff-bd56-4195-a58d-7c02d9284e3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 10:28:59 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[e56cfeb8-5c45-44b1-bcff-65b7242740cc]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:28:59 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-73dc3482-6091-4e45-ba37-4508100cad30 tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a46313ff-bd56-4195-a58d-7c02d9284e3f {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:28:59 devstack sudo[107648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a46313ff-bd56-4195-a58d-7c02d9284e3f Jul 10 10:28:59 devstack sudo[107648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:29:00 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-8f1868c9-13ac-4f27-bfae-47d4fb2e0da0 tempest-ProjectReaderTests-915870083 None] Acquiring lock "cinder-102b3f51-26f2-4792-843a-41723495a02c-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:29:00 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-8f1868c9-13ac-4f27-bfae-47d4fb2e0da0 tempest-ProjectReaderTests-915870083 None] Lock "cinder-102b3f51-26f2-4792-843a-41723495a02c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:29:00 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-8f1868c9-13ac-4f27-bfae-47d4fb2e0da0 tempest-ProjectReaderTests-915870083 None] Acquiring lock "cinder-quobyte-102b3f51-26f2-4792-843a-41723495a02c" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:29:00 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-8f1868c9-13ac-4f27-bfae-47d4fb2e0da0 tempest-ProjectReaderTests-915870083 None] Lock "cinder-quobyte-102b3f51-26f2-4792-843a-41723495a02c" acquired by "delete_volume" :: waited 0.019s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:29:00 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[012cd42a-2173-4323-923a-90c1c17c4ba0]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:29:00 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-8f1868c9-13ac-4f27-bfae-47d4fb2e0da0 tempest-ProjectReaderTests-915870083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-102b3f51-26f2-4792-843a-41723495a02c {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:29:00 devstack sudo[107648]: pam_unix(sudo:session): session closed for user root Jul 10 10:29:00 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-73dc3482-6091-4e45-ba37-4508100cad30 tempest-ProjectMemberTests-915988921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a46313ff-bd56-4195-a58d-7c02d9284e3f" returned: 0 in 0.866s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:29:00 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-73dc3482-6091-4e45-ba37-4508100cad30 tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a46313ff-bd56-4195-a58d-7c02d9284e3f.ca5dd3e6-6f8b-4c29-993e-673fb0f0b20c {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:29:00 devstack sudo[107654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-102b3f51-26f2-4792-843a-41723495a02c Jul 10 10:29:00 devstack sudo[107654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:29:00 devstack sudo[107656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a46313ff-bd56-4195-a58d-7c02d9284e3f.ca5dd3e6-6f8b-4c29-993e-673fb0f0b20c Jul 10 10:29:00 devstack sudo[107656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:29:01 devstack sudo[107654]: pam_unix(sudo:session): session closed for user root Jul 10 10:29:01 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-8f1868c9-13ac-4f27-bfae-47d4fb2e0da0 tempest-ProjectReaderTests-915870083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-102b3f51-26f2-4792-843a-41723495a02c" returned: 0 in 0.772s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:29:01 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-8f1868c9-13ac-4f27-bfae-47d4fb2e0da0 tempest-ProjectReaderTests-915870083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-102b3f51-26f2-4792-843a-41723495a02c {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:29:01 devstack sudo[107664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-102b3f51-26f2-4792-843a-41723495a02c Jul 10 10:29:01 devstack sudo[107664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:29:01 devstack sudo[107656]: pam_unix(sudo:session): session closed for user root Jul 10 10:29:01 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-73dc3482-6091-4e45-ba37-4508100cad30 tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a46313ff-bd56-4195-a58d-7c02d9284e3f.ca5dd3e6-6f8b-4c29-993e-673fb0f0b20c" returned: 0 in 0.718s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:29:01 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-73dc3482-6091-4e45-ba37-4508100cad30 tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a46313ff-bd56-4195-a58d-7c02d9284e3f.ca5dd3e6-6f8b-4c29-993e-673fb0f0b20c {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:29:01 devstack sudo[107666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a46313ff-bd56-4195-a58d-7c02d9284e3f.ca5dd3e6-6f8b-4c29-993e-673fb0f0b20c Jul 10 10:29:01 devstack sudo[107666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:29:01 devstack sudo[107664]: pam_unix(sudo:session): session closed for user root Jul 10 10:29:01 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-8f1868c9-13ac-4f27-bfae-47d4fb2e0da0 tempest-ProjectReaderTests-915870083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-102b3f51-26f2-4792-843a-41723495a02c" returned: 0 in 0.643s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:29:01 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-8f1868c9-13ac-4f27-bfae-47d4fb2e0da0 tempest-ProjectReaderTests-915870083 None] Lock "cinder-quobyte-102b3f51-26f2-4792-843a-41723495a02c" released by "delete_volume" :: held 1.457s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:29:01 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-8f1868c9-13ac-4f27-bfae-47d4fb2e0da0 tempest-ProjectReaderTests-915870083 None] Created reservations ['5cb13f27-80f9-4cfd-95c7-b4d38846e1a3', '2a4a3090-e865-4afe-bfc3-7a51e96b2f45', 'd08472b1-786a-4111-b7c2-4d8f9a7d46ee', '6c74697e-e969-47b5-bb06-feb6ab6aa104'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:29:01 devstack sudo[107666]: pam_unix(sudo:session): session closed for user root Jul 10 10:29:01 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-73dc3482-6091-4e45-ba37-4508100cad30 tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a46313ff-bd56-4195-a58d-7c02d9284e3f.ca5dd3e6-6f8b-4c29-993e-673fb0f0b20c" returned: 0 in 0.693s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:29:01 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-73dc3482-6091-4e45-ba37-4508100cad30 tempest-ProjectMemberTests-915988921 None] Lock "cinder-quobyte-ca5dd3e6-6f8b-4c29-993e-673fb0f0b20c" released by "_delete_snapshot" :: held 3.139s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:29:01 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-73dc3482-6091-4e45-ba37-4508100cad30 tempest-ProjectMemberTests-915988921 None] Lock "cinder-quobyte-a46313ff-bd56-4195-a58d-7c02d9284e3f" released by "delete_snapshot" :: held 3.169s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:29:01 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-8f1868c9-13ac-4f27-bfae-47d4fb2e0da0 tempest-ProjectReaderTests-915870083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:29:01 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-8f1868c9-13ac-4f27-bfae-47d4fb2e0da0 tempest-ProjectReaderTests-915870083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:29:01 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-8f1868c9-13ac-4f27-bfae-47d4fb2e0da0 tempest-ProjectReaderTests-915870083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:29:01 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-8f1868c9-13ac-4f27-bfae-47d4fb2e0da0 tempest-ProjectReaderTests-915870083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:29:01 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-8f1868c9-13ac-4f27-bfae-47d4fb2e0da0 tempest-ProjectReaderTests-915870083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:29:01 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-8f1868c9-13ac-4f27-bfae-47d4fb2e0da0 tempest-ProjectReaderTests-915870083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:29:01 devstack sudo[107670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:29:01 devstack sudo[107670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:29:01 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-73dc3482-6091-4e45-ba37-4508100cad30 tempest-ProjectMemberTests-915988921 None] Created reservations ['91ec6be7-280b-4ec1-9343-4d5cec1147a0', '2c82bea9-3b46-4f99-94e9-a8c4a9b0c2e7', 'dbd4eea7-5085-4ce9-8c1b-247640845d8a', '6c5e2f7a-64dd-4e6d-9e6e-53dd66abb9c3'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:29:01 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-73dc3482-6091-4e45-ba37-4508100cad30 tempest-ProjectMemberTests-915988921 None] Delete snapshot completed successfully. Jul 10 10:29:01 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-73dc3482-6091-4e45-ba37-4508100cad30 tempest-ProjectMemberTests-915988921 None] Lock "cinder-ca5dd3e6-6f8b-4c29-993e-673fb0f0b20c-delete_snapshot" released by "delete_snapshot" :: held 3.336s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:29:02 devstack sudo[107670]: pam_unix(sudo:session): session closed for user root Jul 10 10:29:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-8f1868c9-13ac-4f27-bfae-47d4fb2e0da0 tempest-ProjectReaderTests-915870083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.612s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:29:02 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-8f1868c9-13ac-4f27-bfae-47d4fb2e0da0 tempest-ProjectReaderTests-915870083 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:29:02 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-8f1868c9-13ac-4f27-bfae-47d4fb2e0da0 tempest-ProjectReaderTests-915870083 None] Deleted volume successfully. Jul 10 10:29:02 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-8f1868c9-13ac-4f27-bfae-47d4fb2e0da0 tempest-ProjectReaderTests-915870083 None] Lock "cinder-102b3f51-26f2-4792-843a-41723495a02c-delete_volume" released by "delete_volume" :: held 2.313s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:29:02 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-8de344d4-01d6-4869-850b-254bead63187 tempest-ProjectReaderTests-915870083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:29:02 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8de344d4-01d6-4869-850b-254bead63187 tempest-ProjectReaderTests-915870083 None] Flow 'volume_create_manager' (6d44cc3c-9008-4462-8add-1485a1927e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:29:02 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8de344d4-01d6-4869-850b-254bead63187 tempest-ProjectReaderTests-915870083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91462a51-cedf-4a84-bd7c-786a843ac86c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:29:02 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-a43c3540-79fa-4d3d-a89d-9a0ed6e861cd tempest-ProjectMemberTests-915988921 None] Acquiring lock "cinder-a46313ff-bd56-4195-a58d-7c02d9284e3f-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:29:02 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8de344d4-01d6-4869-850b-254bead63187 tempest-ProjectReaderTests-915870083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91462a51-cedf-4a84-bd7c-786a843ac86c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:29:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1501400469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46b2e4f8-b498-49e5-bd0b-b2336939507c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0576d19b5bc74984a5bd77b78e049c0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:29:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:29:03Z,use_quota=True,user_id='5b3ef76bd18c49be9f286b80c45a67db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:29:02 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8de344d4-01d6-4869-850b-254bead63187 tempest-ProjectReaderTests-915870083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67c1c725-0cd7-49a3-9ca5-99e78666a0a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:29:02 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8de344d4-01d6-4869-850b-254bead63187 tempest-ProjectReaderTests-915870083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67c1c725-0cd7-49a3-9ca5-99e78666a0a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:29:02 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8de344d4-01d6-4869-850b-254bead63187 tempest-ProjectReaderTests-915870083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e185b9ba-24ac-4fd0-bf4b-731a20ad0df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:29:02 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8de344d4-01d6-4869-850b-254bead63187 tempest-ProjectReaderTests-915870083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e185b9ba-24ac-4fd0-bf4b-731a20ad0df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46b2e4f8-b498-49e5-bd0b-b2336939507c', 'volume_name': 'volume-46b2e4f8-b498-49e5-bd0b-b2336939507c', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:29:02 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8de344d4-01d6-4869-850b-254bead63187 tempest-ProjectReaderTests-915870083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (121545d1-5896-48fc-b093-1571a9e0de42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:29:02 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8de344d4-01d6-4869-850b-254bead63187 tempest-ProjectReaderTests-915870083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (121545d1-5896-48fc-b093-1571a9e0de42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:29:02 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8de344d4-01d6-4869-850b-254bead63187 tempest-ProjectReaderTests-915870083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0902eb52-b1aa-404c-9ff4-53438603d27b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:29:02 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-8de344d4-01d6-4869-850b-254bead63187 tempest-ProjectReaderTests-915870083 None] Volume 46b2e4f8-b498-49e5-bd0b-b2336939507c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46b2e4f8-b498-49e5-bd0b-b2336939507c', 'volume_size': 1} Jul 10 10:29:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-8de344d4-01d6-4869-850b-254bead63187 tempest-ProjectReaderTests-915870083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:29:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-8de344d4-01d6-4869-850b-254bead63187 tempest-ProjectReaderTests-915870083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:29:02 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-8de344d4-01d6-4869-850b-254bead63187 tempest-ProjectReaderTests-915870083 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:29:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1501400469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46b2e4f8-b498-49e5-bd0b-b2336939507c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0576d19b5bc74984a5bd77b78e049c0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:29:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:29:03Z,use_quota=True,user_id='5b3ef76bd18c49be9f286b80c45a67db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:29:02 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-8de344d4-01d6-4869-850b-254bead63187 tempest-ProjectReaderTests-915870083 None] Creating volume 46b2e4f8-b498-49e5-bd0b-b2336939507c {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:29:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-8de344d4-01d6-4869-850b-254bead63187 tempest-ProjectReaderTests-915870083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:29:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-8de344d4-01d6-4869-850b-254bead63187 tempest-ProjectReaderTests-915870083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:29:02 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-8de344d4-01d6-4869-850b-254bead63187 tempest-ProjectReaderTests-915870083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:29:02 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-8de344d4-01d6-4869-850b-254bead63187 tempest-ProjectReaderTests-915870083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:29:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-8de344d4-01d6-4869-850b-254bead63187 tempest-ProjectReaderTests-915870083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:29:02 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-8de344d4-01d6-4869-850b-254bead63187 tempest-ProjectReaderTests-915870083 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:29:02 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-8de344d4-01d6-4869-850b-254bead63187 tempest-ProjectReaderTests-915870083 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:29:02 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-8de344d4-01d6-4869-850b-254bead63187 tempest-ProjectReaderTests-915870083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-46b2e4f8-b498-49e5-bd0b-b2336939507c 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:29:02 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-a43c3540-79fa-4d3d-a89d-9a0ed6e861cd tempest-ProjectMemberTests-915988921 None] Lock "cinder-a46313ff-bd56-4195-a58d-7c02d9284e3f-delete_volume" acquired by "delete_volume" :: waited 0.094s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:29:02 devstack sudo[107673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-46b2e4f8-b498-49e5-bd0b-b2336939507c 1073741824 Jul 10 10:29:02 devstack sudo[107673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:29:02 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-a43c3540-79fa-4d3d-a89d-9a0ed6e861cd tempest-ProjectMemberTests-915988921 None] Acquiring lock "cinder-quobyte-a46313ff-bd56-4195-a58d-7c02d9284e3f" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:29:02 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-a43c3540-79fa-4d3d-a89d-9a0ed6e861cd tempest-ProjectMemberTests-915988921 None] Lock "cinder-quobyte-a46313ff-bd56-4195-a58d-7c02d9284e3f" acquired by "delete_volume" :: waited 0.013s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:29:03 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[63adfcff-d013-4b9a-ba3d-fd916557ba2a]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:29:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a43c3540-79fa-4d3d-a89d-9a0ed6e861cd tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a46313ff-bd56-4195-a58d-7c02d9284e3f {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:29:03 devstack sudo[107675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a46313ff-bd56-4195-a58d-7c02d9284e3f Jul 10 10:29:03 devstack sudo[107675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:29:03 devstack sudo[107673]: pam_unix(sudo:session): session closed for user root Jul 10 10:29:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-8de344d4-01d6-4869-850b-254bead63187 tempest-ProjectReaderTests-915870083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-46b2e4f8-b498-49e5-bd0b-b2336939507c 1073741824" returned: 0 in 0.787s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:29:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-8de344d4-01d6-4869-850b-254bead63187 tempest-ProjectReaderTests-915870083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-46b2e4f8-b498-49e5-bd0b-b2336939507c {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:29:03 devstack sudo[107683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-46b2e4f8-b498-49e5-bd0b-b2336939507c Jul 10 10:29:03 devstack sudo[107683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:29:03 devstack sudo[107675]: pam_unix(sudo:session): session closed for user root Jul 10 10:29:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a43c3540-79fa-4d3d-a89d-9a0ed6e861cd tempest-ProjectMemberTests-915988921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a46313ff-bd56-4195-a58d-7c02d9284e3f" returned: 0 in 0.800s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:29:03 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a43c3540-79fa-4d3d-a89d-9a0ed6e861cd tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a46313ff-bd56-4195-a58d-7c02d9284e3f {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:29:03 devstack sudo[107685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a46313ff-bd56-4195-a58d-7c02d9284e3f Jul 10 10:29:03 devstack sudo[107685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:29:04 devstack sudo[107683]: pam_unix(sudo:session): session closed for user root Jul 10 10:29:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-8de344d4-01d6-4869-850b-254bead63187 tempest-ProjectReaderTests-915870083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-46b2e4f8-b498-49e5-bd0b-b2336939507c" returned: 0 in 0.647s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:29:04 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-8de344d4-01d6-4869-850b-254bead63187 tempest-ProjectReaderTests-915870083 None] <== create_volume: return (1483ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:29:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-8de344d4-01d6-4869-850b-254bead63187 tempest-ProjectReaderTests-915870083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.487s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:29:04 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8de344d4-01d6-4869-850b-254bead63187 tempest-ProjectReaderTests-915870083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0902eb52-b1aa-404c-9ff4-53438603d27b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46b2e4f8-b498-49e5-bd0b-b2336939507c', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:29:04 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8de344d4-01d6-4869-850b-254bead63187 tempest-ProjectReaderTests-915870083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (894dcc2d-75de-4ec5-8f39-3895013999bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:29:04 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-8de344d4-01d6-4869-850b-254bead63187 tempest-ProjectReaderTests-915870083 None] Volume volume-46b2e4f8-b498-49e5-bd0b-b2336939507c (46b2e4f8-b498-49e5-bd0b-b2336939507c): created successfully Jul 10 10:29:04 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8de344d4-01d6-4869-850b-254bead63187 tempest-ProjectReaderTests-915870083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (894dcc2d-75de-4ec5-8f39-3895013999bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:29:04 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8de344d4-01d6-4869-850b-254bead63187 tempest-ProjectReaderTests-915870083 None] Flow 'volume_create_manager' (6d44cc3c-9008-4462-8add-1485a1927e10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:29:04 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-8de344d4-01d6-4869-850b-254bead63187 tempest-ProjectReaderTests-915870083 None] Created volume successfully. Jul 10 10:29:04 devstack sudo[107685]: pam_unix(sudo:session): session closed for user root Jul 10 10:29:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a43c3540-79fa-4d3d-a89d-9a0ed6e861cd tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-a46313ff-bd56-4195-a58d-7c02d9284e3f" returned: 0 in 0.652s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:29:04 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-a43c3540-79fa-4d3d-a89d-9a0ed6e861cd tempest-ProjectMemberTests-915988921 None] Lock "cinder-quobyte-a46313ff-bd56-4195-a58d-7c02d9284e3f" released by "delete_volume" :: held 1.507s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:29:04 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-a43c3540-79fa-4d3d-a89d-9a0ed6e861cd tempest-ProjectMemberTests-915988921 None] Created reservations ['40b348c9-c5cb-4850-abd8-54ce5e3e40d0', '2d9d38d9-6416-4c35-864b-96d4bdc9cdfa', '57929346-2202-45e8-8c01-c728b9474869', 'edcd4c72-bed6-4356-b94c-fd5df2954b6d'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:29:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-a43c3540-79fa-4d3d-a89d-9a0ed6e861cd tempest-ProjectMemberTests-915988921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:29:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-a43c3540-79fa-4d3d-a89d-9a0ed6e861cd tempest-ProjectMemberTests-915988921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:29:04 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-a43c3540-79fa-4d3d-a89d-9a0ed6e861cd tempest-ProjectMemberTests-915988921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:29:04 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-a43c3540-79fa-4d3d-a89d-9a0ed6e861cd tempest-ProjectMemberTests-915988921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:29:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-a43c3540-79fa-4d3d-a89d-9a0ed6e861cd tempest-ProjectMemberTests-915988921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:29:04 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a43c3540-79fa-4d3d-a89d-9a0ed6e861cd tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:29:04 devstack sudo[107689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:29:04 devstack sudo[107689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:29:04 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-dbfc73b0-b26f-4095-bb42-93783743c411 tempest-ProjectReaderTests-915870083 None] Acquiring lock "cinder-46b2e4f8-b498-49e5-bd0b-b2336939507c-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:29:04 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-dbfc73b0-b26f-4095-bb42-93783743c411 tempest-ProjectReaderTests-915870083 None] Lock "cinder-46b2e4f8-b498-49e5-bd0b-b2336939507c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:29:04 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-dbfc73b0-b26f-4095-bb42-93783743c411 tempest-ProjectReaderTests-915870083 None] Acquiring lock "cinder-quobyte-46b2e4f8-b498-49e5-bd0b-b2336939507c" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:29:05 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-dbfc73b0-b26f-4095-bb42-93783743c411 tempest-ProjectReaderTests-915870083 None] Lock "cinder-quobyte-46b2e4f8-b498-49e5-bd0b-b2336939507c" acquired by "delete_volume" :: waited 0.025s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:29:05 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e80d8e3-fe80-4119-b3ce-8038a6b813ef]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:29:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-dbfc73b0-b26f-4095-bb42-93783743c411 tempest-ProjectReaderTests-915870083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-46b2e4f8-b498-49e5-bd0b-b2336939507c {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:29:05 devstack sudo[107691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-46b2e4f8-b498-49e5-bd0b-b2336939507c Jul 10 10:29:05 devstack sudo[107691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:29:05 devstack sudo[107689]: pam_unix(sudo:session): session closed for user root Jul 10 10:29:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a43c3540-79fa-4d3d-a89d-9a0ed6e861cd tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.709s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:29:05 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-a43c3540-79fa-4d3d-a89d-9a0ed6e861cd tempest-ProjectMemberTests-915988921 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:29:05 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-a43c3540-79fa-4d3d-a89d-9a0ed6e861cd tempest-ProjectMemberTests-915988921 None] Deleted volume successfully. Jul 10 10:29:05 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-a43c3540-79fa-4d3d-a89d-9a0ed6e861cd tempest-ProjectMemberTests-915988921 None] Lock "cinder-a46313ff-bd56-4195-a58d-7c02d9284e3f-delete_volume" released by "delete_volume" :: held 2.403s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:29:05 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-07ee979f-2235-4f0c-b9aa-c0d4ac5e0a1d tempest-ProjectMemberTests-915988921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:29:05 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-07ee979f-2235-4f0c-b9aa-c0d4ac5e0a1d tempest-ProjectMemberTests-915988921 None] Flow 'volume_create_manager' (39c7cb2f-b180-432a-a63d-ead49007299b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:29:05 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-07ee979f-2235-4f0c-b9aa-c0d4ac5e0a1d tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71f81a31-d05e-4bcd-b66f-6dda32969395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:29:05 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-07ee979f-2235-4f0c-b9aa-c0d4ac5e0a1d tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71f81a31-d05e-4bcd-b66f-6dda32969395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:29:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1553811945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fdd8cf5-2f76-48a3-9fe4-2965d71dc30b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac4b039bd3aa49f393fe3462e2fed6d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:29:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:29:05Z,use_quota=True,user_id='cc3f433661ac4946825a66613f6d748c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:29:05 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-07ee979f-2235-4f0c-b9aa-c0d4ac5e0a1d tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (090ef7f1-7acc-477e-a1a0-f5f1ea373bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:29:05 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-07ee979f-2235-4f0c-b9aa-c0d4ac5e0a1d tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (090ef7f1-7acc-477e-a1a0-f5f1ea373bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:29:05 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-07ee979f-2235-4f0c-b9aa-c0d4ac5e0a1d tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8e047d8-3be7-4acf-8cc7-95ae61733100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:29:05 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-07ee979f-2235-4f0c-b9aa-c0d4ac5e0a1d tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8e047d8-3be7-4acf-8cc7-95ae61733100) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fdd8cf5-2f76-48a3-9fe4-2965d71dc30b', 'volume_name': 'volume-2fdd8cf5-2f76-48a3-9fe4-2965d71dc30b', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:29:05 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-07ee979f-2235-4f0c-b9aa-c0d4ac5e0a1d tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f070276a-e67e-47f8-a33d-c58efb402925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:29:05 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-07ee979f-2235-4f0c-b9aa-c0d4ac5e0a1d tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f070276a-e67e-47f8-a33d-c58efb402925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:29:05 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-07ee979f-2235-4f0c-b9aa-c0d4ac5e0a1d tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (955dc1e9-617c-42c7-88c5-df6bcace0646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:29:05 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-07ee979f-2235-4f0c-b9aa-c0d4ac5e0a1d tempest-ProjectMemberTests-915988921 None] Volume 2fdd8cf5-2f76-48a3-9fe4-2965d71dc30b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fdd8cf5-2f76-48a3-9fe4-2965d71dc30b', 'volume_size': 1} Jul 10 10:29:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-07ee979f-2235-4f0c-b9aa-c0d4ac5e0a1d tempest-ProjectMemberTests-915988921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:29:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-07ee979f-2235-4f0c-b9aa-c0d4ac5e0a1d tempest-ProjectMemberTests-915988921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:29:05 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-07ee979f-2235-4f0c-b9aa-c0d4ac5e0a1d tempest-ProjectMemberTests-915988921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:29:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1553811945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fdd8cf5-2f76-48a3-9fe4-2965d71dc30b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac4b039bd3aa49f393fe3462e2fed6d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:29:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:29:05Z,use_quota=True,user_id='cc3f433661ac4946825a66613f6d748c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:29:05 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-07ee979f-2235-4f0c-b9aa-c0d4ac5e0a1d tempest-ProjectMemberTests-915988921 None] Creating volume 2fdd8cf5-2f76-48a3-9fe4-2965d71dc30b {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:29:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-07ee979f-2235-4f0c-b9aa-c0d4ac5e0a1d tempest-ProjectMemberTests-915988921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:29:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-07ee979f-2235-4f0c-b9aa-c0d4ac5e0a1d tempest-ProjectMemberTests-915988921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:29:05 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-07ee979f-2235-4f0c-b9aa-c0d4ac5e0a1d tempest-ProjectMemberTests-915988921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:29:05 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-07ee979f-2235-4f0c-b9aa-c0d4ac5e0a1d tempest-ProjectMemberTests-915988921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:29:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-07ee979f-2235-4f0c-b9aa-c0d4ac5e0a1d tempest-ProjectMemberTests-915988921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:29:05 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-07ee979f-2235-4f0c-b9aa-c0d4ac5e0a1d tempest-ProjectMemberTests-915988921 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:29:05 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-07ee979f-2235-4f0c-b9aa-c0d4ac5e0a1d tempest-ProjectMemberTests-915988921 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:29:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-07ee979f-2235-4f0c-b9aa-c0d4ac5e0a1d tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2fdd8cf5-2f76-48a3-9fe4-2965d71dc30b 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:29:05 devstack sudo[107694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2fdd8cf5-2f76-48a3-9fe4-2965d71dc30b 1073741824 Jul 10 10:29:05 devstack sudo[107694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:29:05 devstack sudo[107691]: pam_unix(sudo:session): session closed for user root Jul 10 10:29:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-dbfc73b0-b26f-4095-bb42-93783743c411 tempest-ProjectReaderTests-915870083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-46b2e4f8-b498-49e5-bd0b-b2336939507c" returned: 0 in 0.843s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:29:05 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-dbfc73b0-b26f-4095-bb42-93783743c411 tempest-ProjectReaderTests-915870083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-46b2e4f8-b498-49e5-bd0b-b2336939507c {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:29:05 devstack sudo[107699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-46b2e4f8-b498-49e5-bd0b-b2336939507c Jul 10 10:29:05 devstack sudo[107699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:29:06 devstack sudo[107694]: pam_unix(sudo:session): session closed for user root Jul 10 10:29:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-07ee979f-2235-4f0c-b9aa-c0d4ac5e0a1d tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2fdd8cf5-2f76-48a3-9fe4-2965d71dc30b 1073741824" returned: 0 in 0.838s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:29:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-07ee979f-2235-4f0c-b9aa-c0d4ac5e0a1d tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2fdd8cf5-2f76-48a3-9fe4-2965d71dc30b {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:29:06 devstack sudo[107706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2fdd8cf5-2f76-48a3-9fe4-2965d71dc30b Jul 10 10:29:06 devstack sudo[107706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:29:06 devstack sudo[107699]: pam_unix(sudo:session): session closed for user root Jul 10 10:29:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-dbfc73b0-b26f-4095-bb42-93783743c411 tempest-ProjectReaderTests-915870083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-46b2e4f8-b498-49e5-bd0b-b2336939507c" returned: 0 in 0.649s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:29:06 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-dbfc73b0-b26f-4095-bb42-93783743c411 tempest-ProjectReaderTests-915870083 None] Lock "cinder-quobyte-46b2e4f8-b498-49e5-bd0b-b2336939507c" released by "delete_volume" :: held 1.536s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:29:06 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-dbfc73b0-b26f-4095-bb42-93783743c411 tempest-ProjectReaderTests-915870083 None] Created reservations ['d7a83469-86cd-4e30-80ad-8257c4706793', 'aa49a9d2-a9e4-4d39-a463-22fabe77bc30', 'b361f244-ecc7-4fb5-845a-f0390bfb953f', '9a01172e-1d5f-41a1-aa0a-82cafd72457a'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:29:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-dbfc73b0-b26f-4095-bb42-93783743c411 tempest-ProjectReaderTests-915870083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:29:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-dbfc73b0-b26f-4095-bb42-93783743c411 tempest-ProjectReaderTests-915870083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:29:06 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-dbfc73b0-b26f-4095-bb42-93783743c411 tempest-ProjectReaderTests-915870083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:29:06 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-dbfc73b0-b26f-4095-bb42-93783743c411 tempest-ProjectReaderTests-915870083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:29:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-dbfc73b0-b26f-4095-bb42-93783743c411 tempest-ProjectReaderTests-915870083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:29:06 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-dbfc73b0-b26f-4095-bb42-93783743c411 tempest-ProjectReaderTests-915870083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:29:06 devstack sudo[107708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:29:06 devstack sudo[107708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:29:07 devstack sudo[107706]: pam_unix(sudo:session): session closed for user root Jul 10 10:29:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-07ee979f-2235-4f0c-b9aa-c0d4ac5e0a1d tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2fdd8cf5-2f76-48a3-9fe4-2965d71dc30b" returned: 0 in 0.634s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:29:07 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-07ee979f-2235-4f0c-b9aa-c0d4ac5e0a1d tempest-ProjectMemberTests-915988921 None] <== create_volume: return (1522ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:29:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-07ee979f-2235-4f0c-b9aa-c0d4ac5e0a1d tempest-ProjectMemberTests-915988921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.526s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:29:07 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-07ee979f-2235-4f0c-b9aa-c0d4ac5e0a1d tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (955dc1e9-617c-42c7-88c5-df6bcace0646) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fdd8cf5-2f76-48a3-9fe4-2965d71dc30b', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:29:07 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-07ee979f-2235-4f0c-b9aa-c0d4ac5e0a1d tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc554aaa-d1d3-4399-8311-1da2da8837a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:29:07 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-07ee979f-2235-4f0c-b9aa-c0d4ac5e0a1d tempest-ProjectMemberTests-915988921 None] Volume volume-2fdd8cf5-2f76-48a3-9fe4-2965d71dc30b (2fdd8cf5-2f76-48a3-9fe4-2965d71dc30b): created successfully Jul 10 10:29:07 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-07ee979f-2235-4f0c-b9aa-c0d4ac5e0a1d tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc554aaa-d1d3-4399-8311-1da2da8837a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:29:07 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-07ee979f-2235-4f0c-b9aa-c0d4ac5e0a1d tempest-ProjectMemberTests-915988921 None] Flow 'volume_create_manager' (39c7cb2f-b180-432a-a63d-ead49007299b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:29:07 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-07ee979f-2235-4f0c-b9aa-c0d4ac5e0a1d tempest-ProjectMemberTests-915988921 None] Created volume successfully. Jul 10 10:29:07 devstack sudo[107708]: pam_unix(sudo:session): session closed for user root Jul 10 10:29:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-dbfc73b0-b26f-4095-bb42-93783743c411 tempest-ProjectReaderTests-915870083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.672s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:29:07 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-dbfc73b0-b26f-4095-bb42-93783743c411 tempest-ProjectReaderTests-915870083 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:29:07 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-dbfc73b0-b26f-4095-bb42-93783743c411 tempest-ProjectReaderTests-915870083 None] Deleted volume successfully. Jul 10 10:29:07 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-dbfc73b0-b26f-4095-bb42-93783743c411 tempest-ProjectReaderTests-915870083 None] Lock "cinder-46b2e4f8-b498-49e5-bd0b-b2336939507c-delete_volume" released by "delete_volume" :: held 2.427s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:29:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-9ab764e1-eb11-47b8-923e-bbbc6eab2a92 tempest-ProjectMemberTests-915988921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:29:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-9ab764e1-eb11-47b8-923e-bbbc6eab2a92 tempest-ProjectMemberTests-915988921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:29:07 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-9ab764e1-eb11-47b8-923e-bbbc6eab2a92 tempest-ProjectMemberTests-915988921 None] Creating offline snapshot 821e71b1-610b-46c2-b7b2-e716b6a0e1e2 of volume 2fdd8cf5-2f76-48a3-9fe4-2965d71dc30b {{(pid=87234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 10:29:07 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b030ffa-f9e0-4d85-9145-82b97f6ab738]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:29:07 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9ab764e1-eb11-47b8-923e-bbbc6eab2a92 tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2fdd8cf5-2f76-48a3-9fe4-2965d71dc30b {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:29:07 devstack sudo[107713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2fdd8cf5-2f76-48a3-9fe4-2965d71dc30b Jul 10 10:29:07 devstack sudo[107713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:29:08 devstack sudo[107713]: pam_unix(sudo:session): session closed for user root Jul 10 10:29:08 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9ab764e1-eb11-47b8-923e-bbbc6eab2a92 tempest-ProjectMemberTests-915988921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2fdd8cf5-2f76-48a3-9fe4-2965d71dc30b" returned: 0 in 0.798s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:29:08 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9ab764e1-eb11-47b8-923e-bbbc6eab2a92 tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2fdd8cf5-2f76-48a3-9fe4-2965d71dc30b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2fdd8cf5-2f76-48a3-9fe4-2965d71dc30b.821e71b1-610b-46c2-b7b2-e716b6a0e1e2 1G {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:29:08 devstack sudo[107719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2fdd8cf5-2f76-48a3-9fe4-2965d71dc30b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2fdd8cf5-2f76-48a3-9fe4-2965d71dc30b.821e71b1-610b-46c2-b7b2-e716b6a0e1e2 1G Jul 10 10:29:08 devstack sudo[107719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:29:09 devstack sudo[107719]: pam_unix(sudo:session): session closed for user root Jul 10 10:29:09 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9ab764e1-eb11-47b8-923e-bbbc6eab2a92 tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2fdd8cf5-2f76-48a3-9fe4-2965d71dc30b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2fdd8cf5-2f76-48a3-9fe4-2965d71dc30b.821e71b1-610b-46c2-b7b2-e716b6a0e1e2 1G" returned: 0 in 0.823s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:29:09 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9ab764e1-eb11-47b8-923e-bbbc6eab2a92 tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fdd8cf5-2f76-48a3-9fe4-2965d71dc30b -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2fdd8cf5-2f76-48a3-9fe4-2965d71dc30b.821e71b1-610b-46c2-b7b2-e716b6a0e1e2 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:29:09 devstack sudo[107725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fdd8cf5-2f76-48a3-9fe4-2965d71dc30b -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2fdd8cf5-2f76-48a3-9fe4-2965d71dc30b.821e71b1-610b-46c2-b7b2-e716b6a0e1e2 Jul 10 10:29:09 devstack sudo[107725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:29:10 devstack sudo[107725]: pam_unix(sudo:session): session closed for user root Jul 10 10:29:10 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9ab764e1-eb11-47b8-923e-bbbc6eab2a92 tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fdd8cf5-2f76-48a3-9fe4-2965d71dc30b -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2fdd8cf5-2f76-48a3-9fe4-2965d71dc30b.821e71b1-610b-46c2-b7b2-e716b6a0e1e2" returned: 0 in 0.685s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:29:10 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-9ab764e1-eb11-47b8-923e-bbbc6eab2a92 tempest-ProjectMemberTests-915988921 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2fdd8cf5-2f76-48a3-9fe4-2965d71dc30b.821e71b1-610b-46c2-b7b2-e716b6a0e1e2 is being set with open permissions: ugo+rw Jul 10 10:29:10 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9ab764e1-eb11-47b8-923e-bbbc6eab2a92 tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2fdd8cf5-2f76-48a3-9fe4-2965d71dc30b.821e71b1-610b-46c2-b7b2-e716b6a0e1e2 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:29:10 devstack sudo[107730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2fdd8cf5-2f76-48a3-9fe4-2965d71dc30b.821e71b1-610b-46c2-b7b2-e716b6a0e1e2 Jul 10 10:29:10 devstack sudo[107730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:29:10 devstack sudo[107730]: pam_unix(sudo:session): session closed for user root Jul 10 10:29:10 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9ab764e1-eb11-47b8-923e-bbbc6eab2a92 tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2fdd8cf5-2f76-48a3-9fe4-2965d71dc30b.821e71b1-610b-46c2-b7b2-e716b6a0e1e2" returned: 0 in 0.627s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:29:10 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9ab764e1-eb11-47b8-923e-bbbc6eab2a92 tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2fdd8cf5-2f76-48a3-9fe4-2965d71dc30b.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:29:10 devstack sudo[107733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2fdd8cf5-2f76-48a3-9fe4-2965d71dc30b.info Jul 10 10:29:10 devstack sudo[107733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:29:11 devstack sudo[107733]: pam_unix(sudo:session): session closed for user root Jul 10 10:29:11 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9ab764e1-eb11-47b8-923e-bbbc6eab2a92 tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2fdd8cf5-2f76-48a3-9fe4-2965d71dc30b.info" returned: 0 in 0.633s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:29:11 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-9ab764e1-eb11-47b8-923e-bbbc6eab2a92 tempest-ProjectMemberTests-915988921 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2fdd8cf5-2f76-48a3-9fe4-2965d71dc30b.info is being set with open permissions: ugo+rw Jul 10 10:29:11 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9ab764e1-eb11-47b8-923e-bbbc6eab2a92 tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2fdd8cf5-2f76-48a3-9fe4-2965d71dc30b.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:29:11 devstack sudo[107736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2fdd8cf5-2f76-48a3-9fe4-2965d71dc30b.info Jul 10 10:29:11 devstack sudo[107736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:29:12 devstack sudo[107736]: pam_unix(sudo:session): session closed for user root Jul 10 10:29:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-9ab764e1-eb11-47b8-923e-bbbc6eab2a92 tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2fdd8cf5-2f76-48a3-9fe4-2965d71dc30b.info" returned: 0 in 0.628s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:29:12 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-9ab764e1-eb11-47b8-923e-bbbc6eab2a92 tempest-ProjectMemberTests-915988921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.277s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:29:12 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-9ab764e1-eb11-47b8-923e-bbbc6eab2a92 tempest-ProjectMemberTests-915988921 None] Create snapshot completed successfully Jul 10 10:29:12 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-8be30781-7881-4e1a-ae22-8aae2e7dfaeb tempest-ProjectMemberTests-915988921 None] Acquiring lock "cinder-821e71b1-610b-46c2-b7b2-e716b6a0e1e2-delete_snapshot" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:29:13 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-8be30781-7881-4e1a-ae22-8aae2e7dfaeb tempest-ProjectMemberTests-915988921 None] Lock "cinder-821e71b1-610b-46c2-b7b2-e716b6a0e1e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:29:13 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-8be30781-7881-4e1a-ae22-8aae2e7dfaeb tempest-ProjectMemberTests-915988921 None] Acquiring lock "cinder-quobyte-2fdd8cf5-2f76-48a3-9fe4-2965d71dc30b" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:29:13 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-8be30781-7881-4e1a-ae22-8aae2e7dfaeb tempest-ProjectMemberTests-915988921 None] Lock "cinder-quobyte-2fdd8cf5-2f76-48a3-9fe4-2965d71dc30b" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:29:13 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-8be30781-7881-4e1a-ae22-8aae2e7dfaeb tempest-ProjectMemberTests-915988921 None] Acquiring lock "cinder-quobyte-821e71b1-610b-46c2-b7b2-e716b6a0e1e2" by "_delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:29:13 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-8be30781-7881-4e1a-ae22-8aae2e7dfaeb tempest-ProjectMemberTests-915988921 None] Lock "cinder-quobyte-821e71b1-610b-46c2-b7b2-e716b6a0e1e2" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:29:13 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-8be30781-7881-4e1a-ae22-8aae2e7dfaeb tempest-ProjectMemberTests-915988921 None] Deleting offline snapshot 821e71b1-610b-46c2-b7b2-e716b6a0e1e2 of volume 2fdd8cf5-2f76-48a3-9fe4-2965d71dc30b {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 10:29:13 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-8be30781-7881-4e1a-ae22-8aae2e7dfaeb tempest-ProjectMemberTests-915988921 None] snapshot_file for this snap is: volume-2fdd8cf5-2f76-48a3-9fe4-2965d71dc30b.821e71b1-610b-46c2-b7b2-e716b6a0e1e2 {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 10:29:13 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[630f4692-50ca-44f1-b8ba-f139c9a975ca]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:29:13 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-8be30781-7881-4e1a-ae22-8aae2e7dfaeb tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2fdd8cf5-2f76-48a3-9fe4-2965d71dc30b.821e71b1-610b-46c2-b7b2-e716b6a0e1e2 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:29:13 devstack sudo[107739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2fdd8cf5-2f76-48a3-9fe4-2965d71dc30b.821e71b1-610b-46c2-b7b2-e716b6a0e1e2 Jul 10 10:29:13 devstack sudo[107739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:29:13 devstack sudo[107739]: pam_unix(sudo:session): session closed for user root Jul 10 10:29:13 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-8be30781-7881-4e1a-ae22-8aae2e7dfaeb tempest-ProjectMemberTests-915988921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2fdd8cf5-2f76-48a3-9fe4-2965d71dc30b.821e71b1-610b-46c2-b7b2-e716b6a0e1e2" returned: 0 in 0.757s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:29:13 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-8be30781-7881-4e1a-ae22-8aae2e7dfaeb tempest-ProjectMemberTests-915988921 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2fdd8cf5-2f76-48a3-9fe4-2965d71dc30b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 10:29:13 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[b794016c-bbb1-448b-b891-d7bf8625c79f]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:29:13 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-8be30781-7881-4e1a-ae22-8aae2e7dfaeb tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2fdd8cf5-2f76-48a3-9fe4-2965d71dc30b {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:29:13 devstack sudo[107744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2fdd8cf5-2f76-48a3-9fe4-2965d71dc30b Jul 10 10:29:13 devstack sudo[107744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:29:14 devstack sudo[107744]: pam_unix(sudo:session): session closed for user root Jul 10 10:29:14 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-8be30781-7881-4e1a-ae22-8aae2e7dfaeb tempest-ProjectMemberTests-915988921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2fdd8cf5-2f76-48a3-9fe4-2965d71dc30b" returned: 0 in 0.747s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:29:14 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-8be30781-7881-4e1a-ae22-8aae2e7dfaeb tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2fdd8cf5-2f76-48a3-9fe4-2965d71dc30b.821e71b1-610b-46c2-b7b2-e716b6a0e1e2 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:29:14 devstack sudo[107749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2fdd8cf5-2f76-48a3-9fe4-2965d71dc30b.821e71b1-610b-46c2-b7b2-e716b6a0e1e2 Jul 10 10:29:14 devstack sudo[107749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:29:15 devstack sudo[107749]: pam_unix(sudo:session): session closed for user root Jul 10 10:29:15 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-8be30781-7881-4e1a-ae22-8aae2e7dfaeb tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2fdd8cf5-2f76-48a3-9fe4-2965d71dc30b.821e71b1-610b-46c2-b7b2-e716b6a0e1e2" returned: 0 in 0.715s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:29:15 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-8be30781-7881-4e1a-ae22-8aae2e7dfaeb tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2fdd8cf5-2f76-48a3-9fe4-2965d71dc30b.821e71b1-610b-46c2-b7b2-e716b6a0e1e2 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:29:15 devstack sudo[107754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2fdd8cf5-2f76-48a3-9fe4-2965d71dc30b.821e71b1-610b-46c2-b7b2-e716b6a0e1e2 Jul 10 10:29:15 devstack sudo[107754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:29:15 devstack sudo[107754]: pam_unix(sudo:session): session closed for user root Jul 10 10:29:15 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-8be30781-7881-4e1a-ae22-8aae2e7dfaeb tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2fdd8cf5-2f76-48a3-9fe4-2965d71dc30b.821e71b1-610b-46c2-b7b2-e716b6a0e1e2" returned: 0 in 0.650s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:29:16 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-8be30781-7881-4e1a-ae22-8aae2e7dfaeb tempest-ProjectMemberTests-915988921 None] Lock "cinder-quobyte-821e71b1-610b-46c2-b7b2-e716b6a0e1e2" released by "_delete_snapshot" :: held 2.959s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:29:16 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-8be30781-7881-4e1a-ae22-8aae2e7dfaeb tempest-ProjectMemberTests-915988921 None] Lock "cinder-quobyte-2fdd8cf5-2f76-48a3-9fe4-2965d71dc30b" released by "delete_snapshot" :: held 2.981s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:29:16 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-8be30781-7881-4e1a-ae22-8aae2e7dfaeb tempest-ProjectMemberTests-915988921 None] Created reservations ['ff0c4a66-3ff0-46bd-9b7b-f465a3a6b602', '329d7b49-cede-46b0-b9bd-22bddaa57896', '8cc59765-bc0b-4004-ba9c-545466442c9d', '551b7b25-28d3-4f0d-a3e5-35602045d7aa'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:29:16 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-8be30781-7881-4e1a-ae22-8aae2e7dfaeb tempest-ProjectMemberTests-915988921 None] Delete snapshot completed successfully. Jul 10 10:29:16 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-8be30781-7881-4e1a-ae22-8aae2e7dfaeb tempest-ProjectMemberTests-915988921 None] Lock "cinder-821e71b1-610b-46c2-b7b2-e716b6a0e1e2-delete_snapshot" released by "delete_snapshot" :: held 3.109s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:29:16 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-58a9b7aa-b197-4b5d-a7ba-6a7a704897f4 tempest-ProjectMemberTests-915988921 None] Acquiring lock "cinder-2fdd8cf5-2f76-48a3-9fe4-2965d71dc30b-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:29:16 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-58a9b7aa-b197-4b5d-a7ba-6a7a704897f4 tempest-ProjectMemberTests-915988921 None] Lock "cinder-2fdd8cf5-2f76-48a3-9fe4-2965d71dc30b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:29:16 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-58a9b7aa-b197-4b5d-a7ba-6a7a704897f4 tempest-ProjectMemberTests-915988921 None] Acquiring lock "cinder-quobyte-2fdd8cf5-2f76-48a3-9fe4-2965d71dc30b" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:29:16 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-58a9b7aa-b197-4b5d-a7ba-6a7a704897f4 tempest-ProjectMemberTests-915988921 None] Lock "cinder-quobyte-2fdd8cf5-2f76-48a3-9fe4-2965d71dc30b" acquired by "delete_volume" :: waited 0.017s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:29:16 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ade836-c690-40d8-88d5-f6dddcdb984b]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:29:16 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-58a9b7aa-b197-4b5d-a7ba-6a7a704897f4 tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2fdd8cf5-2f76-48a3-9fe4-2965d71dc30b {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:29:16 devstack sudo[107757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2fdd8cf5-2f76-48a3-9fe4-2965d71dc30b Jul 10 10:29:16 devstack sudo[107757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:29:17 devstack sudo[107757]: pam_unix(sudo:session): session closed for user root Jul 10 10:29:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-58a9b7aa-b197-4b5d-a7ba-6a7a704897f4 tempest-ProjectMemberTests-915988921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2fdd8cf5-2f76-48a3-9fe4-2965d71dc30b" returned: 0 in 0.737s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:29:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-58a9b7aa-b197-4b5d-a7ba-6a7a704897f4 tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2fdd8cf5-2f76-48a3-9fe4-2965d71dc30b {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:29:17 devstack sudo[107762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2fdd8cf5-2f76-48a3-9fe4-2965d71dc30b Jul 10 10:29:17 devstack sudo[107762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:29:17 devstack sudo[107762]: pam_unix(sudo:session): session closed for user root Jul 10 10:29:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-58a9b7aa-b197-4b5d-a7ba-6a7a704897f4 tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-2fdd8cf5-2f76-48a3-9fe4-2965d71dc30b" returned: 0 in 0.621s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:29:17 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-58a9b7aa-b197-4b5d-a7ba-6a7a704897f4 tempest-ProjectMemberTests-915988921 None] Lock "cinder-quobyte-2fdd8cf5-2f76-48a3-9fe4-2965d71dc30b" released by "delete_volume" :: held 1.412s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:29:17 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-58a9b7aa-b197-4b5d-a7ba-6a7a704897f4 tempest-ProjectMemberTests-915988921 None] Created reservations ['8645e4ea-817b-4312-96de-b457acd16fda', '2bd8e911-c4eb-4984-b486-8f0213822121', 'd8bc3c5d-232e-48af-9b27-07bb1e9669d5', '4cd63c76-4a62-497b-9854-54284551fed6'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:29:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-58a9b7aa-b197-4b5d-a7ba-6a7a704897f4 tempest-ProjectMemberTests-915988921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:29:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-58a9b7aa-b197-4b5d-a7ba-6a7a704897f4 tempest-ProjectMemberTests-915988921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:29:17 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-58a9b7aa-b197-4b5d-a7ba-6a7a704897f4 tempest-ProjectMemberTests-915988921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:29:17 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-58a9b7aa-b197-4b5d-a7ba-6a7a704897f4 tempest-ProjectMemberTests-915988921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:29:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-58a9b7aa-b197-4b5d-a7ba-6a7a704897f4 tempest-ProjectMemberTests-915988921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:29:17 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-58a9b7aa-b197-4b5d-a7ba-6a7a704897f4 tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:29:17 devstack sudo[107766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:29:17 devstack sudo[107766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:29:18 devstack sudo[107766]: pam_unix(sudo:session): session closed for user root Jul 10 10:29:18 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-58a9b7aa-b197-4b5d-a7ba-6a7a704897f4 tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.653s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:29:18 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-58a9b7aa-b197-4b5d-a7ba-6a7a704897f4 tempest-ProjectMemberTests-915988921 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:29:18 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-58a9b7aa-b197-4b5d-a7ba-6a7a704897f4 tempest-ProjectMemberTests-915988921 None] Deleted volume successfully. Jul 10 10:29:18 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-58a9b7aa-b197-4b5d-a7ba-6a7a704897f4 tempest-ProjectMemberTests-915988921 None] Lock "cinder-2fdd8cf5-2f76-48a3-9fe4-2965d71dc30b-delete_volume" released by "delete_volume" :: held 2.257s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:29:18 devstack cinder-volume[87234]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f1b9ebf-fc3d-4ba4-a5d6-d066ef62ff4d tempest-ProjectMemberTests-915988921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87234) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 10:29:18 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8f1b9ebf-fc3d-4ba4-a5d6-d066ef62ff4d tempest-ProjectMemberTests-915988921 None] Flow 'volume_create_manager' (6e4bd6fb-985e-42de-be11-445a8c839415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:29:18 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8f1b9ebf-fc3d-4ba4-a5d6-d066ef62ff4d tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0191d9f5-0b15-4ab6-9758-75e155a33ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:29:18 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8f1b9ebf-fc3d-4ba4-a5d6-d066ef62ff4d tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0191d9f5-0b15-4ab6-9758-75e155a33ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:29:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1538245943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3481ac3f-8a59-4a00-9f6a-edbd41ea767a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac4b039bd3aa49f393fe3462e2fed6d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:29:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:29:19Z,use_quota=True,user_id='cc3f433661ac4946825a66613f6d748c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:29:18 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8f1b9ebf-fc3d-4ba4-a5d6-d066ef62ff4d tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7147c751-83b4-4b27-8158-0c727bc98c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:29:18 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8f1b9ebf-fc3d-4ba4-a5d6-d066ef62ff4d tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7147c751-83b4-4b27-8158-0c727bc98c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:29:18 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8f1b9ebf-fc3d-4ba4-a5d6-d066ef62ff4d tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6e95821-a1ea-4380-9fe1-fd92fd6aabe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:29:18 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8f1b9ebf-fc3d-4ba4-a5d6-d066ef62ff4d tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6e95821-a1ea-4380-9fe1-fd92fd6aabe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3481ac3f-8a59-4a00-9f6a-edbd41ea767a', 'volume_name': 'volume-3481ac3f-8a59-4a00-9f6a-edbd41ea767a', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:29:18 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8f1b9ebf-fc3d-4ba4-a5d6-d066ef62ff4d tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb613aea-759f-4de7-adce-cda6982f7396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:29:18 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8f1b9ebf-fc3d-4ba4-a5d6-d066ef62ff4d tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb613aea-759f-4de7-adce-cda6982f7396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:29:18 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8f1b9ebf-fc3d-4ba4-a5d6-d066ef62ff4d tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2affe9c9-3d5a-4496-9087-d08405a0a7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:29:18 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-8f1b9ebf-fc3d-4ba4-a5d6-d066ef62ff4d tempest-ProjectMemberTests-915988921 None] Volume 3481ac3f-8a59-4a00-9f6a-edbd41ea767a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3481ac3f-8a59-4a00-9f6a-edbd41ea767a', 'volume_size': 1} Jul 10 10:29:18 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-8f1b9ebf-fc3d-4ba4-a5d6-d066ef62ff4d tempest-ProjectMemberTests-915988921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:29:18 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-8f1b9ebf-fc3d-4ba4-a5d6-d066ef62ff4d tempest-ProjectMemberTests-915988921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:29:18 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-8f1b9ebf-fc3d-4ba4-a5d6-d066ef62ff4d tempest-ProjectMemberTests-915988921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T08:29:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1538245943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3481ac3f-8a59-4a00-9f6a-edbd41ea767a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac4b039bd3aa49f393fe3462e2fed6d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T08:29:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T08:29:19Z,use_quota=True,user_id='cc3f433661ac4946825a66613f6d748c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2dba730-9638-4ca3-944e-ae3eff78e12e),volume_type_id=b2dba730-9638-4ca3-944e-ae3eff78e12e)}" {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 10:29:18 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-8f1b9ebf-fc3d-4ba4-a5d6-d066ef62ff4d tempest-ProjectMemberTests-915988921 None] Creating volume 3481ac3f-8a59-4a00-9f6a-edbd41ea767a {{(pid=87234) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 10:29:18 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-8f1b9ebf-fc3d-4ba4-a5d6-d066ef62ff4d tempest-ProjectMemberTests-915988921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:29:18 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-8f1b9ebf-fc3d-4ba4-a5d6-d066ef62ff4d tempest-ProjectMemberTests-915988921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:29:18 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-8f1b9ebf-fc3d-4ba4-a5d6-d066ef62ff4d tempest-ProjectMemberTests-915988921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:29:18 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-8f1b9ebf-fc3d-4ba4-a5d6-d066ef62ff4d tempest-ProjectMemberTests-915988921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:29:18 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-8f1b9ebf-fc3d-4ba4-a5d6-d066ef62ff4d tempest-ProjectMemberTests-915988921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:29:18 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-8f1b9ebf-fc3d-4ba4-a5d6-d066ef62ff4d tempest-ProjectMemberTests-915988921 None] Selected osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 as target Quobyte volume. {{(pid=87234) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 10:29:18 devstack cinder-volume[87234]: INFO cinder.volume.drivers.remotefs [None req-8f1b9ebf-fc3d-4ba4-a5d6-d066ef62ff4d tempest-ProjectMemberTests-915988921 None] casted to osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091 Jul 10 10:29:18 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-8f1b9ebf-fc3d-4ba4-a5d6-d066ef62ff4d tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3481ac3f-8a59-4a00-9f6a-edbd41ea767a 1073741824 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:29:18 devstack sudo[107769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3481ac3f-8a59-4a00-9f6a-edbd41ea767a 1073741824 Jul 10 10:29:18 devstack sudo[107769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:29:19 devstack sudo[107769]: pam_unix(sudo:session): session closed for user root Jul 10 10:29:19 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-8f1b9ebf-fc3d-4ba4-a5d6-d066ef62ff4d tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3481ac3f-8a59-4a00-9f6a-edbd41ea767a 1073741824" returned: 0 in 0.828s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:29:19 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-8f1b9ebf-fc3d-4ba4-a5d6-d066ef62ff4d tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3481ac3f-8a59-4a00-9f6a-edbd41ea767a {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:29:19 devstack sudo[107775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3481ac3f-8a59-4a00-9f6a-edbd41ea767a Jul 10 10:29:19 devstack sudo[107775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:29:20 devstack sudo[107775]: pam_unix(sudo:session): session closed for user root Jul 10 10:29:20 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-8f1b9ebf-fc3d-4ba4-a5d6-d066ef62ff4d tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3481ac3f-8a59-4a00-9f6a-edbd41ea767a" returned: 0 in 0.627s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:29:20 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-8f1b9ebf-fc3d-4ba4-a5d6-d066ef62ff4d tempest-ProjectMemberTests-915988921 None] <== create_volume: return (1497ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'} {{(pid=87234) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 10:29:20 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-8f1b9ebf-fc3d-4ba4-a5d6-d066ef62ff4d tempest-ProjectMemberTests-915988921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.500s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:29:20 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8f1b9ebf-fc3d-4ba4-a5d6-d066ef62ff4d tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2affe9c9-3d5a-4496-9087-d08405a0a7b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3481ac3f-8a59-4a00-9f6a-edbd41ea767a', 'volume_size': 1}' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:29:20 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8f1b9ebf-fc3d-4ba4-a5d6-d066ef62ff4d tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8da650b2-6960-4e01-855e-cfa0557dbad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 10:29:20 devstack cinder-volume[87234]: INFO cinder.volume.flows.manager.create_volume [None req-8f1b9ebf-fc3d-4ba4-a5d6-d066ef62ff4d tempest-ProjectMemberTests-915988921 None] Volume volume-3481ac3f-8a59-4a00-9f6a-edbd41ea767a (3481ac3f-8a59-4a00-9f6a-edbd41ea767a): created successfully Jul 10 10:29:20 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8f1b9ebf-fc3d-4ba4-a5d6-d066ef62ff4d tempest-ProjectMemberTests-915988921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8da650b2-6960-4e01-855e-cfa0557dbad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87234) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 10:29:20 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-8f1b9ebf-fc3d-4ba4-a5d6-d066ef62ff4d tempest-ProjectMemberTests-915988921 None] Flow 'volume_create_manager' (6e4bd6fb-985e-42de-be11-445a8c839415) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87234) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 10:29:20 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-8f1b9ebf-fc3d-4ba4-a5d6-d066ef62ff4d tempest-ProjectMemberTests-915988921 None] Created volume successfully. Jul 10 10:29:21 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-ffae391b-97bf-454c-bd73-ab67601dc654 tempest-ProjectMemberTests-915988921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:29:21 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-ffae391b-97bf-454c-bd73-ab67601dc654 tempest-ProjectMemberTests-915988921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:29:21 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-ffae391b-97bf-454c-bd73-ab67601dc654 tempest-ProjectMemberTests-915988921 None] Creating offline snapshot 1ec9ab38-cc64-414a-9385-2b06631833be of volume 3481ac3f-8a59-4a00-9f6a-edbd41ea767a {{(pid=87234) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 10:29:21 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8c9785-b0e7-4e16-a8e0-4feacdc14c6d]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:29:21 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ffae391b-97bf-454c-bd73-ab67601dc654 tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3481ac3f-8a59-4a00-9f6a-edbd41ea767a {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:29:21 devstack sudo[107778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3481ac3f-8a59-4a00-9f6a-edbd41ea767a Jul 10 10:29:21 devstack sudo[107778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:29:21 devstack sudo[107778]: pam_unix(sudo:session): session closed for user root Jul 10 10:29:21 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ffae391b-97bf-454c-bd73-ab67601dc654 tempest-ProjectMemberTests-915988921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3481ac3f-8a59-4a00-9f6a-edbd41ea767a" returned: 0 in 0.753s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:29:21 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ffae391b-97bf-454c-bd73-ab67601dc654 tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3481ac3f-8a59-4a00-9f6a-edbd41ea767a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3481ac3f-8a59-4a00-9f6a-edbd41ea767a.1ec9ab38-cc64-414a-9385-2b06631833be 1G {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:29:21 devstack sudo[107783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3481ac3f-8a59-4a00-9f6a-edbd41ea767a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3481ac3f-8a59-4a00-9f6a-edbd41ea767a.1ec9ab38-cc64-414a-9385-2b06631833be 1G Jul 10 10:29:21 devstack sudo[107783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:29:22 devstack sudo[107783]: pam_unix(sudo:session): session closed for user root Jul 10 10:29:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ffae391b-97bf-454c-bd73-ab67601dc654 tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3481ac3f-8a59-4a00-9f6a-edbd41ea767a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3481ac3f-8a59-4a00-9f6a-edbd41ea767a.1ec9ab38-cc64-414a-9385-2b06631833be 1G" returned: 0 in 0.806s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:29:22 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ffae391b-97bf-454c-bd73-ab67601dc654 tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3481ac3f-8a59-4a00-9f6a-edbd41ea767a -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3481ac3f-8a59-4a00-9f6a-edbd41ea767a.1ec9ab38-cc64-414a-9385-2b06631833be {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:29:22 devstack sudo[107826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3481ac3f-8a59-4a00-9f6a-edbd41ea767a -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3481ac3f-8a59-4a00-9f6a-edbd41ea767a.1ec9ab38-cc64-414a-9385-2b06631833be Jul 10 10:29:22 devstack sudo[107826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:29:23 devstack sudo[107826]: pam_unix(sudo:session): session closed for user root Jul 10 10:29:23 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ffae391b-97bf-454c-bd73-ab67601dc654 tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3481ac3f-8a59-4a00-9f6a-edbd41ea767a -F qcow2 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3481ac3f-8a59-4a00-9f6a-edbd41ea767a.1ec9ab38-cc64-414a-9385-2b06631833be" returned: 0 in 0.687s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:29:23 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-ffae391b-97bf-454c-bd73-ab67601dc654 tempest-ProjectMemberTests-915988921 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3481ac3f-8a59-4a00-9f6a-edbd41ea767a.1ec9ab38-cc64-414a-9385-2b06631833be is being set with open permissions: ugo+rw Jul 10 10:29:23 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ffae391b-97bf-454c-bd73-ab67601dc654 tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3481ac3f-8a59-4a00-9f6a-edbd41ea767a.1ec9ab38-cc64-414a-9385-2b06631833be {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:29:23 devstack sudo[107831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3481ac3f-8a59-4a00-9f6a-edbd41ea767a.1ec9ab38-cc64-414a-9385-2b06631833be Jul 10 10:29:23 devstack sudo[107831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:29:23 devstack sudo[107831]: pam_unix(sudo:session): session closed for user root Jul 10 10:29:23 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ffae391b-97bf-454c-bd73-ab67601dc654 tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3481ac3f-8a59-4a00-9f6a-edbd41ea767a.1ec9ab38-cc64-414a-9385-2b06631833be" returned: 0 in 0.633s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:29:23 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ffae391b-97bf-454c-bd73-ab67601dc654 tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3481ac3f-8a59-4a00-9f6a-edbd41ea767a.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:29:24 devstack sudo[107834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3481ac3f-8a59-4a00-9f6a-edbd41ea767a.info Jul 10 10:29:24 devstack sudo[107834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:29:24 devstack sudo[107834]: pam_unix(sudo:session): session closed for user root Jul 10 10:29:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ffae391b-97bf-454c-bd73-ab67601dc654 tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3481ac3f-8a59-4a00-9f6a-edbd41ea767a.info" returned: 0 in 0.648s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:29:24 devstack cinder-volume[87234]: WARNING cinder.volume.drivers.remotefs [None req-ffae391b-97bf-454c-bd73-ab67601dc654 tempest-ProjectMemberTests-915988921 None] /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3481ac3f-8a59-4a00-9f6a-edbd41ea767a.info is being set with open permissions: ugo+rw Jul 10 10:29:24 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ffae391b-97bf-454c-bd73-ab67601dc654 tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3481ac3f-8a59-4a00-9f6a-edbd41ea767a.info {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:29:24 devstack sudo[107837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3481ac3f-8a59-4a00-9f6a-edbd41ea767a.info Jul 10 10:29:24 devstack sudo[107837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:29:25 devstack sudo[107837]: pam_unix(sudo:session): session closed for user root Jul 10 10:29:25 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-ffae391b-97bf-454c-bd73-ab67601dc654 tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3481ac3f-8a59-4a00-9f6a-edbd41ea767a.info" returned: 0 in 0.635s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:29:25 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-ffae391b-97bf-454c-bd73-ab67601dc654 tempest-ProjectMemberTests-915988921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.242s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:29:25 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-ffae391b-97bf-454c-bd73-ab67601dc654 tempest-ProjectMemberTests-915988921 None] Create snapshot completed successfully Jul 10 10:29:26 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-a80d5c90-810d-4314-8c13-0dd8f3187e64 tempest-ProjectMemberTests-915988921 None] Acquiring lock "cinder-1ec9ab38-cc64-414a-9385-2b06631833be-delete_snapshot" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:29:26 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-a80d5c90-810d-4314-8c13-0dd8f3187e64 tempest-ProjectMemberTests-915988921 None] Lock "cinder-1ec9ab38-cc64-414a-9385-2b06631833be-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:29:26 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-a80d5c90-810d-4314-8c13-0dd8f3187e64 tempest-ProjectMemberTests-915988921 None] Acquiring lock "cinder-quobyte-3481ac3f-8a59-4a00-9f6a-edbd41ea767a" by "delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:29:26 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-a80d5c90-810d-4314-8c13-0dd8f3187e64 tempest-ProjectMemberTests-915988921 None] Lock "cinder-quobyte-3481ac3f-8a59-4a00-9f6a-edbd41ea767a" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:29:26 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-a80d5c90-810d-4314-8c13-0dd8f3187e64 tempest-ProjectMemberTests-915988921 None] Acquiring lock "cinder-quobyte-1ec9ab38-cc64-414a-9385-2b06631833be" by "_delete_snapshot" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:29:26 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-a80d5c90-810d-4314-8c13-0dd8f3187e64 tempest-ProjectMemberTests-915988921 None] Lock "cinder-quobyte-1ec9ab38-cc64-414a-9385-2b06631833be" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:29:26 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-a80d5c90-810d-4314-8c13-0dd8f3187e64 tempest-ProjectMemberTests-915988921 None] Deleting offline snapshot 1ec9ab38-cc64-414a-9385-2b06631833be of volume 3481ac3f-8a59-4a00-9f6a-edbd41ea767a {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 10:29:26 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-a80d5c90-810d-4314-8c13-0dd8f3187e64 tempest-ProjectMemberTests-915988921 None] snapshot_file for this snap is: volume-3481ac3f-8a59-4a00-9f6a-edbd41ea767a.1ec9ab38-cc64-414a-9385-2b06631833be {{(pid=87234) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 10:29:26 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e63864a-ead0-4d24-9ad9-7da69dda7d8c]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:29:26 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a80d5c90-810d-4314-8c13-0dd8f3187e64 tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3481ac3f-8a59-4a00-9f6a-edbd41ea767a.1ec9ab38-cc64-414a-9385-2b06631833be {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:29:26 devstack sudo[107840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3481ac3f-8a59-4a00-9f6a-edbd41ea767a.1ec9ab38-cc64-414a-9385-2b06631833be Jul 10 10:29:26 devstack sudo[107840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:29:27 devstack sudo[107840]: pam_unix(sudo:session): session closed for user root Jul 10 10:29:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a80d5c90-810d-4314-8c13-0dd8f3187e64 tempest-ProjectMemberTests-915988921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3481ac3f-8a59-4a00-9f6a-edbd41ea767a.1ec9ab38-cc64-414a-9385-2b06631833be" returned: 0 in 0.772s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:29:27 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.remotefs [None req-a80d5c90-810d-4314-8c13-0dd8f3187e64 tempest-ProjectMemberTests-915988921 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3481ac3f-8a59-4a00-9f6a-edbd41ea767a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87234) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 10:29:27 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ac177b-79e8-4f4a-b4e2-5bb335a61a7b]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:29:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a80d5c90-810d-4314-8c13-0dd8f3187e64 tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3481ac3f-8a59-4a00-9f6a-edbd41ea767a {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:29:27 devstack sudo[107845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3481ac3f-8a59-4a00-9f6a-edbd41ea767a Jul 10 10:29:27 devstack sudo[107845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:29:27 devstack sudo[107845]: pam_unix(sudo:session): session closed for user root Jul 10 10:29:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a80d5c90-810d-4314-8c13-0dd8f3187e64 tempest-ProjectMemberTests-915988921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3481ac3f-8a59-4a00-9f6a-edbd41ea767a" returned: 0 in 0.747s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:29:27 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a80d5c90-810d-4314-8c13-0dd8f3187e64 tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3481ac3f-8a59-4a00-9f6a-edbd41ea767a.1ec9ab38-cc64-414a-9385-2b06631833be {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:29:28 devstack sudo[107851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3481ac3f-8a59-4a00-9f6a-edbd41ea767a.1ec9ab38-cc64-414a-9385-2b06631833be Jul 10 10:29:28 devstack sudo[107851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:29:28 devstack sudo[107851]: pam_unix(sudo:session): session closed for user root Jul 10 10:29:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a80d5c90-810d-4314-8c13-0dd8f3187e64 tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3481ac3f-8a59-4a00-9f6a-edbd41ea767a.1ec9ab38-cc64-414a-9385-2b06631833be" returned: 0 in 0.711s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:29:28 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a80d5c90-810d-4314-8c13-0dd8f3187e64 tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3481ac3f-8a59-4a00-9f6a-edbd41ea767a.1ec9ab38-cc64-414a-9385-2b06631833be {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:29:28 devstack sudo[107857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3481ac3f-8a59-4a00-9f6a-edbd41ea767a.1ec9ab38-cc64-414a-9385-2b06631833be Jul 10 10:29:28 devstack sudo[107857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:29:29 devstack sudo[107857]: pam_unix(sudo:session): session closed for user root Jul 10 10:29:29 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-a80d5c90-810d-4314-8c13-0dd8f3187e64 tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3481ac3f-8a59-4a00-9f6a-edbd41ea767a.1ec9ab38-cc64-414a-9385-2b06631833be" returned: 0 in 0.625s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:29:29 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-a80d5c90-810d-4314-8c13-0dd8f3187e64 tempest-ProjectMemberTests-915988921 None] Lock "cinder-quobyte-1ec9ab38-cc64-414a-9385-2b06631833be" released by "_delete_snapshot" :: held 2.950s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:29:29 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-a80d5c90-810d-4314-8c13-0dd8f3187e64 tempest-ProjectMemberTests-915988921 None] Lock "cinder-quobyte-3481ac3f-8a59-4a00-9f6a-edbd41ea767a" released by "delete_snapshot" :: held 2.971s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:29:29 devstack cinder-volume[87234]: DEBUG dbcounter [-] [87234] Writing DB stats cinder:DELETE=9,cinder:SELECT=84,cinder:INSERT=26,cinder:UPDATE=120 {{(pid=87234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 10:29:29 devstack cinder-volume[87234]: DEBUG dbcounter [-] [87234] Writing DB stats cinder:SELECT=86,cinder:INSERT=34,cinder:UPDATE=112,cinder:DELETE=12 {{(pid=87234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 10:29:29 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-a80d5c90-810d-4314-8c13-0dd8f3187e64 tempest-ProjectMemberTests-915988921 None] Created reservations ['c1a62c14-91cc-4794-833c-b91773c191a9', 'c821b921-28fe-4fa3-93ff-6726c541507d', '1667f11b-fdb9-4f85-a878-10d3ef1c9e9d', '6fee1ff0-657e-4593-86f6-c22b0e44a46b'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:29:29 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-a80d5c90-810d-4314-8c13-0dd8f3187e64 tempest-ProjectMemberTests-915988921 None] Delete snapshot completed successfully. Jul 10 10:29:29 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-a80d5c90-810d-4314-8c13-0dd8f3187e64 tempest-ProjectMemberTests-915988921 None] Lock "cinder-1ec9ab38-cc64-414a-9385-2b06631833be-delete_snapshot" released by "delete_snapshot" :: held 3.209s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:29:30 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-65502521-72ff-4c5f-9309-b42c5183ba3b tempest-ProjectMemberTests-915988921 None] Acquiring lock "cinder-3481ac3f-8a59-4a00-9f6a-edbd41ea767a-delete_volume" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:29:30 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-65502521-72ff-4c5f-9309-b42c5183ba3b tempest-ProjectMemberTests-915988921 None] Lock "cinder-3481ac3f-8a59-4a00-9f6a-edbd41ea767a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:29:30 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-65502521-72ff-4c5f-9309-b42c5183ba3b tempest-ProjectMemberTests-915988921 None] Acquiring lock "cinder-quobyte-3481ac3f-8a59-4a00-9f6a-edbd41ea767a" by "delete_volume" {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 10:29:30 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-65502521-72ff-4c5f-9309-b42c5183ba3b tempest-ProjectMemberTests-915988921 None] Lock "cinder-quobyte-3481ac3f-8a59-4a00-9f6a-edbd41ea767a" acquired by "delete_volume" :: waited 0.017s {{(pid=87234) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 10:29:30 devstack cinder-volume[87234]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f787cb-841d-4325-aedd-841b506b66df]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 10:29:30 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-65502521-72ff-4c5f-9309-b42c5183ba3b tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3481ac3f-8a59-4a00-9f6a-edbd41ea767a {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:29:30 devstack sudo[107860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3481ac3f-8a59-4a00-9f6a-edbd41ea767a Jul 10 10:29:30 devstack sudo[107860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:29:31 devstack sudo[107860]: pam_unix(sudo:session): session closed for user root Jul 10 10:29:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-65502521-72ff-4c5f-9309-b42c5183ba3b tempest-ProjectMemberTests-915988921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3481ac3f-8a59-4a00-9f6a-edbd41ea767a" returned: 0 in 0.772s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:29:31 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-65502521-72ff-4c5f-9309-b42c5183ba3b tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3481ac3f-8a59-4a00-9f6a-edbd41ea767a {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:29:31 devstack sudo[107871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3481ac3f-8a59-4a00-9f6a-edbd41ea767a Jul 10 10:29:31 devstack sudo[107871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:29:32 devstack sudo[107871]: pam_unix(sudo:session): session closed for user root Jul 10 10:29:32 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-65502521-72ff-4c5f-9309-b42c5183ba3b tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0/volume-3481ac3f-8a59-4a00-9f6a-edbd41ea767a" returned: 0 in 0.634s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:29:32 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-65502521-72ff-4c5f-9309-b42c5183ba3b tempest-ProjectMemberTests-915988921 None] Lock "cinder-quobyte-3481ac3f-8a59-4a00-9f6a-edbd41ea767a" released by "delete_volume" :: held 1.460s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:29:32 devstack cinder-volume[87234]: DEBUG cinder.quota [None req-65502521-72ff-4c5f-9309-b42c5183ba3b tempest-ProjectMemberTests-915988921 None] Created reservations ['188cb715-1b12-4682-b3cb-24ad5a992fb9', 'e02b1fd4-bf45-4fc0-9ba3-da4ac81a03dd', 'daebef30-6a35-4d4f-a17e-89726cc9266a', '134595ca-2ef8-45c8-9852-887cc1717697'] {{(pid=87234) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 10:29:32 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-65502521-72ff-4c5f-9309-b42c5183ba3b tempest-ProjectMemberTests-915988921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:29:32 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-65502521-72ff-4c5f-9309-b42c5183ba3b tempest-ProjectMemberTests-915988921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:29:32 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-65502521-72ff-4c5f-9309-b42c5183ba3b tempest-ProjectMemberTests-915988921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:29:32 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-65502521-72ff-4c5f-9309-b42c5183ba3b tempest-ProjectMemberTests-915988921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:29:32 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-65502521-72ff-4c5f-9309-b42c5183ba3b tempest-ProjectMemberTests-915988921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:29:32 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-65502521-72ff-4c5f-9309-b42c5183ba3b tempest-ProjectMemberTests-915988921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:29:32 devstack sudo[107874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:29:32 devstack sudo[107874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:29:32 devstack sudo[107874]: pam_unix(sudo:session): session closed for user root Jul 10 10:29:32 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-65502521-72ff-4c5f-9309-b42c5183ba3b tempest-ProjectMemberTests-915988921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.636s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:29:32 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-65502521-72ff-4c5f-9309-b42c5183ba3b tempest-ProjectMemberTests-915988921 None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:29:32 devstack cinder-volume[87234]: INFO cinder.volume.manager [None req-65502521-72ff-4c5f-9309-b42c5183ba3b tempest-ProjectMemberTests-915988921 None] Deleted volume successfully. Jul 10 10:29:32 devstack cinder-volume[87234]: DEBUG cinder.coordination [None req-65502521-72ff-4c5f-9309-b42c5183ba3b tempest-ProjectMemberTests-915988921 None] Lock "cinder-3481ac3f-8a59-4a00-9f6a-edbd41ea767a-delete_volume" released by "delete_volume" :: held 2.291s {{(pid=87234) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 10:29:42 devstack cinder-volume[87234]: DEBUG oslo_service.periodic_task [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 10:29:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 10:29:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 10:29:42 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091': None} {{(pid=87234) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 10:29:42 devstack cinder-volume[87234]: DEBUG cinder.volume.drivers.quobyte [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7373fad0-27c8-4990-938c-d4bb4c080091'] {{(pid=87234) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 10:29:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.lockutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87234) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 10:29:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 10:29:42 devstack sudo[107879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0 Jul 10 10:29:42 devstack sudo[107879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 10:29:42 devstack cinder-volume[87234]: DEBUG dbcounter [-] [87234] Writing DB stats cinder:SELECT=10,cinder:INSERT=7,cinder:UPDATE=21 {{(pid=87234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 10:29:42 devstack sudo[107879]: pam_unix(sudo:session): session closed for user root Jul 10 10:29:42 devstack cinder-volume[87234]: DEBUG oslo_concurrency.processutils [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5e2021f47e20b61eec9ec0797097bb0" returned: 0 in 0.621s {{(pid=87234) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 10:29:42 devstack cinder-volume[87234]: DEBUG cinder.manager [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Notifying Schedulers of capabilities ... {{(pid=87234) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 10:29:42 devstack cinder-volume[87234]: DEBUG oslo_service.periodic_task [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] Running periodic task VolumeManager._thread_info {{(pid=87234) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 10:29:42 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] thread count: 28 {{(pid=87234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 10:29:42 devstack cinder-volume[87234]: DEBUG cinder.volume.manager [None req-286d9a6b-6829-4281-8258-e2b42c487a90 None None] thread info: [<_MainThread(MainThread, started 131600773742720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87234) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 10:29:42 devstack cinder-volume[87234]: DEBUG dbcounter [-] [87234] Writing DB stats cinder:SELECT=7,cinder:INSERT=1,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=87234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}